Information processing device

Abstract

To provide a human interface with excellent operability and a novel information processing apparatus with excellent operability.SOLUTION: An information processing apparatus is configured to include a flexible position input section that can detect an object in proximity or contact and supply position information. The flexible position input section can be folded to form a first region, a second region facing the first region, and a third region overlapping a display section between the first region and the second region.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an article, a method, or a manufacturing method. , manufacture, or composition of matter. The present invention relates to, for example, a semiconductor device, a display device, a light emitting device, a driving method thereof, or In particular, the present invention relates to a method for processing and displaying image information, a program and a device having a storage medium in which a program is stored. Image information processing and display method for displaying an image including information processed by an information processing device and a program for displaying an image including processed information on an information processing device having a display unit. The present invention also relates to an information processing device having a storage medium in which the program is stored. [Background technology]

[0002] A display device with a large screen can display a lot of information. Therefore, it has an advantage in viewability. This makes it suitable for information processing devices.

[0003] In addition, the social infrastructure related to information transmission methods has been improved. This allows for a wide range of information to be available. It is possible to obtain, process, or transmit information using information processing devices not only at work or at home but also on the go. It has become.

[0004] In this context, portable information processing devices have been actively developed.

[0005] Portable information processing devices are often used outdoors, and if they are dropped, unexpected force may be applied to the information processing device. This may affect the display device and the display unit used in it. For example, a structure is known in which the adhesion between the structure separating the light-emitting layer and the second electrode layer is improved. (Patent Document 1). [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2012-190794 A Summary of the Invention [Problem to be solved by the invention]

[0007] One aspect of the present invention is to provide a novel human interface with excellent operability. Another object of the present invention is to provide a novel information processing device or display device with excellent operability. This is one of the challenges.

[0008] The description of these problems does not preclude the existence of other problems. It is not necessary for the embodiment to solve all of these problems. The above will become apparent from the description in the specification, drawings, claims, etc. It is possible to extract other issues from the descriptions in the patent, claims, etc. [Means for solving the problem]

[0009] One aspect of the present invention is an input / output device that supplies position information and receives image information; and a computing unit that receives the image information and provides the image information.

[0010] The input / output device includes a position input unit and a display unit. The position input unit includes a first area and a second region facing the first region, and a third region between the first region and the second region; The flexible member has a flexibility that allows it to be bent so as to form a

[0011] The display unit is disposed so as to overlap the third region, and receives image information and displays the image information. The arithmetic device includes a calculation unit and a storage unit that stores a program to be executed by the calculation unit. .

[0012] The information processing device according to the embodiment of the present invention detects an object in proximity or in contact with the object and outputs position information. As described above, the flexible position input unit can be The portion includes a first region, a second region facing the first region, and a first region and a second region. The display unit can be folded so that a third region overlapping the display unit is formed between the first region and the second region. For example, when either the palm or the fingers of the hand are close to either the first region or the second region, As a result, it is possible to know whether the user has touched the screen or not. Alternatively, a novel information processing device with excellent operability can be provided.

[0013] In addition, the information processing device according to one embodiment of the present invention provides detection information including position information and folding information. and an input / output device to which image information is supplied, and which is supplied with position information and detection information and which outputs an image. The folding information is provided by the information processing device. Contains information to distinguish between the closed and expanded states.

[0014] The input / output device includes a position input unit, a display unit, and a detection unit. and a first region, a second region facing the first region, and a first region and The second region can be folded over to form a third region between the second regions. It is flexible.

[0015] The detection unit detects a folded state of the position input unit and supplies detection information including folding information. The display unit is provided with a folding sensor that can be folded so as to overlap with the third area. The image information is supplied to the computing device, and the computing device displays the image information. and a storage unit that stores a program to be executed by the calculation unit.

[0016] As described above, the information processing device according to one aspect of the present invention detects an object approaching or contacting the object. and a flexible position input unit capable of supplying position information when the flexible position input unit is folded. A detection unit including a folding sensor that can detect whether the folding mechanism is in a folded or unfolded state. The flexible position input unit is configured with a first region and a first region in a folded state. a second region facing the first region, and a third region overlapping the display unit between the first region and the second region. This allows the area to be folded so that, for example, the palm or Knowing whether any of the fingers of the hand are in proximity to or in contact with either the first area or the second area As a result, a human interface with excellent operability can be provided. Alternatively, a novel information processing device with excellent operability can be provided.

[0017] In one aspect of the present invention, the first area provides first position information and the second area provides second position information. The calculation unit calculates image information to be displayed on the display unit based on the first position information and the second position information. The information processing device generates the position information based on the result of the comparison.

[0018] In one aspect of the present invention, the storage unit determines a first line from first position information provided by the first area. A first step of determining the length of a minute and a second step of determining a second time from second position information provided by a second region. A second step of determining the length of the line segment and a step of calculating the length of the first line segment and the length of the second line segment. If only one of the lengths is longer than the specified length, proceed to the fourth step; otherwise If so, proceed to the first step. The third step is to find the coordinates of the midpoint of the line segment longer than the given length. A fourth step determines the coordinates of the midpoints, and a fifth step generates image information based on the coordinates of the midpoints. and a sixth step of terminating the process. It is an information processing device.

[0019] As described above, the information processing device according to one aspect of the present invention detects an object approaching or contacting the object. The position input unit includes a flexible position input unit capable of supplying position information, and a calculation unit. The flexible position input unit has a first region, a second region facing the first region, and a first and a third region overlapping the display unit between the second region and the second region. The calculation unit can calculate the first position information provided by the first area and the second position information provided by the second area. The second position information can be compared to generate image information to be displayed on the display unit.

[0020] This allows, for example, either the palm or the fingers of the hand to be in contact with either the first region or the second region. It determines whether the user is in close proximity to or in contact with an image arranged for easy operation (for example, an image for operation) As a result, it is possible to generate image information including the human eye image with excellent operability. Alternatively, a new information processing device with excellent operability can be provided. .

[0021] In one aspect of the present invention, the first area provides first position information and the second area provides second position information. The detection unit supplies detection information including folding information, and the calculation unit supplies a display The image information to be displayed on the folding part is determined based on the result of comparing the first position information and the second position information. The information processing device generates the image based on the image information.

[0022] In one aspect of the present invention, the storage unit determines a first line from first position information provided by the first area. A first step of determining the length of a minute and a second step of determining a second time from second position information provided by a second region. A second step of determining the length of the line segment and a step of calculating the length of the first line segment and the length of the second line segment. If only one of the two is longer than the specified length, proceed to the fourth step. If not, proceed to the first step. The third step is to find the coordinates of the midpoint of the line segment longer than the given length. The fourth step is to determine the folding information and obtain the folding information. If it shows the expanded state, go to step 7. a sixth step of generating first image information based on the coordinates of the midpoint; A seventh step of generating image information based on the coordinates of the midpoint, and an eighth step of terminating the process. and a program for causing the calculation unit to execute the above.

[0023] As described above, the information processing device according to one aspect of the present invention detects an object approaching or contacting the information processing device. and a flexible position input unit capable of supplying position information by folding the flexible position input unit. A detection unit including a folding sensor that can detect whether the folded state is in the folded state or the unfolded state, and a calculation The flexible position input unit includes a first region and a folded portion. a second region facing the first region in the state in which the first region is in contact with the second region; and a display unit between the first region and the second region. and a third region overlapping the first region. As a result of comparing the first location information provided by the first region with the second location information provided by the second region, Based on the folding information, image information to be displayed on the display unit can be generated.

[0024] This allows, for example, either the palm or the fingers of the hand to be in contact with either the first region or the second region. The position input unit can be folded to make it easier to operate. A first image (e.g., an image for operation) or a position input section arranged on the screen is expanded. and generating image information including any one of the second images arranged so as to be easily operated in a state in which the second image is displayed. As a result, a human interface with excellent operability can be provided. Alternatively, a novel information processing device with excellent operability can be provided.

[0025] In one aspect of the present invention, the display unit overlaps with the position input unit, and the display unit is in an unfolded state and a folded state. The first member has flexibility that allows it to be folded and exposed in the folded state. the information processing device comprising a first area and a second area separated from the first area by a fold. It is.

[0026] The storage unit stores a program to be executed by the calculation unit. a first step of generating initial image information; a second step of allowing interrupt processing; Step 3 and retrieving the folding information to show the folded state If it shows an expanded state, proceed to the fifth step, if it shows an expanded state, proceed to the sixth step. and a fifth step of displaying at least a portion of the provided image information in the first area. a sixth screen for displaying a part of the image information provided in the first area and another part in the second area; If an end command is provided by the interrupt process, the process proceeds to step 8. The seventh step goes to the fourth step if no value is provided, and the eighth step ends. and a.

[0027] If a page feed command is issued, the interrupt process proceeds to step 10. If no command is provided, proceed to step 11. A tenth step of generating image information based on the command and an eleventh step of returning from the interrupt process The method includes the steps of:

[0028] The information processing device according to one aspect of the present invention can be folded and unfolded. and a first area exposed in a folded state and a fold line between the first area and the fold line. and a second area separated by a second area. displaying a portion of the generated image in a first area and another portion in a second area. The processor further includes a storage unit that stores a program for causing the processor to execute the process.

[0029] As a result, for example, a display unit (first a part of one image is displayed in a second area of ​​the display unit, the second area being continuous with the first area of ​​the display unit in the developed state; In the area, another part of the image that is continuous with or related to the part of the image can be displayed. As a result, a human interface with excellent operability can be provided. It is possible to provide an excellent new information processing device. Effect of the Invention

[0030] As described above, according to one aspect of the present invention, a human interface with excellent operability is provided. Alternatively, a novel information processing device with excellent operability can be provided. It is possible to provide a novel information processing device and a novel display device. However, this does not necessarily prevent the existence of these effects. It is not necessary to have all of these effects. Effects other than these may be described in the specification, drawings, claims, etc. These and other points will become apparent from the description, drawings, claims, etc. It is possible to extract external effects. [Brief description of the drawings]

[0031] [Figure 1] FIG. 1 is a block diagram illustrating a configuration of an information processing device according to an embodiment. [Diagram 2] 1A and 1B are diagrams illustrating configurations of an information processing device and a position input unit according to an embodiment. [Diagram 3] FIG. 1 is a block diagram illustrating a configuration of an information processing device according to an embodiment. [Figure 4] 1A to 1C are diagrams illustrating an information processing device according to an embodiment in an unfolded state, a folded state, and a folded up state. [Diagram 5] 1 is a diagram illustrating a configuration of an information processing device according to an embodiment. [Figure 6] 1A and 1B are diagrams illustrating a state in which an information processing device according to an embodiment is held by a user. [Figure 7] FIG. 4 is a flow diagram for explaining a program executed by a calculation unit of the information processing device according to the embodiment. [Figure 8] 1A and 1B are diagrams illustrating a state in which an information processing device according to an embodiment is held by a user. [Figure 9] FIG. 4 is a flow diagram for explaining a program executed by a calculation unit of the information processing device according to the embodiment. [Figure 10] 5A to 5C are diagrams illustrating examples of images displayed on a display unit of an information processing device according to an embodiment. [Figure 11] FIG. 4 is a flow diagram for explaining a program executed by a calculation unit of the information processing device according to the embodiment. [Figure 12] FIG. 4 is a flow diagram for explaining a program executed by a calculation unit of the information processing device according to the embodiment. [Figure 13] 5A to 5C are diagrams illustrating examples of images displayed on a display unit of an information processing device according to an embodiment. [Figure 14] 1A to 1C illustrate a structure of a display panel that can be used for a display device according to an embodiment. [Figure 15] 1A to 1C illustrate a structure of a display panel that can be used for a display device according to an embodiment. [Figure 16] 1A to 1C illustrate a structure of a display panel that can be used for a display device according to an embodiment. [Figure 17] 1A and 1B are diagrams illustrating configurations of an information processing device and a position input unit according to an embodiment. [Figure 18] 1A and 1B are diagrams illustrating configurations of an information processing device and a position input unit according to an embodiment. [Figure 19] 1A and 1B are diagrams illustrating configurations of an information processing device and a position input unit according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0032] The information processing device according to one embodiment of the present invention detects an object in proximity or in contact with the object and supplies position information. The flexible position input unit includes a first a display unit between the first and second regions; and a third region overlapping with the third region.

[0033] This allows, for example, either the palm or the fingers of the hand to be in contact with either the first region or the second region. This allows the user to know whether the person is in close proximity to or in contact with the object. Alternatively, a new information processing device with excellent operability can be provided. .

[0034] The embodiment will be described in detail with reference to the drawings. However, the present invention is not limited to the following description. The present invention is not limited to the above embodiment, and various changes and modifications may be made in the form and details without departing from the spirit and scope of the present invention. It will be easily understood by those skilled in the art that the above-mentioned invention can be obtained by the following embodiments. The present invention should not be construed as being limited to the contents described below. The same reference numerals are used in different drawings to indicate the same parts or parts having similar functions. A repeated explanation will be omitted.

[0035] (Embodiment 1) In this embodiment, a configuration of an information processing device according to one embodiment of the present invention will be described with reference to FIGS. The following description will be given with reference to FIG.

[0036] FIG. 1 is a block diagram illustrating a configuration of an information processing device 100 according to an embodiment of the present invention.

[0037] FIG. 2A is a schematic diagram illustrating the appearance of an information processing device 100 of one embodiment of the present invention. 2B is a cross-sectional view illustrating the structure of the cross section taken along line X1-X2 shown in FIG. As shown in FIG. 2A, the display unit 130 is only displayed on the front surface of the information processing device 100. Alternatively, the side surface may be provided on the side surface of the substrate 11. As shown in FIG. 17(B), the information processing device 100 does not necessarily need to be provided on its side surface.

[0038] FIG. 2C-1 shows a position input unit 140 and a position input unit 140 which can be used in the information processing device 100 according to one embodiment of the present invention. 2C-2 is a schematic diagram for explaining the arrangement of the position input unit 140 and the display unit 130. 13 is a schematic diagram illustrating the arrangement of a proximity sensor 142. FIG.

[0039] FIG. 2(D) is a cross-sectional view of the position input unit 140 taken along the line X3-X4 shown in FIG. 2(C-2). FIG.

[0040] <Configuration example of information processing device> The information processing device 100 described here is a device that supplies position information L-INF to a housing 101 and An input / output device 120 to which image information VIDEO is supplied, and a position information L-INF to which the and a calculation device 110 that supplies the image information VIDEO (see FIG. 1 and FIG. 2(B)). .

[0041] The input / output device 120 includes a position input unit 140 that supplies position information L-INF and an image information V The display unit 130 is supplied with IDEO.

[0042] The position input unit 140, for example, includes a first area 140(1) and a second area 140(1 ) and a second region 140(2) facing the first region 140(1) and the second region 14 0(2) and a third region 140(3) can be formed between the first region 140(3) and the second region 140(2). The third region 140(3) has flexibility (see FIG. 2(B)). 0(1) and the second region 140(2), and these first to third regions are positioned together. The input unit 140 is formed.

[0043] Alternatively, a separate position input unit 140 may be provided for each area. For example, as shown in FIG. 17(C), (D), and (E), a position input section 140 (A ), position input section 140(B), position input section 140(C), position input section 140(D), position Alternatively, the input unit 140(E) may be provided separately. Input unit 140(A), position input unit 140(B), position input unit 140(C), position input unit 1 40(D) ​​and some of the position input unit 140(E) may not be provided. As shown in (G) and (H), it may be provided so as to surround the entire surface.

[0044] The arrangement of the second region 140(2) facing the first region 140(1) is the same as that of the first region 140(1). The arrangement is not limited to facing directly to the first region 140(1), but may be tilted toward the first region 140(1). This also includes arrangements such as:

[0045] The display unit 130 is supplied with image information VIDEO and is arranged so as to overlap with the third area 140(3). The calculation device 110 is arranged as shown in FIG. 2(B). The computer-implemented device includes a storage unit 112 that stores a program to be executed by the computer-implemented device 1 (see FIG. 1).

[0046] The information processing device 100 described here is a flexible position sensor that detects proximity or contact. The position input unit 140 includes a first area 140 (1 ), a second region 140(2) facing the first region 140(1), and a second region 140(2) facing the first region 140 A third area 140(3) overlapping the display unit 130 is provided between the first area 140(1) and the second area 140(2). ) and can be folded so as to form a palm or hand. When any of the fingers is close to either the first region 140(1) or the second region 140(2), As a result, it is possible to realize a human interface with excellent operability. Alternatively, a novel information processing device with excellent operability can be provided.

[0047] Below, the individual elements constituting the information processing device 100 will be described.

[0048] Input / Output Device The input / output device 120 includes a position input unit 140 and a display unit 130. , a detection unit 150, a communication unit 160, etc.

[0049] <<Location input section>> The position input unit 140 supplies the position information L-INF. By bringing a finger or a palm into close proximity to or in contact with the position input unit 140, position information L-INF is input. The input unit 140 can then supply various operation commands to the information processing device 100. For example, you can provide operation commands including an exit command (a command to end a program). This is possible (see Figure 1).

[0050] The position input unit 140 includes a first area 140(1), a second area 140(2), and a A third region 140(3) is provided between the region 140(1) and the second region 140(2) (FIG. 2 (See C-1). The first region 140(1), the second region 140(2) and the third region 140(3), the proximity sensors 142 are arranged in a matrix (FIG. 2(C- See 2).

[0051] The position input unit 140 is, for example, a flexible substrate 141 and a It has a proximity sensor 142 (see FIG. 2(D)).

[0052] The position input unit 140, for example, has a second area 140(2) and a first area 140(1). can be bent so that they face each other (see FIG. 2(B)).

[0053] The third area 140(3) of the position input unit 140 overlaps with the display unit 130 (FIG. 2(B) and 2(C-1)). The third area 140(3) is located closer to the user than the display unit 130. If present, the third region 140(3) is optically transparent.

[0054] The second region in the folded state is the first region so that the user can hold it with one hand. The distance is preferably, for example, 17 cm or less. The distance should be 9 cm or less, and more preferably 7 cm or less. Using the thumb, position information can be input over a wide area of ​​the third area 140(3). do.

[0055] This allows the user to place the base of the thumb (near the ball of the foot) in the first area 140(1) or or in close proximity to or in contact with one of the second regions 140(2) and bring a finger other than the thumb close to the other. The information processing device 100 can be grasped by touching or coming into contact with the object.

[0056] Since the shape of the base of the thumb is different from the shapes of the fingers other than the thumb, the first region 140(1) provides different position information than the second region 140(2). The shape of the portion has characteristics such as being larger than or continuous with the shape of a finger other than the thumb.

[0057] The proximity sensor 142 is a sensor that can detect proximity or contact (for example, a finger or a palm). For example, a capacitance element or an image sensor can be used. The substrate with the image sensor is called a capacitive touch sensor, and the substrate with the image sensor is called an optical touch sensor. It is possible to do so.

[0058] Resin can be used as the flexible substrate 141. Examples of resin include polyester, Polyolefin, polyamide, polyimide, polycarbonate, acrylic resin, etc. Some examples include:

[0059] In addition, a glass substrate, a quartz substrate, a semiconductor substrate, or the like having a thickness sufficient to provide flexibility is used. is possible.

[0060] Specific configuration examples applicable to the position input unit 140 will be described in the sixth and sixth embodiments. This is explained in 7.

[0061] 《Display section》 The display unit 130 is located at a position overlapping at least the third area 140(3) of the position input unit 140. In addition, the display unit 130 is arranged not only in the third area 140(3) but also in the first area 140(4). It may also be arranged to overlap with the first region 140(1) and / or the second region 140(2).

[0062] The display unit 130 may be any device capable of displaying the supplied image information VIDEO. Not determined.

[0063] The first region 140(1) and / or the second region 140(2) may include a third region 140( 3) A different operation command can be associated with the command.

[0064] This allows the user to use the display unit to select the first area 140(1) and / or the second area 140(2) can be used to verify the operation instructions associated with the This allows commands to be associated with each other, and also reduces the risk of incorrect input of operation commands.

[0065] Specific configuration examples applicable to the display unit 130 will be described in the sixth and seventh embodiments. Describe and explain.

[0066] 《Arithmetic device》 The arithmetic device 110 includes a calculation unit 111, a storage unit 112, an input / output interface 115, and It includes a transmission path 114 (see FIG. 1).

[0067] The arithmetic unit 110 receives the position information L-INF and supplies image information VIDEO.

[0068] For example, the arithmetic device 110 may receive image information VIDEO to the input / output device 120. The display unit 130 displays an image for operation.

[0069] The user can touch the third area 140(3) overlapping the display unit 130 with his / her finger. It is possible to provide position information L-INF for selecting an image.

[0070] 《Arithmetic section》 The calculation unit 111 executes a program stored in the storage unit 112. For example, When the position information L-INF associated with the displayed position is provided, the calculation unit 111 A program that is previously associated with the image is executed.

[0071] 《Memory Department》 The storage unit 112 stores the programs to be executed by the calculation unit 111 .

[0072] An example of a program to be processed by the arithmetic unit 110 will be described in the third embodiment. do.

[0073] Input / Output Interface / Transmission Path Input / output interface 115 provides and is supplied with information.

[0074] The transmission line 114 can supply information, and the calculation unit 111, the memory unit 112, and the input / output interface The interface 115 is supplied with information. The output interface 115 can provide information, and the transmission line 114 provides information. will be done.

[0075] 《Detection Unit》 The detection unit 150 detects the state of the information processing device 100 and its surroundings and outputs detection information SENS (See Figure 1.)

[0076] The detection unit 150 detects, for example, acceleration, direction, pressure, and navigation satellite system (NSS). tion satellite system) signals, temperature or humidity, etc., Specifically, the information on GPS (Global Positioning System) may be provided. The NI 9110 may detect a System (IP) signal and provide that information.

[0077] Communications Department The communication unit 160 transmits the information COM provided by the arithmetic unit 110 to a device external to the information processing device 100. It also acquires information COM from external devices or communication networks and provides it. Provide.

[0078] The information COM can include various commands. For example, the image information VIDEO is The display command may include a display command to cause 111 to generate, erase, etc.

[0079] Communication means for connecting to external devices or networks, such as a hub, router, or modem can be applied to the communication unit 160. Note that the connection method is not limited to a wired method, and may be a wireless method (e.g. Radio waves or infrared rays may also be used.

[0080] 《Input / output section》 For example, cameras, microphones, read-only external storage, external storage, scanners, speakers A printer or the like can be used as the input / output unit 145 (see FIG. 1).

[0081] Specifically, a digital camera, a digital video camera, etc. can be used as the camera. do.

[0082] A hard disk or a removable memory can be used as the external storage unit. , CD-ROM, DVD-ROM, etc. can be used as the read-only external storage unit.

[0083] 《Case》 The housing 101 protects the computing device 110 and other components from external stress.

[0084] The housing 101 can be made of metal, plastic, glass, ceramics, or the like.

[0085] Note that this embodiment mode can be appropriately combined with other embodiment modes described in this specification. .

[0086] (Embodiment 2) In this embodiment, a configuration of a data processing device according to one embodiment of the present invention will be described with reference to FIGS. He explains as he goes.

[0087] FIG. 3 is a block diagram illustrating a configuration of an information processing device 100B according to an embodiment of the present invention.

[0088] FIG. 4 is a schematic diagram illustrating the appearance of the information processing device 100B. FIG. 4(A) shows the information processing device 100B in an unfolded state. 4(A) shows the information processing device 1 in a folded state, FIG. 4(B) shows the information processing device 1 in a folded state, and FIG. 4(C) shows the information processing device 1 in a folded state. 2 is a schematic diagram illustrating the appearance of 00B.

[0089] FIG. 5 is a schematic diagram for explaining the configuration of the information processing device 100B. FIG. 5(A) is a diagram illustrating the configuration in an unfolded state, and FIG. 5(E) is a diagram illustrating the configuration in a folded state.

[0090] 5(A) to 5(C) are a top view, a bottom view, and a side view of the information processing device 100B, respectively. FIG. 5D is a cross-sectional view of the information processing device 1 taken along the line Y1-Y2 in FIG. FIG. 5(E) is a cross-sectional view illustrating the cross-sectional structure of the information processing device in the folded state. FIG. 1 is a side view of the device 100B.

[0091] <Configuration example of information processing device> The information processing device 100B described here includes position information L-INF and folding information. an input / output device 120B which supplies detection information SENS and receives image information VIDEO; The position information L-INF and the detection information SENS including the folding information are supplied, and the image information VI and a computing device 110 that provides the DEO (see FIG. 3).

[0092] The input / output device 120B includes a position input unit 140B, a display unit 130, and a detection unit 150. .

[0093] The position input unit 140B is in an expanded state, and the first area 140B(1) and the first area A second region 140B(2) facing the first region 140B(1) and and folding the second region 140B(2) so that a third region 140B(3) is formed between the first region 140B(3) and the second region 140B(2). It has flexibility that allows it to be folded (see Figures 4 and 5).

[0094] The detection unit 150 detects the folded state of the position input unit 140B and outputs folding information. A folding sensor 151 is provided which is capable of providing detection information SENS.

[0095] The display unit 130 is supplied with image information VIDEO and overlaps with the third area 140B(3). The calculation device 110 is arranged so as to include a calculation unit 111 and a program to be executed by the calculation unit 111. The device includes a storage unit 112 for storing the data (see FIG. 5(D)).

[0096] The information processing device 100B described here has a first area 140B(1), a folded state The second region 140B(2) facing the first region 140B(1) and the first region 14 A third region 140B overlapping the display unit 130 between the second region 140B(1) and the third region 140B(2). (3) A flexible position input unit 140 capable of detecting a palm or a finger that is in close proximity to or in contact with the B, it is possible to know whether the flexible position input unit 140B is in a folded or unfolded state. and a detection unit 150 including a folding sensor 151 capable of folding the device (see FIG. 3 and FIG. 5). This allows, for example, the palm or the fingers of the hand to be in contact with the first region 140B(1). It can be known whether the first region 140B(1) or the second region 140B(2) has come into proximity with or into contact with the first region 140B(1). As a result, a human interface with excellent operability can be provided. It is possible to provide an excellent new information processing device.

[0097] The individual elements constituting the information processing device 100B will be described below.

[0098] In addition, the information processing device 100B is in a state where the position input unit 140B is unfolded or folded. The input / output device 120B has a flexibility that allows it to be folded. The information processing device 100 differs from the information processing device 100 described in the first embodiment in that it includes a folding sensor 151 . Different configurations are described in detail here, and where similar configurations can be used, the above The above explanation is incorporated herein by reference.

[0099] Input / Output Device The input / output device 120B includes a position input unit 140B, a display unit 130, and a folding sensor 151. The detector 150 includes an input / output unit 145, a sign 159, and a communication unit 16. 0, etc. Also, the input / output device 120B is supplied with information and can supply information ( Figure 3).

[0100] 《Case》 The information processing device 100B has highly flexible parts E1 and less flexible parts E2 arranged alternately. In other words, the information processing device 100B has a flexible housing in a stripe shape. It has a high portion E1 and a low flexibility portion E2 (see Figures 5(A) and 5(B)).

[0101] This allows the information processing device 100B to be folded (see FIG. 4). The information processing device 100B in this state is highly portable. 140B(3) may be folded with a portion of it facing outward and used as the display area only. (See FIG. 4(C)).

[0102] For example, the shape of parallel ends, triangular shape, trapezoid or sector shape can be formed in the highly flexible area. It can be used for the shape of E1 and the less flexible portion E2 (see FIG. 5(A)).

[0103] The information processing device 100B can be folded to a size that can be held in one hand. The user can then input position information into the third area 140B(3) with the thumb of the supporting hand. This makes it possible to provide an information processing device that can be operated with one hand. (See Figure 8(A)).

[0104] In addition, in the folded state, a part of the position input unit 140B is on the inside, and the user Since the part that has been turned off cannot be operated (see Fig. 4(C)), the drive of this part is stopped. As a result, power consumption can be reduced.

[0105] Furthermore, position input unit 140B in the unfolded state has no seams and a wide operation area.

[0106] The display unit 130 is disposed so as to overlap the third area 140B(3) of the position input unit (FIG. 5(D ). The position input unit 140B is sandwiched between the connection member 13a and the connection member 13b. The connection members 13a and 13b are disposed between the support members 15a and 15b. (See FIG. 5(C)).

[0107] Display unit 130, position input unit 140B, connection member 13a, connection member 13b, support member 15a The support member 15b may be formed by various means such as adhesive, screws, or structures that can be fitted together. It is fixed in a variety of ways.

[0108] <Highly flexible parts> The highly flexible portion E1 can be bent and functions as a hinge.

[0109] The highly flexible portion E1 includes a connecting member 13a and a connecting member 13b overlapping the connecting member 13a. (See FIG. 5(A) to FIG. 5(C)).

[0110] <<Areas with low flexibility>> The less flexible portion E2 includes at least one of the support member 15a and the support member 15b. For example, the support member 15a and the support member 15b overlapping the support member 15a are included. In addition, the configuration including only the support member 15b reduces the weight of the less flexible portion E2 or The thickness can be reduced.

[0111] <<Connection Parts>> The connecting members 13a and 13b are flexible. For example, they are made of flexible plastic. The connecting members 13a and 13b are made of a material such as a material of a material such as a material of a metal, an alloy, or / and a material of a rubber. Specifically, silicone rubber can be used for the connection members 13a and 13b. Applicable.

[0112] <<Supporting member>> Either the support member 15a or the support member 15b is a connecting member 13a and a connecting member The support member 15a or the support member 15b is less flexible than the position input unit 140B. This can increase the mechanical strength of position input section 140B and protect it from damage.

[0113] For example, plastic, metal, alloy, rubber, etc. are used as the support member 15a or the support member 15b. The connecting member 13a and the connecting member 13b are made of plastic or rubber. The weight of the support member 3b, the support member 15a or the support member 15b can be reduced. Or, it can make it less likely to be damaged.

[0114] Specifically, engineering plastics and silicone rubber can be used. In addition, the support member 15a and the support part 15b are made of stainless steel, aluminum, magnesium alloy, or the like. It can be used for material 15b.

[0115] <<Location input section>> The position input unit 140B can be in an unfolded or folded state (see FIG. See Figures 4(A) to 4(C).

[0116] The third area 140B(3) is disposed on the top surface of the information processing device 100B in the unfolded state. (See FIG. 5D) and placed on the top and sides of the information processing device 100B in the folded state. (See FIG. 5(E)).

[0117] When position input section 140B is unfolded, a larger area can be utilized than when it is folded.

[0118] When the position input section 140B is folded, the operation command to be associated with the top surface of the third area 140B(3) is displayed. A different operation command from the command can be associated with the side. ) may be associated with a different operation command. Section 140B can be used to give complex operational commands.

[0119] The position input unit 140B supplies position information L-INF (see FIG. 3).

[0120] The position input unit 140B is located between the support member 15a and the support member 15b. The connecting member 13b may clamp the position input unit 140B.

[0121] The position input section 140B includes a first area 140B(1), a second area 140B(2), and a third area 140B(3). A third region 140B(3) is provided between the first region 140B(1) and the second region 140B(2). , (see FIG. 5(D)).

[0122] The position input unit 140B has a flexible substrate and a proximity sensor on the flexible substrate. The first region 140B(1), the second region 140B(2) and the third region 140B( 3) Proximity sensors are arranged in a matrix at each of the above.

[0123] Note that specific configuration examples applicable to the position input unit 140B are described in the sixth and seventh embodiments. This is described in form 7.

[0124] Detection unit and sign The information processing device 100B includes a detection unit 150. The detection unit 150 includes a folding sensor 151. (See Figure 3.)

[0125] The folding sensor 151 and the marker 159 are connected to the position input unit 140B when the unit 140B is in the folded state. In order to detect the state of the information processing device 100B (FIGS. 4(A) and 4(B)), ), Figures 5(A), 5(C) and 5(E).

[0126] When the position input unit 140B is unfolded, the sign 159 is separated from the folding sensor 151. In the position (see Figs. 4(A), 5(A) and 5(C)).

[0127] When the position input unit 140B is folded at the connecting member 13a, the sign 159 is folded. The robot approaches sensor 151 (see FIG. 4(B)).

[0128] When the position input unit 140B is folded at the connection member 13a, the sign 159 is It faces the connector 151 (see FIG. 5(E)).

[0129] The detection unit 150 detects the sign 159 and detects that the position input unit 140B is in a folded state. and supplies detection information SENS including folding information.

[0130] 《Display section》 The display unit 130 overlaps at least a part of the third area 140B(3) of the position input unit 140B. The display unit 130 is arranged to display the supplied image information VIDEO. That would be fine.

[0131] Since the display unit 130 is flexible, it can be folded or unfolded so as to overlap the position input unit 140B. This allows the display unit 130 to display a seamless image with excellent visibility. This can be done.

[0132] Specific configuration examples applicable to the flexible display unit 130 will be described in the sixth and sixth embodiments. This will be described in the seventh embodiment.

[0133] 《Arithmetic device》 The arithmetic device 110 includes a calculation unit 111, a storage unit 112, an input / output interface 115, and It includes a transmission path 114 (see FIG. 3).

[0134] Note that this embodiment mode can be appropriately combined with other embodiment modes described in this specification. .

[0135] (Embodiment 3) In this embodiment, a configuration of an information processing device according to one embodiment of the present invention will be described with reference to FIGS. Description will be given with reference to FIG. 7, FIG. 18 and FIG.

[0136] FIG. 6 is a diagram illustrating a state in which an information processing device 100 according to an embodiment of the present invention is held by a user. Here, in the position input section 140, the third area 140(3) is the same as the first area 140 (1) and the second region 140(2), and the first region 140(1) and the second region 140(2) are located between The areas 140(2) face each other. FIG. 6(A-2) is a diagram for explaining the appearance of the device when held by a user. 1 is a development view of the position input unit 140, showing the portion where the proximity sensor detects the palm or finger. In addition, the position input unit 140(A) and the position input unit 140(B) are provided as separate position input units. FIG. 18(A) shows a case where the position input unit 140(C) is used. This can be thought of in the same way as 2).

[0137] FIG. 6(B-1) shows the first position information L-INF(1) detected by the first area 140(1). The second position information L-INF(2) detected by the second region 140(2) is subjected to edge detection. FIG. 6(B-2) is a schematic diagram showing the processed result in a solid line. A schematic showing the results of labeling (1) and the second location information L-INF(2) by hatching. FIG.

[0138] FIG. 7 illustrates a program executed by the processor 111 of the information processing device according to an embodiment of the present invention. FIG.

[0139] <Configuration example of information processing device> The information processing device 100 described here is configured such that the first area 140(1) is a first location information LI NF(1), and the second region 140(2) provides second position information L-INF(2). (See FIG. 6(A-2)). The calculation unit 111 is a display unit that overlaps with the third region 140(3). The image information VIDEO to be displayed on 130 is divided into the first position information L-INF(1) and the second position information L-INF(2). The point that the information L-INF(2) is generated based on the result of comparing the information L-INF(2) is the information described in the first embodiment. This is different from the information processing device (see Fig. 1, Fig. 2 and Fig. 6). The above description will be used in detail, and where a similar configuration can be used, the above description will be used.

[0140] Below, the individual elements constituting the information processing device 100 will be described.

[0141] <<Location input section>> The position input unit 140 includes a first area 140(1) and a second area 140(2) facing the first area 140(1). Between the first region 140(1) and the second region 140(2), The display portion 130 and the third region 140(3) can be folded to form the third region 140(3). The material has sufficient flexibility (see FIG. 2(B)).

[0142] The first area 140(1) and the second area 140( 2) detects a part of the palm of the user and a part of the fingers. 1) is a first position information LI including position information of parts of the index finger, middle finger, and ring finger in contact with each other. NF(1) is supplied, and the second region 140(2) is adjacent to the base of the thumb (near the ball of the foot). The second position information L-INF(2) includes position information for the third region 14. 0(3) provides position information for the thumb contact point.

[0143] 《Display section》 The display unit 130 is provided at a position overlapping with the third region 140(3) (FIG. 6(A-1 ) and FIG. 6(A-2). The display unit 130 is supplied with image information VIDEO. For example, image information VI including an image for operating the information processing device 100 is displayed. The user can display the DEO. The user places the thumb in the third area 140 ( 3) By approaching or touching the image, you can input location information to select the image. do.

[0144] For example, as shown in FIG. 18B, when operating with the right hand, the keyboard 131 is provided on the right side. On the other hand, when operating with the left hand, the display shows the following: On the left side, the keyboard 131 and icons are displayed. By doing this, It becomes easier to operate.

[0145] The detection unit 150 detects the acceleration and detects the inclination of the information processing device 100. For example, as shown in FIG. 19(A), the display screen may be changed by holding the device in the left hand. Consider a state in which the camera is tilted to the right as viewed from the direction of the arrow 152 (see FIG. 19(C)). By detecting this tilt, a screen for left-handed users is displayed, as shown in FIG. 18(C). Similarly, as shown in FIG. 19(B), hold it with your right hand and tilt it to the left as viewed from the direction of the arrow 152. Let us consider the case where the tilt is detected as shown in FIG. Therefore, the screen for the right hand is displayed as shown in FIG. The display positions of the buttons and icons may be controlled.

[0146] In addition, the user can change the operation screen for the right hand and the operation screen for the left hand by setting it by himself. The number of times may be changed.

[0147] 《Arithmetic section》 The calculation unit 111 calculates the first position information L-INF(1) and the second position information L-INF(2). The first position information L-INF(1) is compared with the second position information L-INF(2). Based on the result, image information VIDEO to be displayed on the display unit 130 is generated.

[0148] <Program> The information processing device described here is a program that causes the calculation unit 111 to execute the following six steps: The program is described below. .

[0149] Example 1 In a first step, the first region 140(1) provides first position information L-INF (1) Determine the length of the first line segment (see FIG. 7(A)(S1)).

[0150] In the second step, the second region 140(2) provides second position information L-INF (2) Determine the length of the second line segment (see FIG. 7(A)(S2)).

[0151] In a third step, the length of the first line segment and the length of the second line segment are compared with a predetermined length. If only one of them is longer, go to the fourth step, otherwise go to the first step. Proceed to step S3 (see FIG. 7(A)(S3)). Note that the specified length is between 2 cm and 15 cm. It is particularly preferable to set the distance between 5 cm and 10 cm.

[0152] In the fourth step, the coordinates of the midpoints of line segments longer than a predetermined length are determined (FIG. 7(A) (See S4)).

[0153] In the fifth step, the image information VIDEO to be displayed on the display unit 130 is set to the coordinates of the midpoint. (See FIG. 7(A)(S5)).

[0154] In the sixth step, the process ends (see FIG. 7(A)(S6)).

[0155] Before the first step, a predetermined image information VIDEO (also called an initial image) is displayed on a display unit. 130. This allows the first line segment or the second line segment If the length of each of the image information VIDs is longer or shorter than a predetermined length, EO can be displayed.

[0156] Below, each process executed by the calculation unit using the program will be described.

[0157] How to determine the coordinates of the midpoint of a line segment The length of the first line segment is calculated from the first position information L-INF(1) and the second position information L- We explain how to determine the length of the second line segment from INF(2). We also explain how to determine the midpoint of the line segment. A method for determining the coordinates of the object will be described.

[0158] Specifically, an edge detection method for determining the length of a line segment will be described.

[0159] In the following description, an image sensor is used as a proximity sensor. etc. may be applied.

[0160] The value acquired by the image pixel located at the coordinates (x, y) is f(x, y). If we use the value obtained by subtracting the background value from the value detected by the pixel for f(x,y), the noise can be removed. This is preferable because it is possible to

[0161] How to extract edges (contours) The coordinates (x-1,y), (x+1,y), and (x,y-1) adjacent to the coordinate (x,y) ) and the value detected by the imaging pixel located at the coordinate (x, y+1) and the value detected by the imaging pixel located at the coordinate (x, y) The sum of the differences between the values ​​detected by the imaging pixels placed in the camera, Δ(x, y), is expressed by the following formula (1): can be.

number

[0162] The first region 140(1), the second region 140(2), and the third region 140(3) are Δ(x,y) is calculated for all the captured pixels, and then imaging is performed to obtain the result shown in Fig. 6( As shown in Fig. 6(A-2) and Fig. 6(B-1), the edges (contours) of the fingers or palm that are in close proximity or contact with each other ) can be extracted.

[0163] How to determine the length of a line segment The coordinates where the contour extracted in the first region 140(1) intersects with a predetermined line segment W1 are determined; Cut the specified line segment W1 at the intersection and divide it into multiple line segments. The longest line segment among the multiple line segments is This is the first line segment, and its length is L1 (see FIG. 6(B-1)).

[0164] The coordinates where the contour extracted in the second region 140(2) intersects with a predetermined line segment W2 are determined, Cut the specified line segment W2 at the intersection and divide it into multiple line segments. The longest line segment among the multiple line segments is Let it be the second line segment and its length be L2.

[0165] How to determine the midpoint L1 and L2 are compared, the longer one is selected, and the coordinates of the midpoint M are calculated. In this case, L2 is longer than L1. Therefore, the midpoint M of the second line segment is used to determine the coordinates. Determine.

[0166] <Image information generated based on midpoint coordinates> The coordinates of the midpoint M can be related to the position of the base of the thumb or the range of motion of the thumb. This allows for the generation of an image that facilitates the operation of the information processing device 100 based on the coordinates of the midpoint M. Can generate information.

[0167] For example, the image information V is arranged so that the operation image is arranged on the display unit 130 within the movable range of the thumb. Specifically, the operation image (circle) is generated on an arc centered near the midpoint M. (See Figure 6(A-1)). In addition, among the operation images, the ones that are frequently used can be Place the items that are frequently used in an arc shape, and place the items that are used less frequently on the inside or outside of the arc. As a result, a human interface with excellent operability can be provided. This makes it possible to provide a novel information processing device with excellent operability.

[0168] Second Example The program explained here calculates the area of ​​the first figure by converting the length of the first line segment into the area of ​​the second line segment. The point that the method has the following six steps, which use the area of ​​the second figure instead of the length of the second figure, is This is different from the program shown in FIG. 7(B). Here, the different processing will be explained in detail. In the parts where similar processing can be used, the above description is incorporated.

[0169] In a first step, the first region 140(1) provides first position information L-INF (1) Determine the area of ​​the first shape (see FIG. 7(B)(T1)).

[0170] In the second step, the second region 140(2) provides second position information L-INF (2) Determine the area of ​​the second figure (see FIG. 7(B)(T2)).

[0171] In a third step, the area of ​​the first shape and the area of ​​the second shape are compared to a predetermined area. If only one of them is larger, go to the fourth step, otherwise go to the first step. (See FIG. 7(B)(T3)). Note that the specified area is 1 cm 2 More than 8c m2 Below, especially 3cm 2 More than 5cm 2 It is preferable to set it as follows.

[0172] In the fourth step, the coordinates of the center of gravity of the figure larger than the given area are determined (FIG. 7(B) )(see T4)).

[0173] In the fifth step, image information VIDE to be displayed on the display unit 130 overlapping the third region is selected. O is generated based on the coordinates of the center of gravity (see FIG. 7(B)(T5)).

[0174] In the sixth step, the process ends (see FIG. 7(B)(T6)).

[0175] Below, each process executed by the calculation unit using the program will be described.

[0176] How to determine the center of gravity of a shape The area of ​​the first figure is calculated from the first position information L-INF(1) and the area of ​​the second figure is calculated from the second position information L- How to determine the area of ​​the second shape from INF(2) and the center of gravity of the shape A method for determining the above will be described.

[0177] Specifically, a labeling process for determining the area of ​​a graphic figure will be described.

[0178] Although the following description will be given taking an example in which an image sensor is used as the proximity sensor, it is also possible to use a capacitance element or the like as the proximity sensor. may be applied.

[0179] The value acquired by the image pixel located at the coordinates (x, y) is f(x, y). If we use the value obtained by subtracting the background value from the value detected by the pixel for f(x,y), the noise can be removed. This is preferable because it is possible to

[0180] Labeling process One imaging pixel included in the first region 140(1) or the second region 140(2), Obtain a value f(x,y) where both the imaging pixel and the adjacent imaging pixel exceed a predetermined threshold. In this case, the area occupied by these imaging pixels is regarded as one figure. For example, if the maximum value is 256, the predetermined threshold should be between 0 and 150, especially between 0 and 50. It is preferable to set the following.

[0181] For all the imaging pixels in the first region 140(1) and the second region 140(2), By carrying out the above-mentioned processing and imaging the results, the images shown in Fig. 6(A-2) and Fig. 6(B-2) can be obtained. As shown in FIG. 1, a region in which adjacent image pixels exceeding a predetermined threshold value are obtained. The shape with the largest area among the shapes in the second region 140(1) is defined as the first shape. 2) The shape with the largest area among the shapes in the list is called the second shape.

[0182] Determining the center of gravity of a shape The area of ​​the first shape is compared with the area of ​​the second shape, the larger one is selected, and the center of gravity is calculated. Center of gravity coordinate C (X,Y) can be calculated using the following formula (2).

number

[0183] In addition, in formula (2), x i , y i are the x-coordinates of n pixels constituting one figure, and y In the example shown in FIG. 6(B-2), the area of ​​the second figure is larger than the area of ​​the first figure. In this case, the center of gravity C of the second figure is used to determine the coordinates.

[0184] <Image information generated based on the coordinates of the center of gravity> The coordinates of the center of gravity C can be related to the position of the base of the thumb or the range of motion of the thumb. This allows for the generation of an image that facilitates the operation of the information processing device 100 based on the coordinates of the center of gravity C. Can generate information.

[0185] As described above, the information processing device 100 described here detects an object in proximity or in contact with the object. a flexible position input unit 140 capable of supplying position information L-INF, a calculation unit 111, The flexible position input unit 140 includes a first region 140(1) and , a second region 140(2) facing the first region 140(1), and ) and a third region 140(3) overlapping the display unit 130 between the second region 140(2) and , and the calculation unit 111 can be folded so as to form a first region 140(1) The first position information L-INF(1) provided by the second area 140(2) and the second The position information L-INF(2) is compared to generate image information VIDEO to be displayed on the display unit 130. It is possible.

[0186] This allows, for example, either the palm or the fingers of the hand to be in contact with the first area 140(1) or the second area 140(2). It is determined whether the user is in proximity to or in contact with any of the areas 140(2) and arranges the area so that the user can easily operate it. Image information VIDEO including the image (e.g., an image for operation) can be generated. As a result, a human interface with excellent operability can be provided. It is possible to provide a novel information processing device.

[0187] Note that this embodiment mode can be appropriately combined with other embodiment modes described in this specification. .

[0188] (Embodiment 4) In this embodiment, a configuration of an information processing device according to one embodiment of the present invention will be described with reference to FIGS. The description will be given with reference to FIG.

[0189] FIG. 8A is a diagram illustrating a state in which the information processing device 100B is folded and held by a user. 8B is a development view of the information processing device 100B in the state shown in FIG. This shows the area where the contact sensor detects the palm or fingers.

[0190] FIG. 9 shows a program executed by the calculation unit 111 of the information processing device 100B according to an embodiment of the present invention. FIG.

[0191] FIG. 10 shows an example of an image displayed on the display unit 130 of an information processing device 100B according to an embodiment of the present invention. FIG.

[0192] FIG. 11 shows a program executed by the calculation unit 111 of the information processing device 100B according to an embodiment of the present invention. FIG.

[0193] <Configuration example of information processing device> The information processing device 100B described here is a first area 140B (1 ) provides the first position information L-INF(1), and the second area 140B(2) provides the second position information L-INF(3). The information L-INF(2) is supplied (see FIG. 8B), and the detector 150 detects that the folding information is included The detection information SENS is supplied to the calculation unit 111, and the image information VIDEO is displayed on the display unit 130. The result of comparing the first location information L-INF(1) and the second location information L-INF(2) is The point that the detection information SENS including the folding information is generated is described in the second embodiment. This differs from the information processing device 100B shown in FIG. 3, FIG. 4, and FIG. 8. The above description will be used in detail to explain the same configuration. .

[0194] The individual elements constituting the information processing device 100B will be described below.

[0195] <<Location input section>> The position input unit 140B is in an expanded state or in a first region 140B(1), a first region 1 40B(1) and the second region 140B(2) facing the first region 140B(1) and the A third region 140B(3) overlapping the display unit 130 is formed between the second region 140B(2). The flexible structure allows the device to be folded so as to be folded up as shown in FIG. 4(C)).

[0196] The first area 140B(1) and the second area 140B(2) are a part of the palm and fingers of the user. Specifically, the first region 140B(1) detects the index finger, the middle finger, and the ring finger. The first position information L-INF(1) including the position information where a part of the second region 1 40B(2) is second position information L-INF(2) including position information of the contact of the base of the thumb The third area 140B(3) provides position information of the position where the thumb touches. do.

[0197] 《Display section》 The display unit 130 is provided at a position overlapping the third region 140B(3) (FIG. 8(A) 8(B)). The display unit 130 is supplied with image information VIDEO, and The user places his / her thumb on the image. The position information for selecting the image is obtained by approaching or touching the third area 140B(3) that is located in the vicinity of the image. You can enter information.

[0198] 《Arithmetic section》 The calculation unit 111 calculates the first position information L-INF(1) and the second position information L-INF(2). The first position information L-INF(1) is compared with the second position information L-INF(2). Based on the result, image information VIDEO to be displayed on the display unit 130 is generated.

[0199] <Program> The information processing device described here is a program that causes the calculation unit 111 to execute the following seven steps: The program is described below.

[0200] Example 1 In the first step, the length of a first line segment is calculated from first position information provided by a first region. (See FIG. 9(U1)).

[0201] In the second step, the length of the second line segment is calculated from the second position information provided by the second region. (See FIG. 9(U2)).

[0202] In a third step, the length of the first line segment and the length of the second line segment are compared with a predetermined length. If only one of them is longer, go to the fourth step, otherwise go to the first step. Proceed to step (see Figure 9 (U3)). Note that the specified length is between 2 cm and 15 cm. In particular, it is preferable to set the thickness to between 5 cm and 10 cm.

[0203] In the fourth step, the coordinates of the midpoints of line segments longer than a certain length are determined (Figure 9(U4 )reference).

[0204] In the fifth step, the folding information is obtained and the folding information is folded. If the expanded state is shown, proceed to step 7 (Figure 9). (See (U5)).

[0205] In the sixth step, first image information to be displayed on the display unit is generated based on the coordinates of the midpoint. (See Figure 9 (U6)).

[0206] In the seventh step, second image information to be displayed on the display unit is generated based on the coordinates of the midpoint. (See Figure 9 (U7)).

[0207] In the eighth step, the process ends (see FIG. 9(U8)).

[0208] In addition, the information processing device 100B described here outputs predetermined image information VIDE A step of generating O and displaying it on the display unit 130 is performed before the first step is performed. In this way, in the third step, the first line segment or the second line segment If any of the above is longer than a predetermined length or shorter than a predetermined length, It is possible to display image information VIDEO.

[0209] Below, each process executed by the calculation unit using the program will be described.

[0210] The program executed by the calculation unit 111 is based on the folded state in the fifth step. The difference from the program explained in the third embodiment is that the process branches based on the The process of the present invention will be described in detail, and the above description will be used to assist in the description of the parts where similar processes can be used. Use.

[0211] <Process for generating first image information> If the acquired folding information indicates a folded state, the calculation unit 111 converts the first image information For example, as in the fifth step of the program described in the third embodiment, The first image information to be displayed on the display unit 130 overlapping the third area 140B(3) in the folded state. An information VIDEO is generated based on the coordinates of the midpoint.

[0212] The coordinates of the midpoint M can be related to the position of the base of the thumb or the range of motion of the thumb. As a result, the folded information processing device 100B can be It is possible to generate image information that facilitates manipulation.

[0213] For example, the first image is arranged on the display unit 130 so that the operation image is within the movable range of the thumb. Information VIDEO can be generated. Specifically, the operation image is generated in an arc shape centered around the midpoint M. (shown in circles) can be placed (see Fig. 8(A)). Place the tallest items in an arc shape, and place the less frequently used items on the inside or outside of that arc. As a result, the information processing device 100B in the folded state has excellent operability. It is possible to provide a human interface with excellent operability. The device can be provided.

[0214] <<Processing for generating second image information>> If the acquired folding information indicates an unfolded state, the calculation unit 111 generates second image information. For example, similar to the fifth step of the program described in the third embodiment, The first image information VIDEO to be displayed on the display unit 130 overlapping the area 140B(3) is set at the midpoint The coordinates of the midpoint M are determined based on the position of the base of the thumb or the movement of the thumb. It can be associated with a range etc.

[0215] For example, the second image information V is arranged so as not to place the operation image in an area overlapping with the movable range of the thumb. IDEO can be generated. Specifically, the operation image is placed outside the arc centered near the midpoint M. (represented by a circle) can be placed (see FIG. 10). The information processing is performed to detect objects approaching or touching the area other than the inside and to provide location information. The processing device 100B may be driven.

[0216] As a result, the arc of the position input section 140B in the expanded state and the area inside it are The information processing device 100B can be supported by holding it with one hand. The image displayed on the screen can be operated with the other hand. In the information processing device 100B in the installed state, a human interface with excellent operability is provided. Alternatively, a novel information processing device with excellent operability can be provided.

[0217] Second Example The program explained here calculates the area of ​​the first figure by converting the length of the first line segment into the area of ​​the second line segment. The following seven steps use the area of ​​the second figure instead of the length of the second figure. This is different from the program shown in Figure 11. Here, we will explain the different processes in detail and The above description is incorporated herein by reference in relation to the parts in which similar processing can be used.

[0218] In a first step, a first region 140B(1) provides first position information. Determine the area of ​​the figure (see Figure 11(V1)).

[0219] In a second step, a second region 140B(2) provides second position information. Determine the area of ​​the figure (see Figure 11(V2)).

[0220] In a third step, the area of ​​the first shape and the area of ​​the second shape are compared to a predetermined area. If only one of them is larger, go to the fourth step, otherwise go to the first step. (See FIG. 11(V3)). Note that the specified area is 1 cm 2 Over 8cm 2 Below, especially 3cm 2 More than 5cm 2 It is preferable to set it as follows.

[0221] In the fourth step, the coordinates of the center of gravity of the figure larger than the predetermined area are determined (FIG. 11( (See V4).

[0222] In the fifth step, the folding information is obtained and the folding information is folded. If the expanded state is shown, proceed to step 7 (Figure 1 1(V5)).

[0223] In the sixth step, first image information to be displayed on the display unit is generated based on the coordinates of the center of gravity. (See Figure 11 (V6)).

[0224] In the seventh step, second image information to be displayed on the display unit is generated based on the coordinates of the center of gravity. (See FIG. 11(V7)).

[0225] In the eighth step, the process ends (see FIG. 11(V8)).

[0226] As described above, the information processing device 100B described here detects objects that are in close proximity or in contact with the object. and a flexible position input unit 140B capable of detecting the position of the object and supplying position information L-INF. A folding indicator that can tell whether the input unit 140B is in a folded or unfolded state The detector 150 includes a detection unit 151 and a calculation unit 111 (FIG. 3). The flexible position input unit 140B is in a folded state with the first region 140B(1). In this state, the second region 140B(2) faces the first region 140B(1), and the first region 14 A third area 140B(1) overlapping the display unit 130 is disposed between the second area 140B(2) and the second area 140B(3). 0B(3) and the like can be folded, and the calculation unit 111 calculates the first region 140B(1) provides first position information L-INF(1) and second area 140B(2) and compares the second position information L-INF(2) provided by the display unit 1 based on the folding information. Image information VIDEO to be displayed on 30 can be generated.

[0227] This allows, for example, either the palm or the fingers of the hand to be in contact with the first region 140B(1) or the second region 140B(2). and determines which of the areas 140B(2) of the position input section 140B A first image (for example, an image for operation) arranged so as to be easily operated when the device is folded or the position input unit 140B is arranged so as to be easily operated in the expanded state. Image information VIDEO including any of the second images can be generated. It is possible to provide a human interface with excellent operability. An information processing device can be provided.

[0228] Note that this embodiment mode can be appropriately combined with other embodiment modes described in this specification. .

[0229] (Embodiment 5) In this embodiment, a configuration of an information processing device according to one embodiment of the present invention will be described with reference to FIGS. The following explanation will be given with reference to the above.

[0230] FIG. 12 shows a program executed by the calculation unit 111 of the information processing device 100B according to an embodiment of the present invention. FIG.

[0231] FIG. 13 is a schematic diagram illustrating an image displayed by an information processing device 100B according to an embodiment of the present invention. .

[0232] <Configuration example of information processing device> The display unit 130 of the information processing device 100B described here is extended to overlap with the position input unit 140B. Flexibility to be able to be in an open and folded state, and and a first area 130(1) exposed at the first area 130(2) and separated from the first area 130(1) by a fold. The information processing device described in the second embodiment includes a second area 130(2) (see FIG. 13(B)).

[0233] 《Display section》 The display unit 130 is flexible and can be extended to overlap the third area 140(3) of the position input unit 140B. It can be in an open or folded state (FIGS. 13(A) and 13(B)). See B).

[0234] The display section 130 is divided into a first area 130(1) and a second area 130(2) by a fold. The second area 130(2) can be regarded as a second area 130(3) and each of them can be driven separately (see FIG. 13( See B).

[0235] The display unit 130 is divided into a first area 130(1), a second area 130(2), and a 0(2), and a third area 130(3), each of which can be driven separately. (Figure 13(C)).

[0236] Also, the display section 130 may not be divided into sections for each fold, but the entire surface may be the first section 130(1). (not shown).

[0237] Specific configuration examples applicable to the display unit 130 will be described in the sixth and seventh embodiments. Describe and explain. "program"

[0238] The memory device stores a program that causes the calculation unit 111 to execute a process including the following steps: The memory unit 112 is provided (see FIG. 3, FIG. 12(A) and FIG. 12(B)).

[0239] In the first step, initialization is performed (see FIG. 12(A)(W1)).

[0240] In the second step, the initial image information VIDEO is generated (FIG. 12(A)(W2) reference).

[0241] In the third step, interrupt processing is permitted (see FIG. 12(A)(W3)). The arithmetic unit 111 that is permitted to perform interrupt processing receives an instruction to execute the interrupt processing and executes the main The process is interrupted, an interrupt process is executed, and the execution result is stored in the memory unit. The main process is resumed based on the execution result of the process.

[0242] In the fourth step, the folding information is obtained and the folding information is folded. If it shows the expanded state, go to the fifth step. If it shows the expanded state, go to the sixth step. See Figure 12(A)(W4).

[0243] In a fifth step, at least a portion of the supplied image information VIDEO is stored in a first area. (See Figure 12(A)(W5)).

[0244] In a sixth step, a part of the supplied image information VIDEO is stored in a first area and a part of the supplied image information VIDEO is stored in another area. The part is displayed in the second area or in the second and third areas (see Figure 12 (A) (W6)).

[0245] In the seventh step, if an interrupt processing end command is issued, the process proceeds to the eighth step. If the end command is not provided, the process proceeds to the third step (FIG. 12(A)(W7) reference).

[0246] The process ends in the eighth step (see FIG. 12(A)(W8)).

[0247] Moreover, the interrupt process includes the following steps.

[0248] In the ninth step, if a page feed command is provided, proceed to a tenth step; If no page feed command is provided, proceed to step 11 (FIG. 12(B)(X9 )reference).

[0249] In a tenth step, image information VIDEO is generated based on the page feed command. (See Figure 12(B)(X10)).

[0250] In the 11th step, the process returns from the interrupt process (see FIG. 12(B)(X11)). .

[0251] <<Example of generated image>> The arithmetic unit 110 generates image information VIDEO to be displayed on the display unit 130. In this embodiment, the case where the arithmetic unit 110 generates one image information VIDEO will be described as an example. The computing device 110 generates image information VIDEO to be displayed in the second area 130(2) of the display unit 130. It may also be generated separately from the image information VIDEO to be displayed in the first area 130(1).

[0252] For example, the computing device 110 may display only the first area 130(1) that is exposed in the folded state. This is a suitable driving method for the folded state (Figure 13(A) )).

[0253] In response to this, the computing device 110 has a first area 130(1) and a second area 130(2) in the unfolded state. The entire display unit 130 including the first area 130(2) and the third area 130(3) is used to form one image. Such an image has excellent viewability (see FIG. 13(B) and FIG. 1 3(C)).

[0254] For example, in the folded state, the control image may be placed in the first area 130(1). good.

[0255] For example, in the deployed state, the control image is placed in the first area 130(1) and the application The display area (also called a window) of the application software is located in the second area 130(2). , or may be disposed throughout second region 130(2) and third region 130(3).

[0256] Also, when a page forward command is issued, the image located in the second area 130(2) is moved to the first area 130(3). The first image is fed into area 130(1) and the new image is placed into the second area 130(2). This may be done.

[0257] Also, the first area 130(1), the second area 130(2) or the third area 130(3) When a page feed command is sent to one of the areas, a new image is sent to that area and the other area is The image may be maintained in the area. This is a command to select and display one image from multiple image information associated with a page number. For example, it may be related to a page number that is one greater than the page number of the image information being displayed. The position input unit 1 can also select and display the attached image information. Gestures using a finger touching 40B as a pointer (tap, drag, swipe, etc.) You can associate a gesture (such as pinching or squeezing) with a page forward command.

[0258] As described above, the information processing device 100B described here can be used in an unfolded state and a folded state. The first region 13 is exposed in the folded state. 0(1) and a second area 130(2) separated by a fold from the first area 130(1). , and a display unit 130 having a first area 130(1) and a second area 130(2) are provided. or another part in the second area 130(2), and the detection information SENS A program for causing the calculation unit 111 to execute a process including a step of displaying based on the The device includes a storage unit 112 for storing the

[0259] As a result, for example, the display unit exposed on the outer periphery of the information processing device 100B in the folded state A part of an image is displayed in the first area 130 (130(1)), and the display unit In the second area 130(2) adjacent to the first area 130(1) of the image It is possible to display a part of a continuous or related image. As a result, it is easy to operate. A new information processing device that can provide a human interface or has excellent operability can be provided.

[0260] Note that this embodiment mode can be appropriately combined with other embodiment modes described in this specification. .

[0261] (Embodiment 6) In this embodiment, the present invention is applied to a position input unit and a display device of an information processing device according to an embodiment of the present invention. The configuration of the display panel that can be used in this embodiment will be described with reference to FIG. The display panel described in the embodiment has a touch sensor (touch detection device) superimposed on the display unit. Therefore, it can be called a touch panel (input / output device).

[0262] FIG. 14A is a top view illustrating the structure of the input / output device.

[0263] FIG. 14(B) is a cross-sectional view taken along line AB and line CD in FIG. 14(A).

[0264] FIG. 14C is a cross-sectional view taken along line EF in FIG. 14A.

[0265] <Explanation of top view> The input / output device 300 includes a display unit 301 (see FIG. 14A).

[0266] The display unit 301 includes a plurality of pixels 302 and a plurality of imaging pixels 308. A finger or the like touching the display unit 301 can be detected.

[0267] The pixel 302 includes a plurality of sub-pixels (e.g., sub-pixel 302R), each of which includes a light-emitting element and a The pixel circuit is capable of supplying power to drive the light emitting element.

[0268] The pixel circuit includes wiring that can supply a selection signal and a pixel circuit that can supply an image signal. The wiring is electrically connected to the wiring.

[0269] The input / output device 300 also includes a scanning line driver circuit that can supply a selection signal to the pixel 302. 303g(1), and an image signal line driver circuit 3 that can supply image signals to the pixels 302. In addition, the image signal line driver circuit 303s(1) is provided to avoid the bent portion. By placing (1), the occurrence of malfunctions can be reduced.

[0270] The imaging pixel 308 includes a photoelectric conversion element and an imaging pixel circuit that drives the photoelectric conversion element.

[0271] The imaging pixel circuit includes wiring that can supply a control signal and a power supply potential. The wiring is electrically connected to the semiconductor device.

[0272] The control signal may be, for example, a pixel circuit for reading out a recorded image signal. a signal that can initialize the imaging pixel circuit, and a signal that can detect light by the imaging pixel circuit Examples of such signals include a signal that can determine the time at which the signal is detected.

[0273] The input / output device 300 may include an imaging pixel drive circuit that may provide control signals to the imaging pixels 308. 303g(2) and an image pickup signal line drive circuit 303s(2) that reads out image pickup signals. If the imaging signal line driving circuit 303s(2) is arranged to avoid the bent portion, a defect may occur. This can reduce the occurrence of collisions.

[0274] <Explanation of the cross-sectional view> The input / output device 300 includes a substrate 310 and an opposing substrate 370 opposed to the substrate 310 ( See Figure 14(B).

[0275] The substrate 310 is a flexible substrate 310b that prevents unintended diffusion of impurities into the light emitting element. A barrier film 310a and an adhesive layer 310 for bonding the barrier film 310a to the substrate 310b are provided. c is a laminated body.

[0276] The opposing substrate 370 is a flexible substrate 370b, which prevents unintended diffusion of impurities into the light emitting element. A barrier film 370a for preventing the above-mentioned phenomenon and an adhesive layer 3 for bonding the barrier film 370a to the substrate 370b are provided. 70c (see FIG. 14(B)).

[0277] The sealing material 360 bonds the opposing substrate 370 and the substrate 310. It also serves as an optical bonding layer. The imaging pixel circuit and the photoelectric conversion element (for example, the photoelectric conversion element 308p) are connected to the substrate 310 and the opposing substrate. It is located between the boards 370.

[0278] 《Pixel Structure》 The pixel 302 includes a subpixel 302R, a subpixel 302G, and a subpixel 302B (FIG. 14 Also, the subpixel 302R includes a light-emitting module 380R, and the subpixel 302G includes a light-emitting module 380R. The subpixel 302A includes a light emitting module 380G, and the subpixel 302B includes a light emitting module 380B.

[0279] For example, the subpixel 302R supplies power to the first light-emitting element 350R and the second light-emitting element 350R. The pixel circuit includes a transistor 302t that can supply The light emitting module 380R includes a first light emitting element 350R and an optical element (e.g., It has a colored layer 367R).

[0280] The transistor 302t includes a semiconductor layer, such as an amorphous silicon film and a low-temperature polysilicon film. Various semiconductor films such as a single crystal silicon film and an oxide semiconductor film are used as the semiconductor of the transistor 302t. The transistor 302t may also include a back gate electrode. The backgate electrode may be used to control the threshold voltage of the transistor 302t.

[0281] The first light emitting element 350R includes a first lower electrode 351R, an upper electrode 352, a first lower electrode Between 351R and the upper electrode 352 is a layer 353 containing a light-emitting organic compound (FIG. 14( See C).

[0282] The layer 353 containing a light-emitting organic compound includes a light-emitting unit 353a, a light-emitting unit 353b, and a light-emitting layer 353c. An intermediate layer 354 is provided between the light-emitting unit 353a and the light-emitting unit 353b.

[0283] The first colored layer 367R of the light emitting module 380R is provided on the opposing substrate 370. The light emitting element may transmit light having a specific wavelength, for example, red, green, or blue. Alternatively, a colored layer may be omitted and the light emitting layer may be omitted. A region that transmits the light emitted by the element may be provided.

[0284] For example, the light emitting module 380R includes a first light emitting element 350R and a first coloring layer 367R. It has a sealing material 360 in contact therewith.

[0285] The first colored layer 367R is located so as to overlap the first light emitting element 350R. A part of the light emitted by the light emitting element 350R passes through the sealing material 360 and the first colored layer 367R. The light passes through the light emitting module 380R and is emitted to the outside as indicated by the arrow in the figure.

[0286] The input / output device 300 further includes a light-shielding layer 367BM on the opposing substrate 370. The BM is provided so as to surround a colored layer (for example, the first colored layer 367R).

[0287] The input / output device 300 includes an anti-reflection layer 367p at a position overlapping the display unit 301. The stop layer 367p may be, for example, a circular polarizer.

[0288] The input / output device 300 includes an insulating film 321. The insulating film 321 covers the transistor 302t. The insulating film 321 is used as a layer for flattening unevenness caused by the pixel circuit. In addition, the diffusion of impurities into the transistor 302t and the like can be suppressed. The insulating film 321 can be an insulating film in which layers capable of forming a conductive film are stacked.

[0289] The light emitting element (for example, the first light emitting element 350R) is provided on the insulating film 321.

[0290] In the input / output device 300, the partition wall 328 overlapping the end of the first lower electrode 351R is disposed between the insulating film 321. (See FIG. 14C). In addition, the distance between the substrate 310 and the counter substrate 370 is controlled. A spacer 329 is provided on the partition 328 .

[0291] Configuration of the Image Signal Line Driving Circuit The image signal line driver circuit 303s(1) includes a transistor 303t and a capacitor 303c. In addition, the image signal line driver circuit 303s(1) is formed on the same substrate as the pixel circuit in the same process. It is possible.

[0292] <Imaging pixel configuration> The imaging pixel 308 has a photoelectric conversion element 308p and converts light irradiated onto the photoelectric conversion element 308p into The imaging pixel circuit includes a transistor 308t. include.

[0293] For example, a pin-type photodiode can be used as the photoelectric conversion element 308p.

[0294] Other configurations The input / output device 300 includes a wiring 311 through which a signal can be supplied, and a terminal 319 is 311. In addition, signals such as image signals and synchronization signals can be supplied. The FPC 309(1) is electrically connected to the terminal 319. The FPC 309(1) is arranged to avoid the bending portion of the power supply device 300. A side selected from the area surrounding the portion 301, particularly the folded side (the long side in the figure), is selected. It is preferable to place the FPC 309(1) in the center of the input / output device. As a result, the information processing device can be handled more easily. This makes it easier to carry the device, and prevents problems such as accidentally dropping the device.

[0295] In addition, a printed wiring board (PWB) may be attached to the FPC309(1). .

[0296] Although the example in which the light-emitting element is used as the display element has been described, this is one embodiment of the present invention. The types are not limited to these.

[0297] For example, electroluminescence (EL) elements (EL elements including organic and inorganic materials, organic EL elements, inorganic EL elements, LEDs, etc.), light-emitting transistor elements (light-emitting elements that emit light according to electric current) transistors, electron emission elements, liquid crystal elements, electronic ink elements, electrophoretic elements, Wetting element, plasma display (PDP), MEMS (microelectromechanical systems) Toro Mechanical Systems) displays (e.g., grating light valves (G LV), Digital Micromirror Device (DMD), Digital Micro Shutter (DMS) element, interference modulation (IMOD) element, etc.), Electro-magnetic effects such as electro-ceramic displays improve contrast, brightness, reflectance, There are display media that change transmittance, etc. Examples of display devices using EL elements are Examples of display devices using electron-emitting devices include EL displays. Field Emission Display (FED) or SED type flat panel display (S ED:Surface-conduction Electron-emitter D An example of a display device using liquid crystal elements is a liquid crystal display. (Transmissive LCD, Semi-transmissive LCD, Reflective LCD, Direct LCD LCDs (e.g., liquid crystal displays, projection LCDs, etc.) An example of a display device using electrophoretic elements is electronic paper.

[0298] Note that this embodiment mode can be appropriately combined with other embodiment modes described in this specification. .

[0299] (Embodiment 7) In this embodiment, the present invention is applied to a position input unit and a display device of an information processing device according to an embodiment of the present invention. The configuration of a display panel that can be used will be described with reference to FIGS. 15 and 16. In addition, the display panel described in this embodiment has a touch sensor (a touch detection device) in the display unit. Since it is placed on top of the screen, it can be called a touch panel (input / output device).

[0300] 15A is a schematic perspective view of a touch panel 500 exemplified in this embodiment. For clarity, representative components are shown in FIG. 15. FIG. 15(B) shows a touch panel 500. FIG.

[0301] FIG. 16 is a cross-sectional view of touch panel 500 taken along line X1-X2 of FIG.

[0302] The touch panel 500 includes a display unit 501 and a touch sensor 595 (see FIG. 15B). The touch panel 500 also includes a substrate 510, a substrate 570, and a substrate 590. As an example, the substrate 510, the substrate 570, and the substrate 590 are all flexible. do.

[0303] As the substrate, various substrates having plasticity can be used. For example, a semiconductor Substrates (e.g. single crystal substrates or silicon substrates), SOI substrates, glass substrates, quartz substrates, plastic There are stick substrates, metal substrates, etc.

[0304] The display unit 501 includes a substrate 510, a plurality of pixels on the substrate 510, and a display device for supplying signals to the pixels. The display device includes a plurality of wirings 511 that can connect the image signal lines and an image signal line driver circuit 503s(1). The wiring 511 is routed to the outer periphery of the substrate 510, and a part of it constitutes a terminal 519. The terminal 519 is electrically connected to the FPC 509(1). ) may have a printed wiring board (PWB) attached to it.

[0305] <Touch sensor> The substrate 590 includes a touch sensor 595 and a plurality of electrodes electrically connected to the touch sensor 595. The wiring 598 is arranged around the periphery of the substrate 590, and a part of the wiring 598 is The terminals are used for electrical connection to the FPC509(2). 595 is provided under the substrate 590 (between the substrate 590 and the substrate 570), and in FIG. For clarity, electrodes, wiring, etc. are shown with solid lines.

[0306] The touch sensor used for the touch sensor 595 is preferably a capacitive touch sensor. The capacitive touch sensor is classified into two types: surface capacitive touch sensor and projected capacitive touch sensor. There are two types of capacitive sensors: self-capacitance and mutual capacitance, which differ mainly in their driving methods. The mutual capacitance method is preferable because it enables simultaneous multi-point detection.

[0307] In the following, the case where a projected capacitive touch sensor is applied will be described with reference to FIG. 15(B). However, various other sensors can also be used.

[0308] The touch sensor 595 has an electrode 591 and an electrode 592. The electrode 591 is connected to a plurality of wirings 59 8, and the electrode 592 is electrically connected to any other of the plurality of wirings 598. Connect to.

[0309] As shown in FIGS. 15(A) and (B), the electrode 592 has a shape in which multiple quadrilaterals are connected in one direction. The electrode 591 has a quadrilateral shape. The wiring 594 extends in the direction in which the electrode 592 extends. Two electrodes 591 arranged in a direction intersecting the direction of the electrode 5 are electrically connected. It is preferable that the area of ​​the intersection of the wiring 594 with the wiring 92 be as small as possible. The area of ​​the region where no electrodes are provided can be reduced, and unevenness in transmittance can be reduced. It is possible to reduce unevenness in the brightness of the light passing through the touch sensor 595. However, the shape of the electrode 592 is not limited to this, and may take various shapes.

[0310] In addition, the electrodes 591 are arranged so that there are as few gaps as possible, and the electrodes are connected to each other via an insulating layer. Alternatively, a plurality of electrodes 592 may be provided at intervals so that there is an area that does not overlap with the electrode 591. At this time, a dummy electrode that is electrically insulated from the adjacent two electrodes 592 is provided between the adjacent two electrodes 592. It is preferable to provide a negative electrode, since the area of ​​the region having different transmittance can be reduced.

[0311] The configuration of the touch panel 500 will be described with reference to FIG.

[0312] The touch sensor 595 includes a substrate 590, electrodes 591 arranged in a staggered pattern on the substrate 590, and The electrode 592, the electrode 591, and the insulating layer 593 covering the electrode 592, and the adjacent electrodes 591 are Electrically connecting wiring 594 is provided.

[0313] The adhesive layer 597 is formed between the substrate 590 and the substrate 501 so that the touch sensor 595 and the display unit 501 overlap each other. 70 are pasted together.

[0314] The electrode 591 and the electrode 592 are formed using a light-transmitting conductive material. Examples of conductive materials that can be used include indium oxide, indium tin oxide, indium zinc oxide, Conductive oxides such as zinc oxide and zinc oxide doped with gallium can be used.

[0315] After forming a film of a light-transmitting conductive material on a substrate 590 by a sputtering method, By using various patterning techniques such as lithography, unnecessary parts are removed and the electrodes 591 are formed. And electrode 592 can be formed.

[0316] Examples of materials used for the insulating layer 593 include acrylic resin, epoxy resin, and siloxane. In addition to resins with bonds, inorganic materials such as silicon oxide, silicon oxynitride, and aluminum oxide are also available. An insulating material may also be used.

[0317] An opening reaching the electrode 591 is provided in the insulating layer 593, and a wiring 594 is connected to the adjacent electrode 5 The wiring 594 formed of a light-transmitting conductive material is This is preferable because the aperture ratio of the panel can be increased. It is preferable to use a highly conductive material for the wiring 594 .

[0318] One electrode 592 extends in one direction, and a plurality of electrodes 592 are provided in a stripe pattern.

[0319] The wiring 594 is provided so as to intersect with the electrodes 592 .

[0320] A pair of electrodes 591 are provided with one electrode 592 sandwiched therebetween and are electrically connected to a wiring 594. There are.

[0321] The electrodes 591 do not necessarily have to be arranged in a direction perpendicular to the electrode 592. However, the angle between the first and second electrodes may be less than 90 degrees.

[0322] One wiring 598 is electrically connected to the electrode 591 or the electrode 592. The wiring 598 may be made of, for example, aluminum, gold, platinum, silver, Nickel, titanium, tungsten, chromium, molybdenum, iron, cobalt, copper, or palladium For example, a metal material such as aluminum or an alloy material containing such a metal material can be used.

[0323] Note that an insulating layer is provided to cover the insulating layer 593 and the wiring 594 to protect the touch sensor 595. It is possible.

[0324] Furthermore, the connection layer 599 electrically connects the wiring 598 and the FPC 509(2).

[0325] The connection layer 599 may be made of various anisotropic conductive films (ACFs). Conductive Film and Anisotropic Conductive Paste (ACP) pic Conductive Paste) can be used.

[0326] The adhesive layer 597 has a light-transmitting property. For example, a thermosetting resin or an ultraviolet-curing resin is used. Specifically, acrylic resin, urethane resin, epoxy resin, or siloxane resin can be used. Resins having such a structure can be used.

[0327] <Display section> The touch panel 500 includes a plurality of pixels arranged in a matrix. and a pixel circuit for driving the display element.

[0328] In this embodiment, a white organic electroluminescence element is used as a display element. However, the display element is not limited to this.

[0329] For example, display elements include organic electroluminescence elements, electrophoretic elements, and electronic Display elements that display images using a powder method (also called electronic ink), shutter-type M Using various display elements such as EMS display elements, optical interference type MEMS display elements, and liquid crystal elements In addition, a suitable configuration for the display element to be applied can be selected from various pixel circuits. It can be used.

[0330] The substrate 510 is a flexible substrate 510b that prevents unintended diffusion of impurities into the light emitting element. A barrier film 510a and an adhesive layer 510 for bonding the barrier film 510a to the substrate 510b are provided. c is a laminated body.

[0331] The substrate 570 is a flexible substrate 570b that prevents unintended diffusion of impurities into the light emitting element. A barrier film 570a and an adhesive layer 570b are bonded to the barrier film 570a. c) is a laminate.

[0332] The sealing material 560 bonds the substrate 570 and the substrate 510 together. The pixel circuit and the light emitting element (for example, the first light emitting element 550R) are mounted on the substrate 51. 0 and substrate 570.

[0333] 《Pixel Structure》 The pixel includes a sub-pixel 502R, which comprises a light-emitting module 580R.

[0334] The subpixel 502R supplies power to the first light-emitting element 550R and the second light-emitting element 550R. The pixel circuit includes a transistor 502t that can emit light. 580R includes a first light emitting element 550R and an optical element (eg, a color layer 567R).

[0335] The first light emitting element 550R includes a lower electrode, an upper electrode, and a light emitting element between the lower electrode and the upper electrode. The organic compound is included in the layer.

[0336] The light emitting module 580R has a first color layer 567R on a substrate 570. Any material that transmits light having a wavelength of red, green, or blue may be used. Alternatively, a light-emitting element may be formed without using a colored layer. A region that transmits the emitted light directly may be provided.

[0337] The light emitting module 580R includes a first light emitting element 550R and an encapsulant in contact with the first color layer 567R. It has a stopper material 560.

[0338] The first colored layer 567R is located so as to overlap the first light emitting element 550R. A part of the light emitted by the light emitting element 550R passes through the sealing material 560 and the first colored layer 567R. The light passes through the light emitting module 580R and is emitted to the outside of the light emitting module 580R as indicated by the arrow in the figure.

[0339] Configuration of the Image Signal Line Driving Circuit The image signal line driver circuit 503s(1) includes a transistor 503t and a capacitor 503c. In addition, the image signal line driver circuit 503s(1) is formed on the same substrate as the pixel circuit in the same process. It is possible.

[0340] Other configurations The display unit 501 has a light-shielding layer 567BM on a substrate 570. The light-shielding layer 567BM is a colored layer. (for example, the first colored layer 567R) is provided so as to surround the first colored layer 567R.

[0341] The display unit 501 includes an anti-reflection layer 567p at a position overlapping the pixels. As the polarizing plate, for example, a circular polarizing plate can be used.

[0342] The display unit 501 includes an insulating film 521. The insulating film 521 covers the transistor 502t. The insulating film 521 is used as a layer for flattening unevenness caused by the pixel circuit. In addition, the diffusion of impurities into the transistor 502t and the like can be suppressed. A stacked insulating film can be used as the insulating film 521.

[0343] The display portion 501 has a partition wall 528 on an insulating film 521, the partition wall 528 overlapping an end portion of a first lower electrode. In addition, a spacer for controlling the distance between the substrate 510 and the substrate 570 is provided on the partition wall 528 .

[0344] Note that this embodiment mode can be appropriately combined with other embodiment modes described in this specification. . [Explanation of symbols]

[0345] 13a Connection member 13b Connection member 15a Support member 15b Support member 100 Information processing device 100B Information processing device 101 Case 110 Arithmetic equipment 111 Arithmetic section 112 Storage section 114 Transmission Line 115 Input / Output Interface 120 I / O Devices 120B I / O device 130(1) First Area 130(2) Second Area 130(3) Third Area 130 Display section 140(1) First Area 140(2) Second Area 140(3) Third Area 140 Position input section 140B(1) First Area 140B(2) Second Area 140B(3) Third Area 140B Position input section 141 Substrate 142 Proximity Sensor 145 Input / output section 150 Detection unit 151 Sensors 159 signs 160 Communications Department 300 I / O devices 301 Display section 302 pixels 302B subpixel 302G subpixel 302R subpixel 302t Transistor 303c capacity 303g(1) Scanning line driver circuit 303g(2) Imaging pixel driving circuit 303s(1) Image signal line driver circuit 303s(2) Imaging signal line driver circuit 303t Transistor 308 imaging pixels 308p Photoelectric conversion element 308t transistor 309 FPC 310 Substrate 310a Barrier film 310b board 310c adhesive layer 311 Wiring 319 Terminal 321 Insulating film 328 Bulkhead 329 Spacer 350R Light emitting element 351R lower electrode 352 Upper electrode 353 layers 353a Light Emitting Unit 353b Light Emitting Unit 354 Middle Class 360 Encapsulating material 367BM light shielding layer 367p anti-reflection layer 367R colored layer 370 Opposing Substrate 370a Barrier film 370b board 370c adhesive layer 380B Light Emitting Module 380G Light Emitting Module 380R Light Emitting Module 500 Touch Panel 501 Display section 502R subpixel 502t transistor 503c capacity 503s Image signal line driver circuit 503t Transistor 509 FPC 510 Substrate 510a Barrier film 510b Board 510c adhesive layer 511 Wiring 519 Terminal 521 Insulating film 528 Bulkhead 550R Light emitting element 560 Encapsulating material 567BM light shielding layer 567p anti-reflection layer 567R colored layer 570 Substrate 570a Barrier film 570b board 570c ​​adhesive layer 580R Light Emitting Module 590 Substrate 591 Electrode 592 Electrode 593 Insulating Layer 594 Wiring 595 Touch Sensor 597 Adhesive layer 598 Wiring 599 Connection Layer

Claims

1. A calculation unit; A display unit on the computing unit; a position input unit on the display unit, the position input unit has a first area arranged on a top surface of the information processing device, a second area arranged on a side surface of the information processing device, a third area arranged on a side surface of the information processing device opposite to the second area, a first curved portion, and a second curved portion; the second region is seamlessly continuous with the first region via the first curved portion, the third region is seamlessly continuous with the first region via the second curved portion, The position input unit detects position information of a portion overlapping with a user's hand, the calculation unit compares a length of a first line segment obtained from position information of the second region with a predetermined length and compares a length of a second line segment obtained from position information of the third region with the predetermined length, and when one of the length of the first line segment or the length of the second line segment is longer than the predetermined length, calculates coordinates of a midpoint of the line segment longer than the predetermined length; An information processing device that displays an image for operation on the display unit at the position of an arc having the midpoint as a center or inside the arc.

2. A calculation unit; A display unit on the computing unit; a position input unit on the display unit, the position input unit has a first area arranged on a top surface of the information processing device, a second area arranged on a side surface of the information processing device, a third area arranged on a side surface of the information processing device opposite to the second area, a first curved portion, and a second curved portion; the second region is seamlessly continuous with the first region via the first curved portion, the third region is seamlessly continuous with the first region via the second curved portion, The position input unit detects position information of a portion overlapping with a user's hand, the calculation unit compares a length of a first line segment obtained from position information of the second region with a predetermined length and compares a length of a second line segment obtained from position information of the third region with the predetermined length, and when one of the length of the first line segment or the length of the second line segment is longer than the predetermined length, calculates coordinates of a midpoint of the line segment longer than the predetermined length; An information processing device that displays an image for operation within a specific range centered on the midpoint on the display unit.

Images