Information processing apparatus
A flexible position input unit with detection capabilities and a bent design enhances the operability of portable information processing devices by accurately detecting hand interactions and adapting display content, addressing the challenges of external damage and interaction methods.
Patent Information
- Application Number
- JP2025078165
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2013-10-11
- Filing Date
- 2025-05-08
- Publication Date
- 2025-07-25
- Estimated Expiration
- 2034-10-09
AI Technical Summary
Existing portable information processing devices face challenges in providing a human interface with excellent operability, particularly due to potential damage from external forces and the need for improved interaction methods.
Incorporating a flexible position input unit that can detect objects in proximity or contact, allowing for regions that can be bent and overlapped with a display unit, along with a detection unit to determine the device's state and generate image information based on position comparisons.
This configuration enables a human interface with enhanced operability by accurately detecting hand interactions and adapting display content based on device state, thereby improving usability.
Smart Images

Figure 2025109791000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an article, a method, or a manufacturing method. Alternatively, the present invention relates to a process, a machine , a manufacture, or a composition of matter. In particular , the present invention relates to, for example, a semiconductor device, a display device, a light-emitting device, a driving method thereof, or a manufacturing method thereof . In particular, the present invention relates to a method for processing and displaying image information, a program and an apparatus having a storage medium storing the program. For example, an image information processing, display method, and table for displaying an image including information processed by an information processing apparatus including a display unit and a program for causing an information processing apparatus including a display unit to display an image including information processed by the information processing apparatus, and an information processing apparatus having a storage medium storing the program .
Background Art
[0002] A display device having a large screen can display a lot of information. Therefore, it is excellent in listability and is suitable for an information processing apparatus
[0003] In addition, the social infrastructure related to information transmission means is well-developed. As a result, diverse and abundant information can be acquired, processed, or transmitted using an information processing apparatus not only at the workplace or at home but also outside .
[0004] Against this background, portable information processing apparatuses are actively being developed
[0005] Portable information processing apparatuses are often used outdoors, and unexpected forces may be applied to the information processing apparatus and the display device used therefor due to dropping. A display device that is not easily damaged As an example, a configuration in which the adhesion between the structure separating the light-emitting layer and the second electrode layer is enhanced is known (Patent Document 1).
Prior Art Documents
Patent Documents
[0006]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0007] One aspect of the present invention is to provide a novel human interface with excellent operability as one of the problems. Alternatively, to provide a novel information processing device or display device with excellent operability is one of the problems.
[0008] Note that the description of these problems does not prevent the existence of other problems. Note that one aspect of the present invention does not need to solve all of these problems. Note that other problems will become apparent from the description in the specification, drawings, claims, etc., and it is possible to extract these other problems from the description in the specification, drawings, claims, etc.
Means for Solving the Problems
[0009] One aspect of the present invention is an information processing device including an input / output device that supplies position information and to which image information is supplied, and a computing device that receives the position information and supplies image information .
[0010] The input / output device includes a position input unit and a display unit. Further, the position input unit includes a first region, a second region facing the first region, and a third region between the first region and the second region It has flexibility so that it can be bent to be formed.
[0011] The display unit is arranged to overlap with the third region, and image information is supplied and the image information is displayed The arithmetic unit includes an arithmetic unit and a storage unit that stores a program to be executed by the arithmetic unit. .
[0012] The information processing apparatus according to one aspect of the present invention includes a flexible position input unit that detects an object in proximity or contact therewith and supplies position information. As described above, the flexible position input unit can be bent so that a first region, a second region facing the first region, and a third region overlapping with the display unit are formed between the first region and the second region. As a result, for example, it is possible to know whether a palm or a finger of a hand is in proximity or contact with either the first region or the second region. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided. The flexible position input unit can be bent so that a first region, a second region facing the first region, and a third region overlapping with the display unit are formed between the first region and the second region. As a result, for example, it is possible to know whether a palm or a finger of a hand is in proximity or contact with either the first region or the second region. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided. By this, for example, it can be known whether a palm or a finger of a hand is in proximity or contact with either the first region or the second region. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided. By this, for example, it can be known whether a palm or a finger of a hand is in proximity or contact with either the first region or the second region. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided. By this, for example, it can be known whether a palm or a finger of a hand is in proximity or contact with either the first region or the second region. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided. By this, for example, it can be known whether a palm or a finger of a hand is in proximity or contact with either the first region or the second region. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided.
[0013] Further, the information processing apparatus according to one aspect of the present invention supplies detection information including position information and folding information, an input / output device to which image information is supplied, and an arithmetic device to which position information and detection information are supplied and which supplies image information. Note that the folding information includes information for distinguishing between a folded state and an unfolded state of the information processing apparatus. The input / output device includes a position input unit, a display unit, and a detection unit. The position input unit has flexibility so that it can be in an unfolded state and a folded state in which a first region, a second region facing the first region, and a third region are formed between the first region and the second region. The input / output device includes a position input unit, a display unit, and a detection unit. The position input unit has flexibility so that it can be in an unfolded state and a folded state in which a first region, a second region facing the first region, and a third region are formed between the first region and the second region. The input / output device includes a position input unit, a display unit, and a detection unit. The position input unit has flexibility so that it can be in an unfolded state and a folded state in which a first region, a second region facing the first region, and a third region are formed between the first region and the second region.
[0014] The input / output device includes a position input unit, a display unit, and a detection unit. The position input unit has flexibility so that it can be in an unfolded state and a folded state in which a first region, a second region facing the first region, and a third region are formed between the first region and the second region. The input / output device includes a position input unit, a display unit, and a detection unit. The position input unit has flexibility so that it can be in an unfolded state and a folded state in which a first region, a second region facing the first region, and a third region are formed between the first region and the second region. The input / output device includes a position input unit, a display unit, and a detection unit. The position input unit has flexibility so that it can be in an unfolded state and a folded state in which a first region, a second region facing the first region, and a third region are formed between the first region and the second region. It has flexibility so that it can be in an unfolded state and a folded state in which a first region, a second region facing the first region, and a third region are formed between the first region and the second region.
[0015] The detection unit includes a fold sensor capable of detecting the folded state of the position input unit and supplying detection information including folding information. Further, the display unit is arranged to overlap with the third region and displays the image information. Further, the arithmetic unit includes an arithmetic unit and a storage unit that stores a program for causing the arithmetic unit to execute. As described above, the information processing apparatus according to one aspect of the present invention includes a flexible position input unit capable of detecting an object in proximity to or in contact with and supplying position information, and a detection unit including a fold sensor capable of knowing whether the flexible position input unit is in a folded state or an unfolded state. The flexible position input unit can be bent so that a first region, a second region facing the first region in the folded state, and a third region overlapping the display unit are formed between the first region and the second region. Thereby, for example, it is possible to know whether a palm or any of the fingers of a hand is close to or in contact with either the first region or the second region. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided.
[0016] As described above, the information processing apparatus according to one aspect of the present invention includes a flexible position input unit capable of detecting an object in proximity to or in contact with and supplying position information, and a detection unit including a fold sensor capable of knowing whether the flexible position input unit is in a folded state or an unfolded state. The flexible position input unit can be bent so that a first region, a second region facing the first region in the folded state, and a third region overlapping the display unit are formed between the first region and the second region. Thereby, for example, it is possible to know whether a palm or any of the fingers of a hand is close to or in contact with either the first region or the second region. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided. The flexible position input unit can be bent so that a first region, a second region facing the first region in the folded state, and a third region overlapping the display unit are formed between the first region and the second region. Thereby, for example, it is possible to know whether a palm or any of the fingers of a hand is close to or in contact with either the first region or the second region. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided. The flexible position input unit can be bent so that a first region, a second region facing the first region in the folded state, and a third region overlapping the display unit are formed between the first region and the second region. Thereby, for example, it is possible to know whether a palm or any of the fingers of a hand is close to or in contact with either the first region or the second region. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided. The flexible position input unit can be bent so that a first region, a second region facing the first region in the folded state, and a third region overlapping the display unit are formed between the first region and the second region. Thereby, for example, it is possible to know whether a palm or any of the fingers of a hand is close to or in contact with either the first region or the second region. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided. The flexible position input unit can be bent so that a first region, a second region facing the first region in the folded state, and a third region overlapping the display unit are formed between the first region and the second region. Thereby, for example, it is possible to know whether a palm or any of the fingers of a hand is close to or in contact with either the first region or the second region. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided. The flexible position input unit can be bent so that a first region, a second region facing the first region in the folded state, and a third region overlapping the display unit are formed between the first region and the second region. Thereby, for example, it is possible to know whether a palm or any of the fingers of a hand is close to or in contact with either the first region or the second region. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided. The flexible position input unit can be bent so that a first region, a second region facing the first region in the folded state, and a third region overlapping the display unit are formed between the first region and the second region. Thereby, for example, it is possible to know whether a palm or any of the fingers of a hand is close to or in contact with either the first region or the second region. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided. The flexible position input unit can be bent so that a first region, a second region facing the first region in the folded state, and a third region overlapping the display unit are formed between the first region and the second region. Thereby, for example, it is possible to know whether a palm or any of the fingers of a hand is close to or in contact with either the first region or the second region. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided.
[0017] In another aspect of the present invention, the first region supplies first position information, the second region supplies second position information, and the arithmetic unit generates the image information to be displayed on the display unit based on the result of comparing the first position information and the second position information. In another aspect of the present invention, the first region supplies first position information, the second region supplies second position information, and the arithmetic unit generates the image information to be displayed on the display unit based on the result of comparing the first position information and the second position information. In another aspect of the present invention, the first region supplies first position information, the second region supplies second position information, and the arithmetic unit generates the image information to be displayed on the display unit based on the result of comparing the first position information and the second position information.
[0018] In another aspect of the present invention, the storage unit calculates a first line from the first position information supplied by the first region. A first step of determining the length of a line segment, and a second step of determining the length of a second line segment from the second position information supplied by the second region. If only one of the lengths of the first line segment and the second line segment is longer when compared with a predetermined length, proceed to the fourth step; otherwise, proceed to the first step. A third step, a fourth step of determining the coordinates of the midpoint of the line segment longer
[0019] than the predetermined length, a fifth step of generating image information based on the coordinates of the midpoint, and a sixth step of ending. A program that causes the arithmetic unit to execute these steps is stored in the above information processing apparatus. As described above, the information processing apparatus according to one aspect of the present invention includes a flexible position
[0020] input unit that can detect something in proximity or contact and supply position information, and an arithmetic unit. The flexible position input unit can be bent so that a first region, a second region opposite to the first region, and a third region overlapping the display unit are formed between the first region and the second region.
[0021] The arithmetic unit can compare the first position information supplies position information, the detection unit supplies detection information including folding information, and the calculation unit compares the image information to be displayed on the display unit with the result of comparing the first position information and the second position information and the folding information, and generates the above information processing device.
[0022] Further, in one aspect of the present invention, the storage unit determines the length of the first line segment from the first position information supplied by the first region, and the second line segment from the second position information supplied by the second region. A first step of determining the length of the line segment, a second step of determining the length of the second line segment from the second position information supplied by the second region, and the length of the first line segment and the length of the second line segment are compared with a predetermined length. If only one of them is long, proceed to the fourth step, and in other cases proceed to the first step, a third step of proceeding to the fourth step if only one of them is longer than the predetermined length, and coordinates of the midpoint of the line segment longer than the predetermined length A fourth step of determining, a fifth step of obtaining folding information and proceeding to the sixth step if the folding information indicates a folded state, and proceeding to the seventh step if it indicates an unfolded state A sixth step of generating the first image information based on the coordinates of the midpoint, a seventh step of generating the second image information based on the coordinates of the midpoint, and an eighth step of ending And storing a program for causing the calculation unit to execute the above steps. The above information processing device stores a program for causing the calculation unit to execute the above steps. The above information processing device stores a program for causing the calculation unit to execute the above steps. The above information processing device stores a program for causing the calculation unit to execute the above steps.
[0023] As described above, the information processing device according to one aspect of the present invention includes a flexible position input unit that can detect proximity or contact and supply position information, and a detection unit including a folding sensor that can know whether the flexible position input unit is in a folded state or an unfolded state. And a calculation unit. The flexible position input unit includes a first region, a second region that faces the first region in a folded state, and a display unit between the first region and the second region. unit. And the flexible position input unit includes a first region, a second region that faces the first region in a folded state, and a display unit between the first region and the second region. And the flexible position input unit includes a first region, a second region that faces the first region in a folded state, and a display unit between the first region and the second region. It can be bent so that a third region that overlaps with it is formed, and the calculation unit compares the first position information supplied by the first region with the second position information supplied by the second region, and Based on the result and the folding information, it is possible to generate image information to be displayed on the display unit.
[0024] As a result, for example, it is possible to determine whether any of the palm or fingers of the hand is close to or in contact with either the first region or the second region, and the first image (for example, an operation image is arranged) arranged so that the position input unit can be easily operated in the folded state or the second image arranged so that the position input unit can be easily operated in the unfolded state. It is possible to generate image information including any of them. As a result, a human interface with excellent operability can be provided. Or, it is possible to provide a novel information processing apparatus with excellent operability.
[0025] Also, in one aspect of the present invention, the display unit overlaps with the position input unit, has flexibility to be in a deployed state and a folded state, and a first area exposed in the folded state and a second area separated from the first area by a fold line. And the above information processing apparatus including the above.
[0026] The storage unit stores a program to be executed by the calculation unit. This program includes a first step of initializing, a second step of generating initial image information, a third step of permitting interrupt processing, and a fourth step of obtaining folding information and proceeding to the fifth step if the folding information indicates a folded state, and proceeding to the sixth step if it indicates an unfolded state. And a fifth step of displaying at least a part of the supplied image information in the first area. , a sixth step of displaying a part of the supplied image information in a first area and another part in a second area, a seventh step of proceeding to the eighth step when an end command is supplied in the interrupt process and proceeding to the fourth step when the end command is not supplied, and an eighth step of ending, comprising.
[0027] In the interrupt process, when a page feed command is supplied, it proceeds to the tenth step, and when the page feed command is not supplied, it proceeds to the eleventh step. A ninth step, a tenth step of generating image information based on the page feed command, and an eleventh step of returning from the interrupt process, comprising.
[0028] The information processing apparatus according to one aspect of the present invention described above can be in a deployed state and a folded state. It has flexibility, and a display unit including a first area exposed in the folded state and a second area separated from the first area by a fold. Further, according to the folding information, it includes a step of displaying a part of the generated image in the first area and another part in the second area. It includes a storage unit that stores a program for causing the arithmetic unit to execute processing.
[0029] Thereby, for example, a part of an image is displayed on a display unit (first area) exposed on the outer periphery of the information processing apparatus in the folded state, and a second area continuous with the first area of the display unit in the deployed state can display another part of the image continuous or related to the part of the image. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided.
Effects of the Invention
[0030] As described above, according to one aspect of the present invention, a human interface with excellent operability can be provided. Or, a novel information processing device with excellent operability can be provided. Or, a novel information processing device, a novel display device, etc. can be provided. Note that the description of these effects does not preclude the existence of other effects. Note that one aspect of the present invention does not necessarily have to have all of these effects. Other effects than these will be obvious from the descriptions in the specification, drawings, claims, etc., and it is possible to extract other effects than these from the descriptions in the specification, drawings, claims, etc.
Brief Description of the Drawings
[0031]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Figure 19
Embodiments for Carrying Out the Invention
[0032] The information processing apparatus according to one aspect of the present invention includes a flexible position input unit that can detect an object in proximity or contact therewith and supply position information. And the flexible position input unit can be bent so that a first region, a second region facing the first region, and a third region overlapping the display unit are formed between the first region and the second region. Thus, for example, it is possible to know whether a palm or a finger of a hand is in proximity or contact with either the first region or the second region. As a result, a human interface with excellent operability is provided. is provided.
[0033] Accordingly, for example, it can be known whether a palm or a finger of a hand is in proximity to or in contact with either the first region or the second region. As a result, a human interface with excellent operability is provided. An interface can be provided. Alternatively, a novel information processing apparatus with excellent operability can be provided .
[0034] Embodiments will be described in detail with reference to the drawings. However, the present invention is not limited to the following description, and it is easily understood by those skilled in the art that the form and details can be variously changed without departing from the spirit and scope of the present invention. Therefore, the present invention is not construed as being limited to the description of the embodiments shown below. In the configuration of the invention described below, the same reference numerals are commonly used among different drawings for the same part or parts having the same function, and the repeated description thereof will be omitted and shall not be construed as being limited to the description of the embodiments shown below. In the configuration of the invention described below, the same reference numerals are commonly used among different drawings for the same part or parts having the same function, and the repeated description thereof will be omitted Among them, the same reference numerals are commonly used among different drawings for the same part or parts having the same function, and the repeated description thereof will be omitted .
[0035] (Embodiment 1) In this embodiment, the configuration of an information processing apparatus according to an aspect of the present invention will be described with reference to FIGS. 1, 2, and FIG. 17
[0036] FIG. 1 is a block diagram for explaining the configuration of an information processing apparatus 100 according to an aspect of the present invention
[0037] FIG. 2(A) is a schematic diagram for explaining the appearance of the information processing apparatus 100 according to an aspect of the present invention, and FIG. 2 (B) is a cross-sectional view for explaining the cross-sectional structure at the cutting line X1-X2 shown in FIG. 2(A). Note that, as shown in FIG. 2(A), the display unit 130 may be provided not only on the front surface of the information processing apparatus 100 but also on the side surface. Alternatively, as shown in FIG. 17(A) and its cross-sectional view FIG. 17(B), it may not be provided on the side surface of the information processing apparatus 100 .
[0038] FIG. 2(C-1) is a schematic diagram for explaining the arrangement of the position input unit 140 and the display unit 130 applicable to the information processing apparatus 100 according to an aspect of the present invention, and FIG. 2(C-2) is a diagram of the position input unit 140 It is a schematic diagram for explaining the arrangement of the proximity sensor 142.
[0039] FIG. 2(D) is a cross-sectional view of the position input unit 140 at the cutting line X3-X4 shown in FIG. 2(C-2). It is a cross-sectional view for explaining the structure.
[0040] <Configuration Example of Information Processing Apparatus> The information processing apparatus 100 described here includes a housing 101, an input / output device 120 that supplies position information L-INF and image information VIDEO, and an arithmetic device 110 that supplies position information L-INF and supplies the recorded image information VIDEO (see FIGS. 1 and 2(B)). The input / output device 120 includes a position input unit 140 that supplies position information L-INF and a display unit 130 to which image information VIDEO is supplied. (See FIGS. 1 and 2(B)). .
[0041] The position input unit 140 can be bent, for example, so that a first region 140(1), a second region 140(2) facing the first region 140(1), and a third region 140(3) are formed between the first region 140(1) and the second region 140(2) (see FIG. 2(B)). Here, the third region 140(3) is in contact with the first region 140(1) and the second region 140(2), and the first to third regions integrally form the position input unit 140. The position input unit 140 has flexibility.
[0042] Alternatively, separate position input units 140 may be provided in each region. For example, as shown in FIGS. 17(C)(D)(E), position input units 140(A), position input units 140(B), position input units 140(C), position input units 140(D), and positions are provided in each region. ). input unit 140(C), position input unit 140(D), and position input unit 140(E). input unit 140(E). input unit 140(E).
[0043] On the other hand, separate position input units 140 may be provided in each region. For example, as shown in FIGS. 17(C)(D)(E), position input units 140(A), position input units 140(B), position input units 140(C), position input units 140(D), and positions are provided in each region. For example, as shown in FIGS. 17(C)(D)(E), in each region, there are position input units 140(A ), position input units 140(B), position input units 140(C), position input units 140(D), and positions The input unit 140(E) may be provided independently. Alternatively, as shown in FIG. 17(F), the position input unit 140(A), the position input unit 140(B), the position input unit 140(C), the position input unit 1 40(D), and a part of the position input unit 140(E) may not be provided. Alternatively, as shown in FIGS. 17 (G)(H), it may be provided so as to surround the whole.
[0044] Note that the arrangement of the second region 140(2) facing the first region 140(1) is not limited to the arrangement directly facing the first region 140(1), and shall include the arrangement facing the first region 140(1) with an inclination.
[0045] The display unit 130 is arranged so that the image information VIDEO is supplied and overlaps with the third region 140(3) (see FIG. 2(B)). The arithmetic unit 110 includes a storage unit 112 that stores a program to be executed by the arithmetic unit 111 and the arithmetic unit 11 1 (see FIG. 1).
[0046] The information processing apparatus 100 described here includes a flexible position input unit that detects an object in proximity or contact. The position input unit 140 can be bent so that a first region 140(1 ), a second region 140(2) facing the first region 140(1), and a third region 140(3 ) that overlaps with the display unit 130 are formed between the first region 140(1) and the second region 140(2). As a result, for example, it is possible to know whether any of the palm or fingers is in proximity or contact with either the first region 140(1) or the second region 140(2). As a result, a human interface with excellent operability can be provided. Alternatively, a novel information processing apparatus with excellent operability can be provided.
[0047] The individual elements constituting the information processing apparatus 100 will be described below.
[0048] 《Input / Output Device》 The input / output device 120 includes a position input unit 140 and a display unit 130. Further, the input / output unit 145 , a detection unit 150, a communication unit 160, etc. may also be included.
[0049] 《Position Input Unit》 The position input unit 140 supplies position information L-INF. A user of the information processing apparatus 100 can supply the position information L-INF to the position input unit 140 by bringing a finger or a palm close to or into contact with the position input unit 140, and thereby supply various operation commands to the information processing apparatus 100. For example, it is possible to supply an operation command including an end command (a command to end a program) (see FIG. 1).
[0050] The position input unit 140 includes a first area 140(1), a second area 140(2), and a third area 140(3) between the first area 140(1) and the second area 140(2) (see FIG. 2 (C-1)). Proximity sensors 142 are arranged in a matrix in each of the first area 140(1), the second area 140(2), and the third area 140(3) (see FIG. 2(C- 2)).
[0051] As an example, the position input unit 140 has a flexible substrate 141 and proximity sensors 142 on the flexible substrate 141 (see FIG. 2(D)).
[0052] As an example, the position input unit 140 can be bent so that the second area 140(2) and the first area 140(1) face each other (see FIG. 2(B)).
[0053] The third region 140(3) of the position input unit 140 overlaps with the display unit 130 (see FIGS. 2(B) and 2(C-1)). When the third region 140(3) is arranged on the user side of the display unit 130, the third region 140(3) has translucency.
[0054] The second region in the folded state is separated from the first region to such an extent that the user can hold it with one hand (see FIG. 6(A-1)). The separation distance is, for example, 17 cm or less, preferably 9 cm or less, more preferably 7 cm or less. When the separation distance is short, position information can be input to a wide range of the third region 140(3) using the thumb of the gripping hand.
[0055] Thus, the user can hold the information processing apparatus 100 by bringing the base part of the thumb (near the thenar) close to or into contact with either the first region 140(1) or the second region 140(2), and bringing the fingers other than the thumb close to or into contact with the other.
[0056] Since the shape of the base part of the thumb is different from the shape of the fingers other than the thumb, the first region 140(1) supplies different position information from the second region 140(2). Specifically, the shape of the base part of the thumb has features such as being larger or continuous than the shape of the fingers other than the thumb.
[0057] The proximity sensor 142 may be any sensor that can detect an object that is close to or in contact with it (e.g., a finger or a palm), and for example, a capacitive element or an imaging element can be applied. Note that a substrate having a capacitive element in a matrix form can be referred to as a capacitive touch sensor, and a substrate having an imaging element can be referred to as an optical touch sensor.
[0058] As the flexible substrate 141, a resin can be applied. Examples of the resin include polyester, polyolefin, polyamide, polyimide, polycarbonate, acrylic resin, etc. can be mentioned.
[0059] In addition, a glass substrate, a quartz substrate, a semiconductor substrate, etc. with a thickness having flexibility can be used. is possible.
[0060] Specific configuration examples applicable to the position input unit 140 will be described and explained in Embodiment 6 and Embodiment 7.
[0061] 《Display Unit》 The display unit 130 is arranged at a position overlapping at least the third region 140(3) of the position input unit 140. Also, the display unit 130 may be arranged so as to overlap not only the third region 140(3) but also the first region 14 0(1) and / or the second region 140(2).
[0062] The display unit 130 may be any as long as it can display the supplied image information VIDEO, and is not particularly limited. specified.
[0063] Operation commands different from those of the third region 140( 3) can be associated with the first region 140(1) and / or the second region 140(2).
[0064] As a result, the user can confirm the operation commands associated with the first region 140(1) and / or the second region 140(2) using the display unit. As a result, various operation commands can be associated. In addition, misinput of operation commands can be reduced.
[0065] Specific configuration examples applicable to the display unit 130 will be described in Embodiment 6 and Embodiment 7. It will be described.
[0066] 《Arithmetic Unit》 The arithmetic unit 110 includes an arithmetic section 111, a memory section 112, an input / output interface 115, and a transmission path 114 (see FIG. 1).
[0067] The arithmetic unit 110 is supplied with position information L-INF and supplies image information VIDEO.
[0068] For example, the arithmetic unit 110 supplies the image information VIDEO including the operation image of the information processing apparatus 100 to the input / output device 120. The display section 130 displays the operation image.
[0069] The user can supply the position information L-INF for selecting the image by touching the third area 140(3) overlapping the display section 130 with a finger.
[0070] 《Arithmetic Section》 The arithmetic section 111 executes the program stored in the memory section 112. For example, when the position information L-INF associated with the position where the operation image is displayed is supplied, the arithmetic section 111 executes the program associated in advance with the image.
[0071] 《Memory Section》 The memory section 112 stores the program to be executed by the arithmetic section 111.
[0072] An example of the program to be processed by the arithmetic unit 110 will be described in Embodiment 3.
[0073] 《Input / Output Interface and Transmission Path》 The input / output interface 115 supplies information and information is supplied.
[0074] The transmission path 114 can supply information, and the arithmetic unit 111, the memory unit 112, and the input / output interface 115 are supplied with information. Also, the arithmetic unit 111, the memory unit 112, and the input / output interface 115 can supply information, and the transmission path 114 is supplied with information from them.
[0075] 《Detection Unit》 The detection unit 150 detects the information processing apparatus 100 and its surrounding states, and supplies detection information SENS (see Fig. 1).
[0076] The detection unit 150 may detect, for example, acceleration, azimuth, pressure, navigation satellite system (NSS) signals, temperature, humidity, etc., and supply that information. Specifically, it may detect GPS (Global Positioning System) signals and supply that information.
[0077] 《Communication Unit》 The communication unit 160 supplies the information COM supplied by the arithmetic unit 110 to devices external to the information processing apparatus 100 or to a communication network. Also, it acquires the information COM from external devices or a communication network and supplies it.
[0078] The information COM can include various commands, etc. For example, it can include a display command for causing the arithmetic unit 111 to generate or erase image information VIDEO, etc.
[0079] Communication means for connecting to external devices or a communication network, such as a hub, router, or modem, etc., can be applied to the communication unit 160. Note that the connection method is not limited to a wired method, and wireless (e.g., radio waves or infrared rays, etc.) can also be used.
[0080] 《Input / Output Unit》 For example, a camera, a microphone, a read-only external storage unit, an external storage unit, a scanner, a speaker, etc. can be used for the input / output unit 145 (see FIG. 1). 、A printer, etc. can be used for the input / output unit 145 (see FIG. 1).
[0081] Specifically, a digital camera, a digital video camera, etc. can be used as the camera. .
[0082] A hard disk or a removable memory, etc. can be used as the external storage unit. Also 、A CDROM, a DVDROM, etc. can be used as the read-only external storage unit.
[0083] 《Housing》 The housing 101 protects the arithmetic unit 110, etc. from stress applied from the outside.
[0084] Metal, plastic, glass, ceramics, etc. can be used for the housing 101.
[0085] Note that this embodiment can be appropriately combined with other embodiments shown in this specification. .
[0086] (Embodiment 2) In this embodiment, the configuration of the information processing apparatus according to one aspect of the present invention will be described with reference to FIGS. 3 to 5. .
[0087] FIG. 3 is a block diagram for explaining the configuration of an information processing apparatus 100B according to one aspect of the present invention.
[0088] FIG. 4 is a schematic diagram for explaining the appearance of the information processing apparatus 100B. FIG. 4(A) is a developed state state, FIG. 4(B) is a bent state, and FIG. 4(C) is a folded state of the information processing apparatus 1 00B.
[0089] FIG. 5 is a schematic diagram for explaining the configuration of the information processing apparatus 100B, and FIGS. 5(A) to 5(D) are diagrams for explaining the configuration in the unfolded state, and FIG. 5(E) is a diagram for explaining the configuration in the folded state.
[0090] FIGS. 5(A) to 5(C) are, respectively, a top view, a bottom view, and a side view of the information processing apparatus 100B . Further, FIG. 5(D) is a cross-sectional view for explaining the cross-sectional structure of the information processing apparatus 1 00B at the cutting line Y1 - Y2 shown in FIG. 5(A). FIG. 5(E) is a side view of the information processing apparatus 100B in the folded state.
[0091] <Configuration Example of Information Processing Apparatus> The information processing apparatus 100B described here supplies detection information SENS including position information L - INF and folding information, and an input / output device 120B to which image information VIDEO is supplied, and a position information L - INF and folding information, and a calculation device 110 to which detection information SENS including folding information is supplied and which supplies image information VI DEO (see FIG. 3).
[0092] The input / output device 120B includes a position input unit 140B, a display unit 130, and a detection unit 150 .
[0093] The position input unit 140B has flexibility such that it can be in an unfolded state, and a first region 140B(1), a second region 140B(2) facing the first region 140B(1), and a third region 140B(3) is formed between the first region 140B(1) and the second region 140B(2) so as to be foldable into a folded state (see FIGS. 4 and 5).
[0094] The detection unit 150 detects the folded state of the position input unit 140B and includes folding information A folding sensor 151 is provided which is capable of providing detection information SENS.
[0095] The display unit 130 is supplied with image information VIDEO and overlaps with the third area 140B(3). The calculation device 110 is arranged so as to include a calculation unit 111 and a program to be executed by the calculation unit 111. The device includes a storage unit 112 for storing the data (see FIG. 5(D)).
[0096] The information processing device 100B described here has a first area 140B(1), a folded state The second region 140B(2) facing the first region 140B(1) and the first region 14 A third region 140B overlapping the display unit 130 between the second region 140B(1) and the third region 140B(2). (3) A flexible position input unit 140 capable of detecting a palm or a finger that is in close proximity to or in contact with the B, it is possible to know whether the flexible position input unit 140B is in a folded or unfolded state. and a detection unit 150 including a folding sensor 151 capable of folding the device (see FIG. 3 and FIG. 5). This allows, for example, the palm or the fingers of the hand to be in contact with the first region 140B(1). It can be known whether the first region 140B(1) or the second region 140B(2) has come into proximity with or into contact with the first region 140B(1). As a result, a human interface with excellent operability can be provided. It is possible to provide an excellent new information processing device.
[0097] The individual elements constituting the information processing device 100B will be described below.
[0098] In addition, the information processing device 100B is in a state where the position input unit 140B is unfolded or folded. The input / output device 120B has a flexibility that allows it to be folded. The information processing device 100 differs from the information processing device 100 described in the first embodiment in that it includes a folding sensor 151 . Here, different configurations will be described in detail, and for parts where the same configuration can be used, the above description will be incorporated by reference.
[0099] 《Input / Output Device》 The input / output device 120B includes a position input unit 140B, a display unit 130, and a detection unit 150 including a folding sensor 151. Further, it may include an input / output unit 145, a label 159, a communication unit 16 0, etc. Also, information is supplied to the input / output device 120B and the information can be supplied ( FIG. 3).
[0100] 《Housing》 The information processing device 100B has a housing that alternately includes a highly flexible portion E1 and a low-flexibility portion E2. In other words, the housing of the information processing device 100B includes a highly flexible portion E1 and a low-flexibility portion E2 in a strip (striped) shape (see FIGS. 5(A) and 5(B)). Accordingly, the information processing device 100B can be folded (see FIG. 4). The folded
[0101] information processing device 100B in the folded state has excellent portability. Also, a part of the third region 140B(3) of the position input unit 140B can be folded outwards and only that part can be used as a display area (see FIG. 4(C)). For example, shapes such as a shape with parallel ends, a triangular shape, a trapezoidal shape, or a fan shape can be used for the shapes of the highly flexible portion
[0102] E1 and the low-flexibility portion E2 (see FIG. 5(A)). The information processing device 100B can be folded into a size that can be held with one hand. Therefore,
[0103] the user can input position information to the third region 140B(3) with the thumb of the supporting hand. Thus, This makes it possible to provide an information processing apparatus that can be operated with one hand (see Fig. 8(A)). (See Fig. 8(A)).
[0104] In the folded state, a part of the position input unit 140B is on the inside, and the user cannot operate the part that has moved to the inside (see Fig. 4(C)). Therefore, the drive of this part can be stopped. As a result, power consumption can be reduced. In the folded state, a part of the position input unit 140B is on the inside, and the user cannot operate the part that has moved to the inside (see Fig. 4(C)). Therefore, the drive of this part can be stopped. As a result, power consumption can be reduced. In the folded state, a part of the position input unit 140B is on the inside, and the user cannot operate the part that has moved to the inside (see Fig. 4(C)). Therefore, the drive of this part can be stopped. As a result, power consumption can be reduced.
[0105] Also, the position input unit 140B in the unfolded state has no seams and a wide operation area.
[0106] The display unit 130 is disposed so as to overlap with the third region 140B(3) of the position input unit (see Fig. 5(D)). The position input unit 140B is sandwiched between the connection member 13a and the connection member 13b. The connection member 13a and the connection member 13b are sandwiched between the support member 15a and the support member 15b (see Fig. 5(C)). The display unit 130 is disposed so as to overlap with the third region 140B(3) of the position input unit (see Fig. 5(D)). The position input unit 140B is sandwiched between the connection member 13a and the connection member 13b. The connection member 13a and the connection member 13b are sandwiched between the support member 15a and the support member 15b (see Fig. 5(C)). The display unit 130 is disposed so as to overlap with the third region 140B(3) of the position input unit (see Fig. 5(D)). The position input unit 140B is sandwiched between the connection member 13a and the connection member 13b. The connection member 13a and the connection member 13b are sandwiched between the support member 15a and the support member 15b (see Fig. 5(C)). (See Fig. 5(C)).
[0107] The display unit 130, the position input unit 140B, the connection member 13a, the connection member 13b, the support member 15a, and the support member 15b are fixed by various methods such as an adhesive, a screw, or a structure that can be fitted to each other. The display unit 130, the position input unit 140B, the connection member 13a, the connection member 13b, the support member 15a, and the support member 15b are fixed by various methods such as an adhesive, a screw, or a structure that can be fitted to each other. The display unit 130, the position input unit 140B, the connection member 13a, the connection member 13b, the support member 15a, and the support member 15b are fixed by various methods such as an adhesive, a screw, or a structure that can be fitted to each other.
[0108] 《Highly flexible part》 The highly flexible part E1 can be bent and functions as a hinge.
[0109] The highly flexible part E1 overlaps with the connection member 13a and the connection member 13b that overlaps with the connection member 13a (see Figs. 5(A) to 5(C)). (See Figs. 5(A) to 5(C)).
[0110] 《Lowly flexible part》 The lowly flexible part E2 includes at least one of the support member 15a or the support member 15b. It has, for example, a support member 15a and a support member 15b that overlaps with the support member 15a. Also, a configuration having only the support member 15b can reduce the weight or thickness of the low-flexibility portion E2.
[0111] 《Connection Member》 The connection members 13a and 13b have flexibility. For example, flexible plastic, metal, alloy, and / or rubber, etc. can be applied to the connection members 13a and 13b. Specifically, silicone rubber can be applied to the connection members 13a and 13b.
[0112] 《Support Member》 Either the support member 15a or the support member 15b has lower flexibility than the connection members 13a and 13b. The support member 15a or the support member 15b can increase the mechanical strength of the position input unit 140B and protect the position input unit 140B from damage.
[0113] For example, plastic, metal, alloy, rubber, etc. can be used for the support member 15a or the support member 15b. The connection members 13a, 13b, the support member 15a, or the support member 15b made of plastic or rubber, etc. can have their weight reduced. Or, they can be made less likely to break.
[0114] Specifically, engineering plastic or silicone rubber can be used. Also, stainless steel, aluminum, or magnesium alloy, etc. can be used for the support members 15a and 15b.
[0115] 《Position Input Unit》 The position input unit 140B can be in a deployed state or a folded state (see FIGS. 4(A) to 4(C)).
[0116] The third region 140B(3) is arranged on the upper surface of the information processing apparatus 100B in the deployed state (see FIG. 5(D)), and is arranged on the upper surface and the side surface of the information processing apparatus 100B in the folded state (see FIG. 5(E)).
[0117] When the position input unit 140B is deployed, a larger area than in the folded state can be utilized.
[0118] When the position input unit 140B is folded, an operation command different from the operation command associated with the upper surface of the third region 140B(3) can be associated with the side surface. Note that an operation command different from the operation command associated with the second region 140B(2 ) may also be associated. Thereby, complex operation commands can be made using the position input unit 140B.
[0119] The position input unit 140B supplies position information L-INF (see FIG. 3).
[0120] The position input unit 140B is between the support member 15a and the support member 15b. The connection member 13a and the connection member 13b may sandwich the position input unit 140B.
[0121] The position input unit 140B includes a first region 140B(1), a second region 140B(2), and a third region 140B(3) between the first region 140B(1) and the second region 140B(2) and (see FIG. 5(D)).
[0122] The position input unit 140B has a flexible substrate and a proximity sensor on the flexible substrate. And Then, proximity sensors are arranged in a matrix in each of the first region 140B(1), the second region 140B(2), and the third region 140B( 3).
[0123] Note that specific configuration examples applicable to the position input unit 140B are described in Embodiment 6 and Embodiment 7.
[0124] 《Detection Unit and Label》 The information processing apparatus 100B includes a detection unit 150. The detection unit 150 includes a folding sensor 151 . (See FIG. 3).
[0125] Also, the folding sensor 151 and the label 159 are arranged in the information processing apparatus 100B so as to be able to detect the folded state of the position input unit 140B (FIGS. 4(A) and 4(B ), FIGS. 5(A), 5(C), and 5(E)).
[0126] When the position input unit 140B is in the unfolded state, the label 159 is located away from the folding sensor 151 . (See FIGS. 4(A), 5(A), and 5(C)).
[0127] When the position input unit 140B is bent by the connection member 13a, the label 159 approaches the folding sensor 151 . (See FIG. 4(B)).
[0128] When the position input unit 140B is folded by the connection member 13a, the label 159 faces the folding sensor 151 . (See FIG. 5(E)).
[0129] The detection unit 150 detects the label 159 and determines that the position input unit 140B is in the folded state, and supplies detection information SENS including folding information.
[0130] 《Display Unit》 The display unit 130 overlaps at least a part of the third area 140B(3) of the position input unit 140B. The display unit 130 is arranged to display the supplied image information VIDEO. That would be fine.
[0131] Since the display unit 130 is flexible, it can be folded or unfolded so as to overlap the position input unit 140B. This allows the display unit 130 to display a seamless image with excellent visibility. This can be done.
[0132] Specific configuration examples applicable to the flexible display unit 130 will be described in the sixth and sixth embodiments. This will be described in the seventh embodiment.
[0133] 《Arithmetic device》 The arithmetic device 110 includes a calculation unit 111, a storage unit 112, an input / output interface 115, and It includes a transmission path 114 (see FIG. 3).
[0134] Note that this embodiment mode can be appropriately combined with other embodiment modes described in this specification. .
[0135] (Embodiment 3) In this embodiment, a configuration of an information processing device according to one embodiment of the present invention will be described with reference to FIGS. Description will be given with reference to FIG. 7, FIG. 18 and FIG.
[0136] FIG. 6 is a diagram illustrating a state in which an information processing device 100 according to an embodiment of the present invention is held by a user. Here, in the position input section 140, the third area 140(3) is the same as the first area 140 (1) and the second region 140(2), and the first region 140(1) and the second region 140(2) are located between The areas 140(2) face each other. This is a diagram for explaining the appearance in the state of being held by the user. FIG. 6(A-2) is a developed view of the position input unit 140 shown in FIG. 6(A-1), showing the part where the proximity sensor has detected the palm or finger. Note that, as separate position input units, the case where the position input unit 140(A), the position input unit 140(B), and the position input unit 140(C) are used is shown in FIG. 18(A). Also in this case, it can be considered in the same way as FIG. 6(A-2). That is, it shows the part where the proximity sensor has detected the palm or finger. Note that, as separate position input units, the case where the position input unit 140(A), the position input unit 140(B), and the position input unit 140(C) are used is shown in FIG. 18(A). Also in this case, it can be considered in the same way as FIG. 6(A-2). Note that, as separate position input units, the case where the position input unit 140(A), the position input unit 140(B), and the position input unit 140(C) are used is shown in FIG. 18(A). Also in this case, it can be considered in the same way as FIG. 6(A-2). Note that, as separate position input units, the case where the position input unit 140(A), the position input unit 140(B), and the position input unit 140(C) are used is shown in FIG. 18(A). Also in this case, it can be considered in the same way as FIG. 6(A-2). Note that, as separate position input units, the case where the position input unit 140(A), the position input unit 140(B), and the position input unit 140(C) are used is shown in FIG. 18(A). Also in this case, it can be considered in the same way as FIG. 6(A-2).
[0137] FIG. 6(B-1) is a schematic diagram showing, by solid lines, the results of edge detection processing on the first position information L-INF(1) detected by the first region 140(1) and the second position information L-INF(2) detected by the second region 140(2). FIG. 6(B-2) is a schematic diagram showing, by hatching, the results of labeling processing on the first position information L-INF(1) and the second position information L-INF(2). That is, FIG. 6(B-1) is a schematic diagram showing, by solid lines, the results of edge detection processing on the first position information L-INF(1) detected by the first region 140(1) and the second position information L-INF(2) detected by the second region 140(2). FIG. 6(B-2) is a schematic diagram showing, by hatching, the results of labeling processing on the first position information L-INF(1) and the second position information L-INF(2). That is, FIG. 6(B-1) is a schematic diagram showing, by solid lines, the results of edge detection processing on the first position information L-INF(1) detected by the first region 140(1) and the second position information L-INF(2) detected by the second region 140(2). FIG. 6(B-2) is a schematic diagram showing, by hatching, the results of labeling processing on the first position information L-INF(1) and the second position information L-INF(2). That is, FIG. 6(B-1) is a schematic diagram showing, by solid lines, the results of edge detection processing on the first position information L-INF(1) detected by the first region 140(1) and the second position information L-INF(2) detected by the second region 140(2). FIG. 6(B-2) is a schematic diagram showing, by hatching, the results of labeling processing on the first position information L-INF(1) and the second position information L-INF(2). That is, FIG. 6(B-1) is a schematic diagram showing, by solid lines, the results of edge detection processing on the first position information L-INF(1) detected by the first region 140(1) and the second position information L-INF(2) detected by the second region 140(2). FIG. 6(B-2) is a schematic diagram showing, by hatching, the results of labeling processing on the first position information L-INF(1) and the second position information L-INF(2).
[0138] FIG. 7 is a flowchart for explaining a program to be executed by the arithmetic unit 111 of the information processing apparatus according to one aspect of the present invention. That is, FIG. 7 is a flowchart for explaining a program to be executed by the arithmetic unit 111 of the information processing apparatus according to one aspect of the present invention.
[0139] <Configuration example of information processing apparatus> The information processing apparatus 100 described here is different from the information processing apparatus described in Embodiment 1 in that the first region 140(1) supplies the first position information L-INF(1) and the second region 140(2) supplies the second position information L-INF(2) (see FIG. 6(A-2)). The arithmetic unit 111 generates the image information VIDEO to be displayed on the display unit 130 overlapping with the third region 140(3) based on the result of comparing the first position information L-INF(1) and the second position information L-INF(2). (See FIGS. 1, 2, and 6). Here, different configurations will be described in detail. That is, the information processing apparatus 100 described here is different from the information processing apparatus described in Embodiment 1 in that the first region 140(1) supplies the first position information L-INF(1) and the second region 140(2) supplies the second position information L-INF(2) (see FIG. 6(A-2)). The arithmetic unit 111 generates the image information VIDEO to be displayed on the display unit 130 overlapping with the third region 140(3) based on the result of comparing the first position information L-INF(1) and the second position information L-INF(2). (See FIGS. 1, 2, and 6). Here, different configurations will be described in detail. That is, the information processing apparatus 100 described here is different from the information processing apparatus described in Embodiment 1 in that the first region 140(1) supplies the first position information L-INF(1) and the second region 140(2) supplies the second position information L-INF(2) (see FIG. 6(A-2)). The arithmetic unit 111 generates the image information VIDEO to be displayed on the display unit 130 overlapping with the third region 140(3) based on the result of comparing the first position information L-INF(1) and the second position information L-INF(2). (See FIGS. 1, 2, and 6). Here, different configurations will be described in detail. That is, the information processing apparatus 100 described here is different from the information processing apparatus described in Embodiment 1 in that the first region 140(1) supplies the first position information L-INF(1) and the second region 140(2) supplies the second position information L-INF(2) (see FIG. 6(A-2)). The arithmetic unit 111 generates the image information VIDEO to be displayed on the display unit 130 overlapping with the third region 140(3) based on the result of comparing the first position information L-INF(1) and the second position information L-INF(2). (See FIGS. 1, 2, and 6). Here, different configurations will be described in detail. That is, the information processing apparatus 100 described here is different from the information processing apparatus described in Embodiment 1 in that the first region 140(1) supplies the first position information L-INF(1) and the second region 140(2) supplies the second position information L-INF(2) (see FIG. 6(A-2)). The arithmetic unit 111 generates the image information VIDEO to be displayed on the display unit 130 overlapping with the third region 140(3) based on the result of comparing the first position information L-INF(1) and the second position information L-INF(2). (See FIGS. 1, 2, and 6). Here, different configurations will be described in detail. That is, the information processing apparatus 100 described here is different from the information processing apparatus described in Embodiment 1 in that the first region 140(1) supplies the first position information L-INF(1) and the second region 140(2) supplies the second position information L-INF(2) (see FIG. 6(A-2)). The arithmetic unit 111 generates the image information VIDEO to be displayed on the display unit 130 overlapping with the third region 140(3) based on the result of comparing the first position information L-INF(1) and the second position information L-INF(2). (See FIGS. 1, 2, and 6). Here, different configurations will be described in detail. The above description will be used in detail, and where a similar configuration can be used, the above description will be used.
[0140] Below, the individual elements constituting the information processing device 100 will be described.
[0141] <<Location input section>> The position input unit 140 includes a first area 140(1) and a second area 140(2) facing the first area 140(1). Between the first region 140(1) and the second region 140(2), The display portion 130 and the third region 140(3) can be folded to form the third region 140(3). The material has sufficient flexibility (see FIG. 2(B)).
[0142] The first area 140(1) and the second area 140( 2) detects a part of the palm of the user and a part of the fingers. 1) is a first position information LI including position information of parts of the index finger, middle finger, and ring finger in contact with each other. NF(1) is supplied, and the second region 140(2) is adjacent to the base of the thumb (near the ball of the foot). The second position information L-INF(2) includes position information for the third region 14. 0(3) provides position information for the thumb contact point.
[0143] 《Display section》 The display unit 130 is provided at a position overlapping with the third region 140(3) (FIG. 6(A-1 ) and FIG. 6(A-2). The display unit 130 is supplied with image information VIDEO. For example, image information VI including an image for operating the information processing device 100 is displayed. The user places his or her thumb over the image in a third area 140 ( 3) By approaching or touching the image, you can input location information to select the image. do.
[0144] For example, as shown in FIG. 18(B), when operating with the right hand, a keyboard 131 or icons are displayed on the right side. On the other hand, when operating with the left hand, as shown in FIG. 18(C) , a keyboard 131 or icons are displayed on the left side. By doing so, it becomes easier to operate with the fingers .
[0145] Note that in the detection unit 150, by detecting the acceleration and detecting the inclination of the information processing apparatus 100 , the display screen may be changed. For example, as shown in FIG. 19(A), consider the state of holding with the left hand and being inclined to the right when viewed from the direction of the arrow 152 (see FIG. 19(C)). In this case , by detecting this inclination, a left - hand - side screen is displayed as shown in FIG. 18(C). Similarly, as shown in FIG. 19(B), consider the case of holding with the right hand and being inclined to the left when viewed from the direction of the arrow 152 (see FIG. 19(D)). Here, by detecting this inclination , a right - hand - side screen is displayed as shown in FIG. 18(B). In this way, the display positions of the keyboard and icons and the like may be controlled.
[0146] Note that by the user's own setting, the right - hand operation screen and the left - hand operation screen may be changed .
[0147] <Arithmetic Unit> The arithmetic unit 111 is supplied with the first position information L - INF(1) and the second position information L - INF(2), and compares the first position information L - INF(1) and the second position information L - INF(2) . Based on the result of the comparison, it generates the image information VIDEO to be displayed on the display unit 130 .
[0148] <Program> The information processing apparatus described here includes a storage unit that stores a program for causing the arithmetic unit 111 to execute the following six steps (see Fig. 7(A)). Hereinafter, the program will be described. (See Fig. 7(A)). Hereinafter, the program will be described. .
[0149] 《First Example》 In the first step, the length of the first line segment is determined from the first position information L-INF(1) supplied by the first region 140(1) (see Fig. 7(A)(S1)). (See Fig. 7(A)(S1)).
[0150] In the second step, the length of the second line segment is determined from the second position information L-INF(2) supplied by the second region 140(2) (see Fig. 7(A)(S2)). (See Fig. 7(A)(S2)).
[0151] In the third step, the lengths of the first and second line segments are compared with a predetermined length. If only one of them is longer, proceed to the fourth step; otherwise, proceed to the first step (see Fig. 7(A)(S3)). Note that the predetermined length is preferably 2 cm or more and 15 cm or less, and particularly preferably 5 cm or more and 10 cm or less. If only one of them is longer, proceed to the fourth step; otherwise, proceed to the first step (see Fig. 7(A)(S3)). Note that the predetermined length is preferably 2 cm or more and 15 cm or less, and particularly preferably 5 cm or more and 10 cm or less. (see Fig. 7(A)(S3)). Note that the predetermined length is preferably 2 cm or more and 15 cm or less, and particularly preferably 5 cm or more and 10 cm or less. (see Fig. 7(A)(S3)). Note that the predetermined length is preferably 2 cm or more and 15 cm or less, and particularly preferably 5 cm or more and 10 cm or less.
[0152] In the fourth step, the coordinates of the midpoint of the line segment longer than the predetermined length are determined (see Fig. 7(A)(S4)). (see Fig. 7(A)(S4)).
[0153] In the fifth step, the image information VIDEO to be displayed on the display unit 130 is generated based on the coordinates of the midpoint (see Fig. 7(A)(S5)). (see Fig. 7(A)(S5)).
[0154] In the sixth step, it ends (see Fig. 7(A)(S6)).
[0155] Note that before the first step, predetermined image information VIDEO (which can also be called an initial image) is displayed on the display unit. It may include a step of displaying on 130. Thereby, when the lengths of both the first line segment and the second line segment are either longer or shorter than a predetermined length, the predetermined image information VID EO can be displayed.
[0156] Hereinafter, the individual processes to be executed by the arithmetic unit using a program will be described.
[0157] 《Method for Determining the Coordinates of the Midpoint of a Line Segment》 Hereinafter, a method for determining the length of the first line segment from the first position information L-INF(1) and the length of the second line segment from the second position information L- INF(2) will be described. Also, a method for determining the coordinates of the midpoint of the line segment will be described.
[0158] Specifically, an edge detection method for determining the length of a line segment will be described.
[0159] Note that, taking the case of using an imaging element for the proximity sensor as an example, the description will be given, but a capacitive element or the like may be applied to the proximity sensor. etc. may be applied.
[0160] Let the value acquired by the imaging pixel arranged at the coordinates (x, y) be f(x, y). In particular, it is preferable to use, for f(x, y), the value obtained by subtracting the background value from the value detected by the imaging pixel, because noise can be removed. from the value detected by the imaging pixel, because noise can be removed. It is preferable because noise can be removed.
[0161] 《Method for Extracting an Edge (Contour)》 The sum of the differences Δ(x, y) between the values detected by the imaging pixels arranged at the coordinates (x - 1, y), (x + 1, y), (x, y - 1 ) and (x, y + 1) adjacent to the coordinates (x, y) and the value detected by the imaging pixel arranged at the coordinates (x, y) is expressed by the following mathematical formula (1). is expressed by the following mathematical formula (1). is expressed.
Equation
[0162] The first region 140(1), the second region 140(2), and the third region 140(3) are Δ(x,y) is calculated for all the captured pixels, and then imaging is performed to obtain the result shown in Fig. 6( As shown in Fig. 6(A-2) and Fig. 6(B-1), the edges (contours) of the fingers or palm that are in close proximity or contact with each other ) can be extracted.
[0163] How to determine the length of a line segment The coordinates where the contour extracted in the first region 140(1) intersects with a predetermined line segment W1 are determined; Cut the specified line segment W1 at the intersection and divide it into multiple line segments. The longest line segment among the multiple line segments is This is the first line segment, and its length is L1 (see FIG. 6(B-1)).
[0164] The coordinates where the contour extracted in the second region 140(2) intersects with a predetermined line segment W2 are determined, Cut the specified line segment W2 at the intersection and divide it into multiple line segments. The longest line segment among the multiple line segments is Let it be the second line segment and its length be L2.
[0165] How to determine the midpoint L1 and L2 are compared, the longer one is selected, and the coordinates of the midpoint M are calculated. In this case, L2 is longer than L1. Therefore, the midpoint M of the second line segment is used to determine the coordinates. Determine.
[0166] <Image information generated based on midpoint coordinates> The coordinates of the midpoint M can be related to the position of the base of the thumb or the range of motion of the thumb. This allows for the generation of an image that facilitates the operation of the information processing device 100 based on the coordinates of the midpoint M. Can generate information.
[0167] For example, image information V can be generated such that the operation image is arranged on the display unit 130 within the movable range of the thumb. IDEO can be generated. Specifically, an operation image (shown as a circle) can be arranged in an arc shape centered on the vicinity of the midpoint M (see Fig. 6(A-1)). Also, among the operation images, those with a high usage frequency can be arranged in an arc shape, and those with a low usage frequency can be arranged inside or outside the arc. As a result, a human interface with excellent operability can be provided. Or, a novel information processing device with excellent operability can be provided.
[0168] 《Second Example》 The program described here is different from the above-described program in that it has the following six steps of using the area of the first figure instead of the length of the first line segment and the area of the second figure instead of the length of the second line segment (see Fig. 7(B)). Here, different processes will be described in detail, and parts where the same processes can be used will refer to the above description.
[0169] In the first step, the area of the first figure is determined from the first position information L-INF(1) supplied by the first region 140(1) (see Fig. 7(B)(T1)).
[0170] In the second step, the area of the second figure is determined from the second position information L-INF(2) supplied by the second region 140(2) (see Fig. 7(B)(T2)).
[0171] In the third step, the area of the first figure and the area of the second figure are compared with a predetermined area. If only one of them is larger, proceed to the fourth step; otherwise, proceed to the first step (see Fig. 7(B)(T3)). Note that the predetermined area is 1 cm or more and 8 cm. 2 2 Specifically, it is preferably 3 cm or more and 5 cm or less. 2 5 cm or less 2 is preferable.
[0172] In the fourth step, the coordinates of the centroid of a figure larger than a predetermined area are determined (see Fig. 7(B) )(T4).
[0173] In the fifth step, the image information VIDEO to be displayed on the display unit 130 overlapping with the third region is generated based on the coordinates of the centroid (see Fig. 7(B)(T5)).
[0174] In the sixth step, it ends. (See Fig. 7(B)(T6)).
[0175] Hereinafter, each process to be executed by the arithmetic unit using the program will be described.
[0176] 《Method for Determining the Centroid of a Figure》 Hereinafter, a method for determining the area of the first figure from the first position information L-INF(1) and the area of the second figure from the second position information L- INF(2) will be described. Also, a method for determining the centroid of the figure will be described.
[0177] Specifically, the labeling process for determining the area of the figure will be described.
[0178] Note that, although the case where an imaging element is used for the proximity sensor will be described as an example, a capacitive element or the like may be applied to the proximity sensor.
[0179] Let the value acquired by the imaging pixel arranged at the coordinates (x, y) be f(x, y). In particular, it is preferable to use, as f(x, y), the value obtained by subtracting the background value from the value detected by the imaging pixel, because noise can be removed.
[0180] 《Labeling Process》 One imaging pixel included in the first region 140(1) or the second region 140(2), and the imaging pixel adjacent to the imaging pixel both obtain a value f(x,y) that exceeds a predetermined threshold value. When this is the case, the region occupied by these imaging pixels is taken as one figure. Note that when f(x,y) can take a value up to 256 at most, it is preferable that the predetermined threshold value be 0 or more and 150 or less, particularly 0 or more and 50 or less.
[0181] Regarding all the imaging pixels in the first region 140(1) and the second region 140(2), by performing the above-described processing and imaging the result, as shown in FIG. 6(A-2) and FIG. 6(B-2), a region where imaging pixels adjacent to each other exceed a predetermined threshold value is obtained. Among the figures in the first region 140(1), the figure with the largest area is taken as the first figure. Among the figures in the second region 140(2), the figure with the largest area is taken as the second figure.
[0182] 《Determination of the centroid of the figure》 Compare the area of the first figure and the area of the second figure, select the larger one, and calculate the centroid. The coordinates C of the centroid (X,Y) can be calculated using the following mathematical formula (2).
Equation
[0183] Note that in the mathematical formula (2), x i , y i represent the respective x coordinates and y coordinates of n imaging pixels that make up one figure. In the example shown in FIG. 6(B-2), the area of the second figure is larger than the area of the first figure. In this case, the centroid C of the second figure is adopted to determine the coordinates.
[0184] 《Image information generated based on the coordinates of the centroid》 The coordinates of the center of gravity C can be associated with the position of the base of the thumb or the range of movement of the thumb, etc. Accordingly, image information that facilitates the operation of the information processing apparatus 100 can be generated based on the coordinates of the center of gravity C.
[0185] As described above, the information processing apparatus 100 described herein includes a flexible position input unit 140 that can detect an object that is close to or in contact with it and supply position information L-INF, and an arithmetic unit 111. The flexible position input unit 140 can be bent so as to form a first region 140(1), a second region 140(2) facing the first region 140(1), and a third region 140(3) overlapping the display unit 130 between the first region 140(1) and the second region 140(2). The arithmetic unit 111 compares the first position information L-INF(1) supplied by the first region 140(1) with the second position information L-INF(2) supplied by the second region 140(2) and can generate image information VIDEO to be displayed on the display unit 130.
[0186] Accordingly, for example, it can be determined whether a palm or a finger of a hand is close to or in contact with either the first region 140(1) or the second region 140(2), and image information VIDEO including an image (for example, an operation image) arranged for easy operation can be generated. As a result, a human interface with excellent operability can be provided. Or, a new information processing apparatus with excellent operability can be provided.
[0187] Note that the present embodiment can be appropriately combined with other embodiments shown in this specification.
[0188] (Embodiment 4) In this embodiment, the configuration of the information processing apparatus according to one aspect of the present invention will be described with reference to FIGS. 3, 4, 8 to 11.
[0189] FIG. 8(A) is a diagram for explaining a state in which the information processing apparatus 100B is folded and held by a user, FIG. 8(B) is a developed view of the information processing apparatus 100B in the state shown in FIG. 8(A), and shows a portion where the proximity sensor has detected a palm or a finger.
[0190] FIG. 9 is a flowchart for explaining a program to be executed by the arithmetic unit 111 of the information processing apparatus 100B according to one aspect of the present invention.
[0191] FIG. 10 is a diagram for explaining an example of an image to be displayed on the display unit 130 of the information processing apparatus 100B according to one aspect of the present invention.
[0192] FIG. 11 is a flowchart for explaining a program to be executed by the arithmetic unit 111 of the information processing apparatus 100B according to one aspect of the present invention.
[0193] <Configuration Example of Information Processing Apparatus> In the information processing apparatus 100B described here, the first region 140B(1) of the position input unit 140B supplies the first position information L-INF(1), and the second region 140B(2) supplies the second position information L-INF(2) (see FIG. 8(B)). The detection unit 150 supplies detection information SENS including folding information, and the arithmetic unit 111 generates image information VIDEO to be displayed on the display unit 130 based on the result of comparing the first position information L-INF(1) with the second position information L-INF(2) and the detection information SENS including folding information. This is different from the information processing apparatus 100B described in Embodiment 2 (see FIGS. 3, 4, and 8). Here, a different configuration will be described in detail, and for parts that can use the same configuration, the above description will be incorporated by reference .
[0194] Hereinafter, each element constituting the information processing apparatus 100B will be described.
[0195] 《Position Input Unit》 The position input unit 140B has flexibility such that it can be folded into a state where the first region 140B(1), the second region 140B(2) facing the first region 140B(1), and the third region 140B(3) overlapping the display unit 130 are formed between the first region 140B(1) and the second region 140B(2) in a deployed state or the first region 140B(1) (see FIGS. 4(A) to 4(C)). The first region 140B(1) and the second region 140B(2) detect a part of the user's palm and a part of the fingers. Specifically, the first region 140B(1) supplies the first position information L-INF(1) including the position information where a part of the index finger, middle finger, and ring finger are in contact, and the second region 140B(2) supplies the second position information L-INF(2) including the position information where the base of the thumb is in contact. Note that the third region 140B(3) supplies the position information of the position where the thumb is in contact.
[0196]
[0197] 《Display Unit》 The display unit 130 is provided at a position overlapping the third region 140B(3) (see FIGS. 8(A) and 8(B)). The display unit 130 is supplied with image information VIDEO and can display, for example, an operation image of the information processing apparatus 100B. The user selects the position information of the image by bringing the thumb close to or into contact with the third region 140B(3) overlapping the image. A report can be inputted.
[0198] 《Operation Unit》 The operation unit 111 is supplied with the first position information L-INF(1) and the second position information L-INF(2), and generates the image information VIDEO to be displayed on the display unit 130 based on the result of comparing the first position information L-INF(1) and the second position information L-INF(2).
[0199] 《Program》 The information processing apparatus described here includes a storage unit that stores a program for causing the operation unit 111 to execute the following seven steps (see FIG. 9). The program will be described below.
[0200] 《First Example》 In the first step, determine the length of the first line segment from the first position information supplied by the first region (see FIG. 9(U1)).
[0201] In the second step, determine the length of the second line segment from the second position information supplied by the second region (see FIG. 9(U2)).
[0202] In the third step, compare the length of the first line segment and the length of the second line segment with a predetermined length. If only one of them is longer, proceed to the fourth step; otherwise, proceed to the first step (see FIG. 9(U3)). Note that the predetermined length is preferably 2 cm or more and 15 cm or less, and particularly preferably 5 cm or more and 10 cm or less.
[0203] In the fourth step, determine the coordinates of the midpoint of the line segment longer than the predetermined length (see FIG. 9(U4)).
[0204] In the fifth step, acquire the folding information and determine the folded state of the folding information. Proceed to the sixth step when showing, or to the seventh step when showing the unfolded state (see Fig. 9 (U5) reference).
[0205] In the sixth step, generate the first image information to be displayed on the display unit based on the coordinates of the midpoint (see Fig. 9 (U6)).
[0206] In the seventh step, generate the second image information to be displayed on the display unit based on the coordinates of the midpoint (see Fig. 9 (U7)).
[0207] In the eighth step, end (see Fig. 9 (U8)).
[0208] Also, the information processing apparatus 100B described here may include a step of causing the arithmetic unit 111 to generate predetermined image information VIDEO and display it on the display unit 130 before executing the first step. As a result, in the third step, when either the first line segment or the second line segment is longer than a predetermined length or both are shorter than the predetermined length, the predetermined image information VIDEO can be displayed.
[0209] Next, the individual processes to be executed by the arithmetic unit using the program will be described.
[0210] The program to be executed by the arithmetic unit 111 has a point where the process branches based on the folded state in the fifth step and is different from the program described in Embodiment 3. Here, different processes will be described in detail, and parts where the same processes can be used will refer to the above description for reference.
[0211] 《Process for Generating First Image Information》 When the acquired folding information indicates a folded state, the arithmetic unit 111 generates the first image information. For example, similar to the fifth step of the program described in Embodiment 3, the first image information VIDEO to be displayed on the display unit 130 overlapping the third region 140B(3) in the
[0212] folded state is generated based on the coordinates of the midpoint. The coordinates of the midpoint M can be associated with the position of the base of the thumb or the movable range of the thumb, etc. Thereby, image
[0213] information that facilitates the operation of the information processing device 100B in the folded state can be generated based on the coordinates of the midpoint M. For example, the first image information VIDEO can be generated so that the operation image is arranged on the display unit 130 within the movable range of the thumb. Specifically, an operation image (shown as a circle) can be arranged in an arc shape centered on the vicinity of the midpoint M (see Fig. 8(A)). Also, among the operation
[0214] images, those with a high frequency of use can be arranged in an arc shape, and those with a low frequency of use can be arranged inside or outside the arc. As a result, in the information processing device 100B in the folded state, a human interface with excellent operability can be provided. Or, a novel information processing device with excellent operability can be It can be associated with a range or the like.
[0215] For example, the second image information V is used so that the operation image is not arranged in the area overlapping with the movable range of the thumb. IDEO can be generated. Specifically, the operation image (indicated by a circle) can be arranged outside the arc centered on the vicinity of the midpoint M (see FIG. 10). Further, the information processing device 100B may be driven so that the position input unit 140B detects what is close to or in contact with the area excluding the arc and its inside and supplies position information. (indicated by a circle) can be arranged (see FIG. 10). Also, the information processing device 100B may be driven so that the position input unit 140B detects what is close to or in contact with the area excluding the arc and its inside and supplies position information. processing device 100B may be driven so that the position input unit 140B detects what is close to or in contact with the area excluding the arc and its inside and supplies position information. processing device 100B may be driven so that the position input unit 140B detects what is close to or in contact with the area excluding the arc and its inside and supplies position information.
[0216] As a result, the arc of the position input unit 140B in the unfolded state and the area inside thereof can be held with one hand to support the information processing device 100B. Also, the operation image displayed outside the arc can be operated with the other hand. As a result, in the information processing device 100B in the unfolded state, a human interface with excellent operability can be provided. Or, a new information processing device with excellent operability can be provided. As a result, the arc of the position input unit 140B in the unfolded state and the area inside thereof can be held with one hand to support the information processing device 100B. Also, the operation image displayed outside the arc can be operated with the other hand. As a result, in the information processing device 100B in the unfolded state, a human interface with excellent operability can be provided. Or, a new information processing device with excellent operability can be provided. As a result, the arc of the position input unit 140B in the unfolded state and the area inside thereof can be held with one hand to support the information processing device 100B. Also, the operation image displayed outside the arc can be operated with the other hand. As a result, in the information processing device 100B in the unfolded state, a human interface with excellent operability can be provided. Or, a new information processing device with excellent operability can be provided. As a result, in the information processing device 100B in the unfolded state, a human interface with excellent operability can be provided. Or, a new information processing device with excellent operability can be provided. As a result, in the information processing device 100B in the unfolded state, a human interface with excellent operability can be provided. Or, a new information processing device with excellent operability can be provided.
[0217] <<Second Example>> The program described here is different from the above-described program in that it has the following seven steps of using the area of the first figure instead of the length of the first line segment and the area of the second figure instead of the length of the second line segment (see FIG. 11). Here, different processes will be described in detail, and the parts where the same processes can be used will refer to the above description. The program described here is different from the above-described program in that it has the following seven steps of using the area of the first figure instead of the length of the first line segment and the area of the second figure instead of the length of the second line segment (see FIG. 11). Here, different processes will be described in detail, and the parts where the same processes can be used will refer to the above description. The program described here is different from the above-described program in that it has the following seven steps of using the area of the first figure instead of the length of the first line segment and the area of the second figure instead of the length of the second line segment (see FIG. 11). Here, different processes will be described in detail, and the parts where the same processes can be used will refer to the above description. The program described here is different from the above-described program in that it has the following seven steps of using the area of the first figure instead of the length of the first line segment and the area of the second figure instead of the length of the second line segment (see FIG. 11). Here, different processes will be described in detail, and the parts where the same processes can be used will refer to the above description.
[0218] In the first step, the area of the first figure is determined from the first position information supplied by the first region 140B(1) (see FIG. 11(V1)). In the first step, the area of the first figure is determined from the first position information supplied by the first region 140B(1) (see FIG. 11(V1)).
[0219] In the second step, the area of the second figure is determined from the second position information supplied by the second region 140B(2) (see Fig. 11(V2)). (See Fig. 11(V2)).
[0220] In the third step, the area of the first figure and the area of the second figure are compared with a predetermined area and if only one of them is larger, the process proceeds to the fourth step, and otherwise it proceeds to the first step (see Fig. 11(V3)). Note that the predetermined area is preferably 1 cm 2 or more and 8 cm 2 or less, particularly preferably 3 cm 2 or more and 5 cm 2 or less.
[0221] In the fourth step, the coordinates of the centroid of the figure larger than the predetermined area are determined (see Fig. 11( V4)).
[0222] In the fifth step, folding information is acquired, and if the folding information indicates a folded state, the process proceeds to the sixth step, and if it indicates an unfolded state, the process proceeds to the seventh step (see Fig. 1 1(V5)). (See Fig. 11(V5)).
[0223] In the sixth step, the first image information to be displayed on the display unit is generated based on the coordinates of the centroid (see Fig. 11(V6)). (See Fig. 11(V6)).
[0224] In the seventh step, the second image information to be displayed on the display unit is generated based on the coordinates of the centroid (see Fig. 11(V7)). (See Fig. 11(V7)).
[0225] In the eighth step, the process ends (see Fig. 11(V8)).
[0226] As described above, the information processing apparatus 100B described here detects those that are close to or in contact with It is known that a flexible position input unit 140B capable of supplying position information L-INF, and a folding sensor 151 that can know whether the flexible position input unit 140B is in a folded state or an unfolded state, and a detection unit 150 including the folding sensor 151, and an arithmetic unit 111 are included (FIG. 3). The flexible position input unit 140B can be bent so that a first region 140B(1), a second region 140B(2) that faces the first region 140B(1) in the folded state, and a third region 14 0B(3) that overlaps the display unit 130 between the first region 14 0B(1) and the second region 140B(2) are formed. The arithmetic unit 111 compares the first position information L-INF(1) supplied by the first region 140B(1) with the second position information L-INF(2) supplied by the second region 140B(2), and can generate image information VIDEO to be displayed on the display unit 1 30 based on the folding information. As a result, for example, it is possible to determine whether any of the palm or the fingers of the hand is close to or in contact with either the first region 140B(1) or the second
[0227] region 140B(2), and generate image information VIDEO including either a first image (for example, an operation image is arranged) arranged so as to be easy to operate when the position input unit 140B is in the folded state or a second image arranged so as to be easy to operate when the position input unit 140B is in the unfolded state. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided. operation. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided. information processing apparatus with excellent operability can be provided.
[0228] Note that the present embodiment can be appropriately combined with other embodiments shown in this specification.
[0229] (Embodiment 5) In this embodiment, the configuration of the information processing apparatus according to one aspect of the present invention will be described with reference to FIGS. 12 and 13 .
[0230] FIG. 12 is a flowchart for explaining a program to be executed by the arithmetic unit 111 of the information processing apparatus 100B according to one aspect of the present invention .
[0231] FIG. 13 is a schematic diagram for explaining an image displayed by the information processing apparatus 100B according to one aspect of the present invention .
[0232] <Configuration Example of Information Processing Apparatus> The display unit 130 of the information processing apparatus 100B described here can be in an unfolded state overlapping the position input unit 140B, and a flexible state that can be folded, and a folded state with a first area 130(1) exposed and a second area 130(2) separated from the first area 130(1) by a fold, and is the information processing apparatus described in Embodiment 2 (see FIG 13(B)). 13(B)). ).
[0233] 《Display Unit》 The display unit 130 has flexibility and can be in an unfolded state or a folded state overlapping the third area 140(3) of the position input unit 140B (see FIGS. 13(A) and 13( B)). ).
[0234] The display unit 130 is regarded as a first area 130(1) and a second area 130(2) separated from the first area 130(1) by a fold, and each can be driven individually (see FIG 13( B)).
[0235] Also, the display unit 130 has a first area 130(1) and a second area 13 0(2), and the third area 130(3), and each can be driven individually (Fig. 13(C)). (Fig. 13(C)).
[0236] Also, the display unit 130 may not be divided by each fold, and the entire surface may be regarded as the first area 130(1) (not shown). (not shown).
[0237] Note that specific configuration examples applicable to the display unit 130 will be described and explained in Embodiment 6 and Embodiment 7. described and explained. 《Program》
[0238] Also, a storage unit 112 that stores a program for causing the arithmetic unit 111 to execute a process including the following steps is provided (see Fig. 3, Fig. 12(A), and Fig. 12(B)). (see Fig. 3, Fig. 12(A), and Fig. 12(B)).
[0239] In the first step, initialize (see Fig. 12(A)(W1)).
[0240] In the second step, generate initial image information VIDEO (see Fig. 12(A)(W2)). (see Fig. 12(A)(W2)).
[0241] In the third step, permit interrupt processing (see Fig. 12(A)(W3)). Note that the arithmetic unit 111 for which interrupt processing is permitted receives an execution instruction for interrupt processing, interrupts the main processing, executes the interrupt processing, and stores the execution result in the storage unit. Then, the main processing is resumed based on the execution result of the interrupt processing. Note that the arithmetic unit 111 for which interrupt processing is permitted receives an execution instruction for interrupt processing, interrupts the main processing, executes the interrupt processing, and stores the execution result in the storage unit. Then, the main processing is resumed based on the execution result of the interrupt processing. processing, interrupts the main processing, executes the interrupt processing, and stores the execution result in the storage unit. Then, the main processing is resumed based on the execution result of the interrupt processing. (see Fig. 12(A)(W3)).
[0242] In the fourth step, obtain folding information, and if the folding information indicates a folded state, proceed to the fifth step, and if it indicates an unfolded state, proceed to the sixth step (see Fig. 12(A)(W4)). (see Fig. 12(A)(W4)). (see Fig. 12(A)(W4)).
[0243] In the fifth step, at least a part of the supplied image information VIDEO is displayed in the first area (see Fig. 12(A)(W5)).
[0244] In the sixth step, a part of the supplied image information VIDEO is displayed in the first area, and another part is displayed in the second area, or in the second and third areas (see Fig. 12(A)(W6)).
[0245] In the seventh step, if an end command for the interrupt process is supplied, proceed to the eighth step, and if no end command is supplied, proceed to the third step (see Fig. 12(A)(W7) ).
[0246] End in the eighth step (see Fig. 12(A)(W8)).
[0247] Also, the interrupt process includes the following steps.
[0248] In the ninth step, if a page feed command is supplied, proceed to the tenth step, and if no page feed command is supplied, proceed to the eleventh step (see Fig. 12(B)(X9 ).
[0249] In the tenth step, generate the image information VIDEO based on the page feed command (see Fig. 12(B)(X10)).
[0250] In the eleventh step, return from the interrupt process (see Fig. 12(B)(X11)) .
[0251] 《Example of the generated image》 The arithmetic unit 110 generates the image information VIDEO to be displayed on the display unit 130. In this embodiment, the case where the arithmetic unit 110 generates one piece of image information VIDEO will be described as an example, but the The arithmetic unit 110 can also generate the image information VIDEO to be displayed in the second area 130(2) of the display unit 130 separately from the image information VIDEO to be displayed in the first area 130(1).
[0252] For example, the arithmetic unit 110 can generate an image only in the first area 130(1) that is exposed in the folded state, which is a driving method suitable for the folded state (FIG. 13(A ))). ))
[0253] On the other hand, the arithmetic unit 110 can generate one image using the entire display unit 130 including the first area 130(1), the second area 130(2), and the third area 130(3) in the unfolded state. Such an image is excellent in listability (FIGS. 13(B) and FIG. 1 3(C)). 3(C)).
[0254] For example, in the folded state, the operation image may be arranged in the first area 130(1). too.
[0255] For example, in the unfolded state, the operation image is arranged in the first area 130(1), and the application lication software display area (also referred to as a window) may be arranged in the second area 130(2) , or the entire second area 130(2) and the third area 130(3).
[0256] Also, when a page feed command is supplied, the image arranged in the second area 130(2) is sent to the first area 130(1), and a new image may be arranged in the second area 130(2). way.
[0257] Also, the first area 130(1), the second area 130(2), or the third area 130(3) When a page feed command is supplied to any of them, a new image is sent into that area, and the images in other areas may be kept maintained. Note that the page feed command is a command to select and display one piece of image information from a plurality of pieces of image information associated with page numbers in advance. For example, a command to select and display image information associated with a page number one larger than the page number of the displayed image information can be cited. Further, a gesture (such as tap, drag, swipe, or pinch-in) using a finger touching the position input unit 140B as a pointer can be associated with the page feed command. As described above, the information processing apparatus 100B described herein has flexibility to be in a deployed state and a folded state, and a display unit 130 including a first area 130(1) and a second area 130(2) separated by a fold line and exposed in the folded state. Further, a storage unit 112 that stores a program for causing the arithmetic unit 111 to execute a process including a step of displaying a part of the generated image in the first area 130(1) or another part in the second area 130(2) based on the detection information SENS including the folding information is provided. As a result, for example, a part of an image can be displayed in the display unit 130 (the first area 130(1)) exposed on the outer periphery of the information processing apparatus 100B in the folded state, and another part of the image continuous or related to the part of the image can be displayed in the second area 130(2) continuous with the first area 130(1) of the display unit 130 in the deployed state. For example, a command to select and display image information associated with a page number one larger than the page number of the displayed image information can be cited. Further, a gesture (such as tap, drag, swipe, or pinch-in) using a finger touching the position input unit 140B as a pointer can be associated with the page feed command. When a page feed command is supplied to any of them, a new image is sent into that area, and the images in other areas may be kept maintained. Note that the page feed command is a command to select and display one piece of image information from a plurality of pieces of image information associated with page numbers in advance.
[0258] As described above, the information processing apparatus 100B described herein has flexibility to be in a deployed state and a folded state, and a display unit 130 including a first area 130(1) and a second area 130(2) separated by a fold line and exposed in the folded state. Further, a storage unit 112 that stores a program for causing the arithmetic unit 111 to execute a process including a step of displaying a part of the generated image in the first area 130(1) or another part in the second area 130(2) based on the detection information SENS including the folding information is provided. and a second area 130(2) separated by a fold line from the first area 130(1). Further, a storage unit 112 that stores a program for causing the arithmetic unit 111 to execute a process including a step of displaying a part of the generated image in the first area 130(1) or another part in the second area 130(2) based on the detection information SENS including the folding information is provided. Further, a storage unit 112 that stores a program for causing the arithmetic unit 111 to execute a process including a step of displaying a part of the generated image in the first area 130(1) or another part in the second area 130(2) based on the detection information SENS including the folding information is provided. Further, a storage unit 112 that stores a program for causing the arithmetic unit 111 to execute a process including a step of displaying a part of the generated image in the first area 130(1) or another part in the second area 130(2) based on the detection information SENS including the folding information is provided. Further, a storage unit 112 that stores a program for causing the arithmetic unit 111 to execute a process including a step of displaying a part of the generated image in the first area 130(1) or another part in the second area 130(2) based on the detection information SENS including the folding information is provided.
[0259] As a result, for example, a part of an image can be displayed in the display unit 130 (the first area 130(1)) exposed on the outer periphery of the information processing apparatus 100B in the folded state, and another part of the image continuous or related to the part of the image can be displayed in the second area 130(2) continuous with the first area 130(1) of the display unit 130 in the deployed state. For example, a part of an image can be displayed in the display unit 130 (the first area 130(1)) exposed on the outer periphery of the information processing apparatus 100B in the folded state, and another part of the image continuous or related to the part of the image can be displayed in the second area 130(2) continuous with the first area 130(1) of the display unit 130 in the deployed state. and another part of the image continuous or related to the part of the image can be displayed in the second area 130(2) continuous with the first area 130(1) of the display unit 130 in the deployed state. As a result, for example, a part of an image can be displayed in the display unit 130 (the first area 130(1)) exposed on the outer periphery of the information processing apparatus 100B in the folded state, and another part of the image continuous or related to the part of the image can be displayed in the second area 130(2) continuous with the first area 130(1) of the display unit 130 in the deployed state. It is possible to provide a human interface. Or, a novel information processing apparatus with excellent operability can be provided.
[0260] Note that this embodiment can be appropriately combined with other embodiments shown in this specification 。
[0261] (Embodiment 6) In this embodiment, the configuration of a display panel applicable to the position input unit and the display device of an information processing apparatus according to an aspect of the present invention will be described with reference to FIG. 14. Note that the display panel described in this embodiment has a touch sensor (contact detection device) superimposed on the display unit, and thus can be referred to as a touch panel (input / output device).
[0262]
[0263] FIG. 14(A) is a top view for explaining the structure of the input / output device.
[0263] FIG. 14(B) is a cross-sectional view taken along cutting lines A-B and C-D in FIG. 14(A).
[0264] FIG. 14(C) is a cross-sectional view taken along cutting line E-F in FIG. 14(A).
[0265] <Explanation of the top view> The input / output device 300 has a display unit 301 (see FIG. 14(A)).
[0266] The display unit 301 includes a plurality of pixels 302 and a plurality of imaging pixels 308. The imaging pixels 308 can detect a finger or the like that touches the display unit 301.
[0267] The pixel 302 includes a plurality of sub-pixels (for example, sub-pixel 302R), and the sub-pixel includes a light-emitting element and a pixel circuit that can supply power to drive the light-emitting element.
[0268] The pixel circuit is electrically connected to a wiring capable of supplying a selection signal and a wiring capable of supplying an image signal.
[0269] Also, the input / output device 300 includes a scanning line driving circuit 303g(1) capable of supplying a selection signal to the pixel 302 and an image signal line driving circuit 303s(1) capable of supplying an image signal to the pixel 302. Note that arranging the image signal line driving circuit 303s(1) while avoiding the bent portion can reduce the occurrence of problems.
[0270] The imaging pixel 308 includes a photoelectric conversion element and an imaging pixel circuit that drives the photoelectric conversion element.
[0271] The imaging pixel circuit is electrically connected to a wiring capable of supplying a control signal and a wiring capable of supplying a power supply potential.
[0272] Examples of the control signal include a signal capable of selecting an imaging pixel circuit that reads a recorded imaging signal, a signal capable of initializing the imaging pixel circuit, and a signal capable of determining the time for the imaging pixel circuit to detect light.
[0273] The input / output device 300 includes an imaging pixel driving circuit 303g(2) capable of supplying a control signal to the imaging pixel 308 and an imaging signal line driving circuit 303s(2) capable of reading an imaging signal. Also, arranging the imaging signal line driving circuit 303s(2) while avoiding the bent portion can reduce the occurrence of problems.
[0274] <Explanation of cross-sectional view> The input / output device 300 has a substrate 310 and a counter substrate 370 facing the substrate 310 (see Fig. 14(B)).
[0275] The substrate 310 is a flexible substrate 310b that prevents unintended diffusion of impurities into the light emitting element. A barrier film 310a and an adhesive layer 310 for bonding the barrier film 310a to the substrate 310b are provided. c is a laminated body.
[0276] The opposing substrate 370 is a flexible substrate 370b, which prevents unintended diffusion of impurities into the light emitting element. A barrier film 370a for preventing the above-mentioned phenomenon and an adhesive layer 3 for bonding the barrier film 370a to the substrate 370b are provided. 70c (see FIG. 14(B)).
[0277] The sealing material 360 bonds the opposing substrate 370 and the substrate 310. It also serves as an optical bonding layer. The imaging pixel circuit and the photoelectric conversion element (for example, the photoelectric conversion element 308p) are connected to the substrate 310 and the opposing substrate. It is located between the boards 370.
[0278] 《Pixel Structure》 The pixel 302 includes a subpixel 302R, a subpixel 302G, and a subpixel 302B (FIG. 14 Also, the subpixel 302R includes a light-emitting module 380R, and the subpixel 302G includes a light-emitting module 380R. The subpixel 302A includes a light emitting module 380G, and the subpixel 302B includes a light emitting module 380B.
[0279] For example, the subpixel 302R supplies power to the first light-emitting element 350R and the second light-emitting element 350R. The pixel circuit includes a transistor 302t that can supply The light emitting module 380R includes a first light emitting element 350R and an optical element (e.g., It has a colored layer 367R).
[0280] Transistor 302t includes a semiconductor layer. Various semiconductor films such as an amorphous silicon film, a low-temperature polysilicon film, a single-crystal silicon film, and an oxide semiconductor film can be applied to the semiconductor layer of transistor 302t. Further, transistor 302t may include a back gate electrode, and the threshold voltage of transistor 302t may be controlled using the back gate electrode.
[0281] The first light-emitting element 350R has a first lower electrode 351R, an upper electrode 352, and a layer 353 containing a light-emitting organic compound between the first lower electrode 351R and the upper electrode 352 (see Fig. 14(C)).
[0282] The layer 353 containing a light-emitting organic compound includes a light-emitting unit 353a, a light-emitting unit 353b, and an intermediate layer 354 between the light-emitting unit 353a and the light-emitting unit 353b.
[0283] The first coloring layer 367R of the light-emitting module 380R is provided on the counter substrate 370. The coloring layer may be any layer that transmits light having a specific wavelength. For example, a layer that selectively transmits light presenting red, green, blue, or the like can be used. Alternatively, instead of providing a coloring layer, a region that transmits the light emitted by the light-emitting element as it is may be provided.
[0284] For example, the light-emitting module 380R has a sealing material 360 in contact with the first light-emitting element 350R and the first coloring layer 367R.
[0285] The first coloring layer 367R is located at a position overlapping the first light-emitting element 350R. As a result, a part of the light emitted by the first light-emitting element 350R passes through the sealing material 360 and the first coloring layer 367R and is emitted outside the light-emitting module 380R as shown by the arrow in the figure.
[0286] The input / output device 300 further has a light-shielding layer 367BM on the counter substrate 370. The light-shielding layer 367 BM is provided so as to surround a coloring layer (for example, the first coloring layer 367R).
[0287] The input / output device 300 includes an antireflection layer 367p at a position overlapping the display unit 301. As the antireflection layer 367p, for example, a circularly polarized plate can be used.
[0288] The input / output device 300 includes an insulating film 321. The insulating film 321 covers the transistor 302t. Note that the insulating film 321 can be used as a layer for flattening the unevenness caused by the pixel circuit. Also, an insulating film in which a layer capable of suppressing the diffusion of impurities into the transistor 302t or the like is laminated can be applied to the insulating film 321. The light-emitting element (for example, the first light-emitting element 350R) is provided on the insulating film 321.
[0289]
[0290] The input / output device 300 has a partition wall 328 overlapping the end of the first lower electrode 351R on the insulating film 321 (see FIG. 14(C)). Also, a spacer 329 for controlling the distance between the substrate 310 and the counter substrate 370 is provided on the partition wall 328.
[0291] 《Configuration of Image Signal Line Driving Circuit》 The image signal line driving circuit 303s(1) includes a transistor 303t and a capacitor 303c. Note that the image signal line driving circuit 303s(1) can be formed on the same substrate in the same process as the pixel circuit.
[0292] 《Configuration of Imaging Pixel》 The imaging pixel 308 includes a photoelectric conversion element 308p and the light irradiated to the photoelectric conversion element 308p It includes an imaging pixel circuit for detection. Also, the imaging pixel circuit includes transistor 308t. including.
[0293] For example, a pin-type photodiode can be used as the photoelectric conversion element 308p.
[0294] 《Other configurations》 The input / output device 300 includes a wiring 311 that can supply signals, and a terminal 319 is provided on the wiring 311. An FPC 309(1) that can supply signals such as an image signal and a synchronization signal is electrically connected to the terminal 319. Also, preferably, the FPC 309(1) is arranged avoiding the bent portion of the input / output device 300. Also, it is preferable to arrange the FPC 309(1) approximately at the center of one side selected from the area surrounding the display unit 301, particularly the side to be folded (the long side in the figure). Thereby, the center of gravity of the external circuit can be approximately made to coincide with the center of gravity of the input / output device 300. As a result, the handling of the information processing device becomes easy, and it is possible to prevent problems such as accidentally dropping it. Note that a printed wiring board (PWB) may be attached to the FPC 309(1). Note that, although an example in the case of using a light-emitting element as the display element has been shown, one aspect of the embodiments of the present invention
[0295] is not limited to this. .
[0296] Note that, although an example in the case of using a light-emitting element as the display element has been shown, one aspect of the embodiments of the present invention is not limited to this.
[0297] For example, an electroluminescence (EL) element (an EL element including an organic and an inorganic substance, an organic EL element, an inorganic EL element, an LED, etc.), a light-emitting transistor element (a transistor that emits light according to a current), an electron-emitting element, a liquid crystal element, an electronic ink element, an electrophoretic element, an electro Note that, although an example in the case of using a light-emitting element as the display element has been shown, one aspect of the embodiments of the present invention Low-temperature element, plasma display (PDP), MEMS (micro-electro -mechanical system) display (e.g., grating light valve (G LV), digital micromirror device (DMD), digital microshutter (DMS) element, interference modulation (IMOD) element, etc.), piezoelectric ceramic display, etc., which have a display medium whose contrast, brightness, reflectivity, transmittance, etc. change due to electromagnetic action. As an example of a display device using an EL element, there is an EL display, etc. As an example of a display device using an electron-emitting element, there is a field emission display (FED) or a surface-conduction electron-emitter display (S ED:Surface-conduction Electron-emitter D isplay), etc. As an example of a display device using a liquid crystal element, there is a liquid crystal display (transmissive liquid crystal display, transflective liquid crystal display, reflective liquid crystal display, direct view liquid crystal display, projection liquid crystal display), etc. As an example of a display device using an electronic ink element or an electrophoretic element, there is electronic paper, etc.
[0298] Note that this embodiment can be appropriately combined with other embodiments shown in this specification.
[0299] (Embodiment 7) In this embodiment, the configuration of a display panel applicable to the position input unit and the display device of an information processing apparatus according to an aspect of the present invention will be described with reference to FIGS. 15 and 16. Note that the display panel described in this embodiment has a touch sensor (contact detection device) in the display unit. Since it is provided so as to be overlaid, it can be called a touch panel (input / output device).
[0300] FIG. 15(A) is a schematic perspective view of a touch panel 500 exemplified in the present embodiment. Note that For clarity, representative components are shown in FIG. 15. FIG. 15(B) is a schematic perspective view of the touch panel 500 in an unfolded state.
[0301] FIG. 16 is a cross-sectional view of the touch panel 500 shown in FIG. 15(A) taken along X1-X2.
[0302] The touch panel 500 includes a display unit 501 and a touch sensor 595 (see FIG. 15(B) ). Further, the touch panel 500 has a substrate 510, a substrate 570, and a substrate 590. Note that, as an example, all of the substrate 510, the substrate 570, and the substrate 590 have flexibility .
[0303] As the substrate, various substrates having plasticity can be used. As an example, a semiconductor substrate (for example, a single crystal substrate or a silicon substrate), an SOI substrate, a glass substrate, a quartz substrate, a plastic stick substrate, a metal substrate, and the like are available.
[0304] The display unit 501 includes a substrate 510, a plurality of pixels on the substrate 510, and a plurality of wirings 511 capable of supplying signals to the pixels, and an image signal line driving circuit 503s(1). The plurality of wirings 511 are routed to the outer peripheral portion of the substrate 510, and a part of them constitutes a terminal 519 . The terminal 519 is electrically connected to an FPC 509(1). Note that a printed wiring board (PWB) may be attached to the FPC 509(1 ). )
[0305] <Touch Sensor> The substrate 590 is provided with a touch sensor 595 and a plurality of wiring 598 that are electrically connected to the touch sensor 595. The plurality of wirings 598 are routed along the outer peripheral portion of the substrate 590, and a part of them constitutes a terminal for electrically connecting to the FPC509(2). Note that the touch sensor 595 is provided under the substrate 590 (between the substrate 590 and the substrate 570), and in FIG. 15(B), for clarity, electrodes, wirings, etc. are shown by solid lines.
[0306] As the touch sensor used for the touch sensor 595, a capacitance-type touch sensor is preferred. As the capacitance method, there are a surface capacitance method, a projection capacitance method, etc. As the projection capacitance method, there are mainly a self-capacitance method, a mutual-capacitance method, etc. depending on the difference in the driving method. Using the mutual-capacitance method is preferable because simultaneous multi-point detection becomes possible.
[0307] Hereinafter, when applying a projection capacitance-type touch sensor, it will be described with reference to FIG. 15(B), but various other sensors can also be applied.
[0308] The touch sensor 595 has an electrode 591 and an electrode 592. The electrode 591 is electrically connected to any one of the plurality of wirings 59 8, and the electrode 592 is electrically connected to any other one of the plurality of wirings 598.
[0309] As shown in FIGS. 15(A) and (B), the electrode 592 has a shape in which a plurality of quadrilaterals are continuous in one direction. Also, the electrode 591 is a quadrilateral. The wiring 594 electrically connects two electrodes 591 arranged in a direction intersecting the direction in which the electrode 592 extends. At this time, a shape in which the area of the intersection portion of the electrode 5 92 and the wiring 594 is as small as possible is preferable. Thereby, The area of the region where no electrodes are provided can be reduced, and unevenness in transmittance can be reduced. It is possible to reduce unevenness in the brightness of the light passing through the touch sensor 595. However, the shape of the electrode 592 is not limited to this, and may take various shapes.
[0310] In addition, the electrodes 591 are arranged so that there are as few gaps as possible, and the electrodes are connected to each other via an insulating layer. Alternatively, a plurality of electrodes 592 may be provided at intervals so that there is an area that does not overlap with the electrode 591. At this time, a dummy electrode that is electrically insulated from the adjacent two electrodes 592 is provided between the adjacent two electrodes 592. It is preferable to provide a negative electrode, since the area of the region having different transmittance can be reduced.
[0311] The configuration of the touch panel 500 will be described with reference to FIG.
[0312] The touch sensor 595 includes a substrate 590, electrodes 591 arranged in a staggered pattern on the substrate 590, and The electrode 592, the electrode 591, and the insulating layer 593 covering the electrode 592, and the adjacent electrodes 591 are Electrically connecting wiring 594 is provided.
[0313] The adhesive layer 597 is formed between the substrate 590 and the substrate 501 so that the touch sensor 595 and the display unit 501 overlap each other. 70 are pasted together.
[0314] The electrode 591 and the electrode 592 are formed using a light-transmitting conductive material. Examples of conductive materials that can be used include indium oxide, indium tin oxide, indium zinc oxide, Conductive oxides such as zinc oxide and zinc oxide doped with gallium can be used.
[0315] After forming a film of a light-transmitting conductive material on a substrate 590 by a sputtering method, By various patterning techniques such as lithography, unnecessary portions are removed to form the electrode 591 and the electrode 592.
[0316] As the material used for the insulating layer 593, for example, acrylic resin, epoxy resin, siloxane In addition to resins having bonds, inorganic insulating materials such as silicon oxide, silicon oxynitride, and aluminum oxide can also be used. It is also possible to use.
[0317] An opening reaching the electrode 591 is provided in the insulating layer 593, and the wiring 594 electrically connects the adjacent electrode 5 91. The wiring 594 formed using a light-transmissive conductive material is preferable because it can increase the aperture ratio of the touch panel. Also, it is preferable to use a material having higher conductivity than the electrodes 591 and 592 for the wiring 594. For The wiring 594 is preferably used.
[0318] One electrode 592 extends in one direction, and a plurality of electrodes 592 are provided in a stripe shape.
[0319] The wiring 594 is provided so as to intersect the electrode 592.
[0320] A pair of electrodes 591 are provided with one electrode 592 interposed therebetween and are electrically connected to the wiring 594. Yes.
[0321] Note that the plurality of electrodes 591 do not necessarily need to be arranged in a direction perpendicular to one electrode 592, and may be arranged at an angle of less than 90 degrees. Yes.
[0322] One wiring 598 is electrically connected to the electrode 591 or the electrode 592. A part of the wiring 598 Functions as a terminal. As the wiring 598, for example, aluminum, gold, platinum, silver, Nickel, titanium, tungsten, chromium, molybdenum, iron, cobalt, copper, or palladium Metal materials such as uranium, and alloy materials containing the metal materials can be used.
[0323] In addition, an insulating layer covering the insulating layer 593 and the wiring 594 can be provided to protect the touch sensor 595. can be.
[0324] Further, the connection layer 599 electrically connects the wiring 598 and the FPC 509(2).
[0325] As the connection layer 599, various anisotropic conductive films (ACF: Anisotropic Conductive Film) and anisotropic conductive pastes (ACP: Anisotro pic Conductive Paste) etc. can be used.
[0326] The adhesive layer 597 has translucency. For example, thermosetting resins or ultraviolet curable resins can be used and specifically, resins such as acrylic resins, urethane resins, epoxy resins, or resins having a siloxane bond can be used.
[0327] <Display unit> The touch panel 500 includes a plurality of pixels arranged in a matrix. The pixels include display elements and pixel circuits for driving the display elements.
[0328] In this embodiment, the case of applying a white organic electroluminescence element as the display element will be described, but the display element is not limited to this. For example, as the display element, in addition to the organic electroluminescence element, display elements that perform display by an electrophoretic method, an electronic
[0329] powder fluid method, etc. (also referred to as electronic ink), a shutter type M EMS display element, an optical interference type MEMS display element, a liquid crystal element, etc., various display elements can be used can be used. It is possible to select a configuration suitable for the display element to be applied from various pixel circuits and use it.
[0330] The substrate 510 is a laminate in which a flexible substrate 510b, a barrier film 510a that prevents the diffusion of unintended impurities into the light-emitting element, and an adhesive layer 510 c that bonds the substrate 510b and the barrier film 510a are laminated.
[0331] The substrate 570 is a laminate in which a flexible substrate 570b, a barrier film 570a that prevents the diffusion of unintended impurities into the light-emitting element, and an adhesive layer 570 c that bonds the substrate 570b and the barrier film 570a are laminated.
[0332] The sealing material 560 bonds the substrate 570 and the substrate 510. Further, the sealing material 560 also serves as an optical bonding layer. The pixel circuit and the light-emitting element (for example, the first light-emitting element 550R) are located between the substrate 51 0 and the substrate 570.
[0333] 《Configuration of Pixel》 The pixel includes a sub-pixel 502R, and the sub-pixel 502R includes a light-emitting module 580R.
[0334] The sub-pixel 502R includes a pixel circuit including a first light-emitting element 550R and a transistor 502t that can supply power to the first light-emitting element 550R. Further, the light-emitting module 580R includes a first light-emitting element 550R and an optical element (for example, a coloring layer 567R).
[0335] The first light-emitting element 550R has a lower electrode, an upper electrode, and a layer containing a light-emitting organic compound between the lower electrode and the upper electrode.
[0336] The light-emitting module 580R has a first colored layer 567R on the substrate 570. The colored layer only needs to transmit light having a specific wavelength, and for example, one that selectively transmits light presenting red, green, blue, etc. can be used. Alternatively, without using a colored layer, a region that directly transmits the light emitted by the light-emitting element may be provided.
[0337] The light-emitting module 580R has a sealing material 560 in contact with the first light-emitting element 550R and the first colored layer 567R.
[0338] The first colored layer 567R is located at a position overlapping the first light-emitting element 550R. As a result, a part of the light emitted by the first light-emitting element 550R passes through the sealing material 560 and the first colored layer 567R and is emitted to the outside of the light-emitting module 580R as shown by the arrow in the figure.
[0339] 《Configuration of Image Signal Line Driving Circuit》 The image signal line driving circuit 503s(1) includes a transistor 503t and a capacitor 503c. Note that the image signal line driving circuit 503s(1) can be formed on the same substrate in the same process as the pixel circuit.
[0340] 《Other Configurations》 The display unit 501 has a light-shielding layer 567BM on the substrate 570. The light-shielding layer 567BM is provided so as to surround the colored layer (for example, the first colored layer 567R).
[0341] The display unit 501 includes an antireflection layer 567p at a position overlapping the pixel. As the antireflection layer 567p, for example, a circularly polarized plate can be used.
[0342] The display unit 501 includes an insulating film 521. The insulating film 521 covers the transistor 502t. It is used as a layer for flattening the unevenness caused by the pixel circuit. It can also suppress the diffusion of impurities into transistors 502t and the like. The insulating film with a laminated layer can be applied to the insulating film 521.
[0343] The display unit 501 has a partition wall 528 overlapping the end of the first lower electrode on the insulating film 521. It also has a spacer for controlling the distance between the substrate 510 and the substrate 570 on the partition wall 528.
[0344] Note that this embodiment can be appropriately combined with other embodiments shown in this specification.
Explanation of Reference Numerals
[0345] 13a Connection member 13b Connection member 15a Support member 15b Support member 100 Information processing apparatus 100B Information processing apparatus 101 Housing 110 Arithmetic unit 111 Arithmetic section 112 Storage section 114 Transmission path 115 Input / output interface 120 Input / output device 120B Input / output device 130(1) First area 130(2) Second area 130(3) Third area 130 Display unit 140(1) First region 140(2) Second region 140(3) Third region 140 Position input unit 140B(1) First region 140B(2) Second region 140B(3) Third region 140B Position Input Section 141 Substrate 142 Proximity Sensor 145 Input / Output Section 150 Detection Section 151 Sensor 159 Mark 160 Communication Section 300 Input / Output Device 301 Display Section 302 Pixel 302B Sub-Pixel 302G Sub-Pixel 302R Sub-Pixel 302t Transistor 303c Capacitor 303g(1) Scanning Line Driving Circuit 303g(2) Imaging Pixel Driving Circuit 303s(1) Image Signal Line Driving Circuit 303s(2) Imaging Signal Line Driving Circuit 303t Transistor 308 Imaging Pixel 308p Photoelectric Conversion Element 308t Transistor 309 FPC 310 Substrate 310a Barrier Film 310b Substrate 310c Adhesive Layer 311 Wiring 319 Terminal 321 Insulating Film 328 Partition Wall 329 Spacer 350R Light-Emitting Element 351R Lower Electrode 352 Upper Electrode 353 Layer 353a Light-Emitting Unit 353b Light-Emitting Unit 354 Intermediate Layer 360 Encapsulant 367BM Light-Shielding Layer 367p Anti-Reflection Layer 367R Coloring Layer 370 Opposing Substrate 370a Barrier film 370b Substrate 370c Adhesive layer 380B Light-emitting module 380G Light-emitting module 380R Light-emitting module 500 Touch panel 501 Display unit 502R Sub-pixel 502t Transistor 503c Capacitance 503s Image signal line drive circuit 503t Transistor 509 FPC 510 Substrate 510a Barrier film 510b Substrate 510c Adhesive layer 511 Wiring 519 Terminal 521 Insulating film 528 Partition wall 550R Light-emitting element 560 Encapsulant 567BM Light-shielding layer 567p Anti-reflection layer 567R Coloring layer 570 Substrate 570a Barrier film 570b Substrate 570c Adhesive layer 580R Light-emitting module 590 Substrate 591 Electrode 592 Electrode 593 Insulating layer 594 Wiring 595 Touch sensor 597 Adhesive layer 598 Wiring 599 Connection layer
Claims
【Claim 1】 An information processing apparatus having a housing and a touch panel, and being foldable, wherein the touch panel has a first region, a second region, a third region, a fourth region, and a fifth region, the first region, the second region, the third region, the fourth region, and the fifth region have a function of displaying an image and a function of a touch sensor, the first region is continuously connected to the second region without a seam, the second region is continuously connected to the third region without a seam, the third region is continuously connected to the fourth region without a seam, the fourth region is continuously connected to the fifth region without a seam, when the information processing apparatus is folded, the first region has a planar shape, when the information processing apparatus is folded, the second region has a curved shape, when the information processing apparatus is folded, the third region has a planar shape, when the information processing apparatus is folded, the fourth region has a curved shape, when the information processing apparatus is folded, the fifth region has a planar shape, when the information processing apparatus is folded, the first region has an overlap with the third region, when the information processing apparatus is folded, the third region has an overlap with the fifth region, when the information processing apparatus is folded, the display surfaces of the third region, the fourth region, and the fifth region are hidden, when the information processing apparatus is folded, the third region, the fourth region, and the fifth region do not display an image, an information processing apparatus capable of making the operation commands associated with the second region different from the operation commands associated with the first region when the information processing apparatus is folded.
Citation Information
Patent Citations
Electronic device with flexible display screen
JP2007128078A
Portable terminal and key display method
JP2012027581A
Display input method of mobile phone
JP2013013038A
Automatic soft key adaptation with left-right hand edge sensing
US20130076639A1
Mobile terminal device and display method for touch panel in mobile terminal device
WO2012049942A1