Display panel

A flexible input/output device with a position input unit and detection unit enhances operability in portable devices by adapting display information based on hand gestures, addressing durability challenges and improving user interaction.

JP2026136304APending Publication Date: 2026-08-25SEMICON ENERGY LAB CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2026090168
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2013-10-11
Filing Date
2026-05-28
Publication Date
2026-08-25

AI Technical Summary

Technical Problem

Existing portable information processing devices face challenges in maintaining operability and durability due to potential damage from unexpected forces, particularly when used outdoors.

Method used

A flexible input/output device with a position input unit comprising a first and second region and a third region overlapping a display unit, equipped with a detection unit to sense proximity or contact, and a calculation unit to generate image information based on position and folding information, allowing for a human interface with enhanced operability.

Benefits of technology

The solution provides a highly user-friendly interface with improved operability by detecting hand gestures and adapting display information accordingly, enhancing the durability and usability of portable devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026136304000001_ABST
    Figure 2026136304000001_ABST
Patent Text Reader

Abstract

It can provide a human interface with excellent operability. We can provide a novel information processing device. [Solution] A flexible positioning device that can detect nearby or touching objects and supply their location information. This is an information processing device that includes a force unit. The flexible position input unit is in the first region A region, a second region opposite the first region, and a display unit between the first and second regions. It can be folded so that a third overlapping region is formed.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] This invention relates to a product, a method, or a method of manufacturing; or to a process, a machine , relating to manufacture or composition of matter. In particular The present invention relates, for example, to semiconductor devices, display devices, light-emitting devices, methods for driving them, or the This invention relates to methods for manufacturing these. In particular, the present invention relates to methods for processing and displaying image information, and programs. The present invention relates to a device having a storage medium on which a program is stored. For example, a device having a display unit. Image processing, display method, and table for displaying images containing processed information on an information processing device. A program that causes an information processing device equipped with a display unit to display an image containing processed information, and This relates to an information processing device having a storage medium in which the program is stored. [Background technology]

[0002] Display devices with large screens can display a lot of information. Therefore, they offer superior overview. Therefore, it is suitable for information processing devices.

[0003] Furthermore, the social infrastructure related to information transmission is well-developed. This allows for the dissemination of diverse and abundant information. Information can be acquired, processed, or transmitted using information processing devices not only at work or home, but also while out and about. It has become that way.

[0004] Against this backdrop, portable information processing devices are being actively developed.

[0005] Portable information processing devices are often used outdoors, and unexpected forces from drops can damage the information processing. It may be applied to the device and the display device used therein. One of the display devices that is difficult to destroy. For example, a configuration is known in which the adhesion between the structure separating the light-emitting layer and the second electrode layer is enhanced. (Patent Document 1) [Prior art documents] [Patent Documents]

[0006] [Patent Document 1] Japanese Patent Publication No. 2012-190794 [Overview of the project] [Problems that the invention aims to solve]

[0007] One aspect of the present invention provides a novel human interface with excellent operability. One of the challenges is to provide a novel information processing device or display device with excellent operability. This will be one of the challenges.

[0008] Furthermore, the description of these problems does not preclude the existence of other problems. The approach does not need to solve all of these problems. This will become clear from the description in the specification, drawings, claims, etc., and the specification, drawings It is possible to extract other issues from the descriptions in the surfaces, claims, etc. [Means for solving the problem]

[0009] One aspect of the present invention is an input / output device that supplies location information and is supplied with image information, and the location information This is an information processing device having a computing device that is supplied with and provides image information.

[0010] The input / output device includes a position input unit and a display unit. The position input unit also includes a first area and A second region opposite the first region, and a third region between the first and second regions, It has flexibility so that it can be bent to form.

[0011] The display unit is arranged to overlap with the third region, and image information is supplied and the image information is displayed The arithmetic unit includes an arithmetic unit and a storage unit that stores a program to be executed by the arithmetic unit. .

[0012] The information processing apparatus according to one aspect of the present invention includes a flexible position input unit that detects an object in proximity or contact and supplies position information. As described above, the flexible position input unit can be bent so that a first region, a second region facing the first region, and a third region overlapping with the display unit are formed between the first region and the second region. As a result, it is possible to know whether, for example, a palm or a finger of a hand is in proximity or contact with either the first region or the second region. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided. The first region, a second region facing the first region, and a third region overlapping with the display unit are formed between the first region and the second region. Accordingly, for example, it is possible to know whether a palm or a finger of a hand is in proximity or contact with either the first region or the second region. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided. Thus, for example, it can be known whether a palm or a finger of a hand is in proximity or contact with either the first region or the second region. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided. It can be known whether a palm or a finger of a hand is in proximity or contact with either the first region or the second region. As a result, a human interface with excellent operability can be provided. Or, a novel information processing apparatus with excellent operability can be provided. face can be provided. Alternatively, a novel information processing apparatus with excellent operability can be provided.

[0013] Further, the information processing apparatus according to one aspect of the present invention supplies detection information including position information and folding information, an input / output device to which image information is supplied, and an arithmetic device to which position information and detection information are supplied and which supplies image information. The folding information includes information for distinguishing between the folded state and the unfolded state of the information processing apparatus. information. The folding information includes information for distinguishing between the folded state and the unfolded state of the information processing apparatus. information.

[0014] The input / output device includes a position input unit, a display unit, and a detection unit. The position input unit has flexibility so that it can be in an unfolded state, and a state in which a first region, a second region facing the first region, and a third region are formed between the first region and the second region and is folded. The input / output device includes a position input unit, a display unit, and a detection unit. The position input unit has flexibility so that it can be in an unfolded state, and a state in which a first region, a second region facing the first region, and a third region are formed between the first region and the second region and is folded. The input / output device includes a position input unit, a display unit, and a detection unit. The position input unit has flexibility so that it can be in an unfolded state, and a state in which a first region, a second region facing the first region, and a third region are formed between the first region and the second region and is folded. It has flexibility so that it can be bent to form.

[0015] The detection unit detects the folded state of the position input unit and supplies detection information including the folding information. It is equipped with a foldable sensor that can do so. Also, the display unit is positioned to overlap with the third area. It is arranged, supplied with image information, and displays the image information. The computing unit also includes a computing unit and It also includes a storage unit that stores a program to be executed by the arithmetic unit.

[0016] As described above, the information processing device in one aspect of the present invention detects objects that are nearby or in contact with it. It includes a flexible position input section that can supply position information, and a state in which the flexible position input section is folded. A detection unit including a folding sensor that can determine whether it is in a folded or unfolded state, and It is composed of the following. The flexible position input section has a first region and, in a folded state, a first A second region opposite to the first region, and a third region overlapping the display unit between the first and second regions. It can be folded so that a region and a shape are formed. This allows for, for example, the palm or To determine if any of the fingers of the hand are in close proximity to or in contact with either the first or second area. This allows for the provision of a highly user-friendly human interface. Alternatively, it is possible to provide a novel information processing device with excellent operability.

[0017] Furthermore, in one aspect of the present invention, the first region supplies first position information, and the second region supplies second position information. The position information is supplied, and the calculation unit calculates the image information to be displayed on the display unit using the first position information and the second position information. This is the information processing device described above, which generates information based on the results of comparing location information.

[0018] Furthermore, in one aspect of the present invention, the storage unit retrieves a first line from the first position information supplied by the first region. The first step is to determine the length of the minute, and the second step is to obtain second position information from the second region. The second step is to determine the length of the line segment, and the lengths of the first and second line segments are used. If only one of the lengths is longer than the given length, proceed to step 4; otherwise, In this case, the third step proceeds to the first step, and the coordinates of the midpoint of a line segment longer than a predetermined length. The fourth step is to determine the midpoint, and the fifth step is to generate image information based on the midpoint coordinates. The above information stores the sixth step which terminates the process and the program which causes the arithmetic unit to execute. It is an information processing device.

[0019] As described above, the information processing device in one aspect of the present invention detects objects that are nearby or in contact with it. It is composed of a flexible position input unit that can supply position information and a calculation unit. The flexible position input section comprises a first region, a second region opposite to the first region, and the first Fold so that a third region overlapping the display area is formed between the region and the second region. The calculation unit can process the first position information supplied by the first region and the second region By comparing it with the second position information, image information can be generated to be displayed on the display unit.

[0020] This means that, for example, either the palm or the fingers of the hand are in either the first or second area. It determines whether it is in close proximity to or in contact with something, and arranges images (for example, for operation) to make them easier to operate. It can generate image information including images. As a result, it has excellent human-operation capabilities. We can provide an interface. Or, we can provide a novel information processing device with excellent operability. .

[0021] Furthermore, in one aspect of the present invention, the first region supplies first position information, and the second region supplies second position information. The detection unit supplies location information, the detection unit supplies detection information including folding information, and the calculation unit displays The image information displayed in the section is determined by comparing the first position information and the second position information, and the folding This is the above-mentioned information processing device that generates information based on the provided information.

[0022] Furthermore, in one aspect of the present invention, the storage unit retrieves a first line from the first position information supplied by the first region. The first step is to determine the length of the minute, and the second step is to obtain second position information from the second region. The second step is to determine the length of the line segment, and the lengths of the first and second line segments are used. If only one of the lengths is longer than the given length, proceed to step 4; otherwise... In this case, proceed to the third step, which is the first step, and find the coordinates of the midpoint of a line segment longer than a predetermined length. The fourth step is to make a decision and obtain the folding information, and then the state in which the folding information is folded. If it indicates the unfolded state, proceed to step 6; if it indicates the unfolded state, proceed to step 7. The steps include the first step of generating the first image information based on the coordinates of the midpoint, and the second step of generating the first image information based on the coordinates of the midpoint. A seventh step generates image information based on the coordinates of the midpoint, and an eighth step terminates the process. The above-mentioned information processing device stores a program that causes the arithmetic unit to execute the above.

[0023] As described above, the information processing device according to one aspect of the present invention detects objects that are nearby or in contact with it. And a flexible position input section that can supply position information, and the flexible position input section that is folded A detection unit including a folding sensor that can determine whether it is in a normal state or an unfolded state, and a calculation unit It is composed of a part and a flexible position input part, and a first region and a folded part. In this state, a second region is opposite the first region, and a display unit is placed between the first region and the second region. It can be folded so that a third region overlapping with the first region is formed, and the calculation unit is the first region As a result of comparing the first location information supplied by the area with the second location information supplied by the second area, Based on the folding information, it is possible to generate image information to be displayed on the display unit.

[0024] This means that, for example, either the palm or the fingers of the hand are in either the first or second area. It determines whether it is in close proximity to or in contact with something, and adjusts the position input section so that it is easy to operate when folded. A first image (for example, an image for operation) or a position input section is placed on it and then expanded. Generate image information that includes one of the second images, which is positioned to be easy to operate in that state. This allows for the provision of a highly user-friendly human interface. Alternatively, it is possible to provide a novel information processing device with excellent operability.

[0025] Furthermore, in one aspect of the present invention, the display unit overlaps with the position input unit, in an unfolded state and a folded state. Having flexibility that allows it to be folded into a fixed state, and the first exposed in a folded state The above-mentioned information processing apparatus comprises a region and a second region separated from the first region by a fold line. That is the case.

[0026] The memory unit stores the program to be executed by the arithmetic unit. This program is the first to be initialized. The first step is to generate initial image information, and the second step is to allow interrupt processing. Step 3 involves obtaining folding information and indicating that the folding information is in a folded state. If it shows an expanded state, proceed to the 5th step, or the 4th step, proceed to the 6th step. The fifth step is to display at least a portion of the supplied image information in a first area. The sixth method displays a portion of the supplied image information in a first area and the other portion in a second area. If a termination instruction is supplied via interrupt handling, proceed to step 8 and terminate the instruction. If it is not supplied, proceed to step 7, which is step 4, and to step 8, which is step 8, which is step 8. It is equipped with a top and a bottom.

[0027] If an interrupt handler is issued, the process proceeds to the 10th step, and the page feed is executed. If no instruction is provided, the ninth step proceeds to the eleventh step, and the page turns. A tenth step involves generating image information based on the instruction, and an eleventh step involves returning from the interrupt process. It includes the following steps and features.

[0028] The information processing apparatus according to one aspect of the present invention described above can be put into an unfolded state and a folded state. The flexibility that allows for this, and the first area that is exposed when folded and the first area and the fold line It has a display unit comprising a second area separated by and a . In addition, according to the folding information, The process includes the step of displaying a portion of the resulting image in a first area and another portion in a second area. It includes a memory unit that stores a program that causes the calculation unit to execute calculations.

[0029] This allows, for example, a display unit (first) that is exposed on the outer periphery of the information processing device when folded. A portion of the image is displayed in the area, and in its expanded state, a second area is continuous with the first area of ​​the display unit. In this area, other images that are continuous with or related to the said part of the image can be displayed. As a result, it is possible to provide a human interface with excellent operability. Or, regarding operability We can provide excellent and innovative information processing equipment. [Effects of the Invention]

[0030] As described above, according to one aspect of the present invention, a human interface with excellent operability is provided. We can provide a new information processing device with excellent operability. This allows us to provide information processing devices and novel display devices. Note that the descriptions of these effects are provided separately. This does not preclude the existence of the effects. Furthermore, one aspect of the present invention does not necessarily imply the existence of these effects. It is not necessary to possess all of these. Any other effects will be described in the specification, drawings, claims, etc. Therefore, it will become clear from the description in the specification, drawings, claims, etc. It is possible to extract external effects. [Brief explanation of the drawing]

[0031] [Figure 1] A block diagram illustrating the configuration of an information processing device according to an embodiment. [Figure 2] A diagram illustrating the configuration of an information processing device and a position input unit according to an embodiment. [Figure 3] A block diagram illustrating the configuration of an information processing device according to an embodiment. [Figure 4] A diagram illustrating the unfolded, folded, and folded states of an information processing device according to an embodiment. [Figure 5] A diagram illustrating the configuration of an information processing device according to an embodiment. [Figure 6] A diagram illustrating the state in which the information processing device according to the embodiment is held by the user. [Figure 7] A flowchart illustrating the program to be executed by the arithmetic unit of the information processing device according to the embodiment. [Figure 8] A diagram illustrating the state in which the information processing device according to the embodiment is held by the user. [Figure 9] A flowchart illustrating the program to be executed by the arithmetic unit of the information processing device according to the embodiment. [Figure 10] A diagram illustrating an example of an image displayed on the display unit of an information processing device according to an embodiment. [Figure 11] A flowchart illustrating the program to be executed by the arithmetic unit of the information processing device according to the embodiment. [Figure 12] A flowchart illustrating the program to be executed by the arithmetic unit of the information processing device according to the embodiment. [Figure 13] A diagram illustrating an example of an image displayed on the display unit of an information processing device according to an embodiment. [Figure 14] A diagram illustrating the configuration of a display panel applicable to the display device according to the embodiment. [Figure 15] A diagram illustrating the configuration of a display panel applicable to the display device according to the embodiment. [Figure 16] A diagram illustrating the configuration of a display panel applicable to the display device according to the embodiment. [Figure 17] A diagram illustrating the configuration of an information processing device and a position input unit according to an embodiment. [Figure 18] A diagram illustrating the configuration of an information processing device and a position input unit according to an embodiment. [Figure 19] A diagram illustrating the configuration of an information processing device and a position input unit according to an embodiment. [Modes for carrying out the invention]

[0032] An information processing device according to one aspect of the present invention detects an object that is nearby or in contact with it and supplies location information. It is configured to include a flexible position input section. The flexible position input section is a first A region, a second region opposite the first region, and a display unit between the first and second regions. It can be folded so that a third region overlapping with it is formed.

[0033] This means that, for example, either the palm or the fingers of the hand are in either the first or second area. It is possible to determine whether it has come into close proximity to or come into contact with something. As a result, a human-operable system is available. We can provide an interface. Or, we can provide a novel information processing device with excellent operability. .

[0034] Embodiments will be described in detail with reference to the drawings. However, the present invention is not limited to the following description. Without departing from the spirit and scope of the present invention, its form and details may be modified in various ways. It will be easily understood by those skilled in the art to obtain this. Therefore, the present invention is as shown in the embodiments below. The description is not to be interpreted as being limited to the stated content. The same reference numeral is used in common across different drawings for parts that are identical or have similar functions. I will omit the explanation of that repetition.

[0035] (Embodiment 1) In this embodiment, the configuration of an information processing device according to one aspect of the present invention is shown in Figures 1 and 2, and I will explain this while referring to Figure 17.

[0036] Figure 1 is a block diagram illustrating the configuration of an information processing device 100 according to one embodiment of the present invention.

[0037] Figure 2(A) is a schematic diagram illustrating the external appearance of an information processing device 100 according to one embodiment of the present invention. (B) is a cross-sectional view illustrating the structure of the cross-section along the cutting line X1-X2 shown in Figure 2(A). Furthermore, as shown in Figure 2(A), the display unit 130 is only on the front surface of the information processing device 100. Alternatively, they may also be provided on the sides. Or, see Figure 17(A) or its cross-sectional view. As shown in 17(B), it is not necessary to provide it on the side of the information processing device 100.

[0038] Figure 2(C-1) shows a position input unit 140 applicable to an information processing device 100 according to one embodiment of the present invention. This is a schematic diagram illustrating the arrangement of the display unit 130, and Figure 2(C-2) shows the position input unit 140. This is a schematic diagram illustrating the arrangement of the proximity sensor 142.

[0039] Figure 2(D) shows the cross-section of the position input section 140 along the cutting line X3-X4 shown in Figure 2(C-2). This is a cross-sectional view illustrating the structure.

[0040] <Example of information processing device configuration> The information processing device 100 described here consists of a housing 101 and a device that supplies position information L-INF and displays An input / output device 120 is supplied with image information VIDEO, and position information L-INF is supplied to the front It includes a computing device 110 that supplies recorded image information VIDEO (see Figures 1 and 2(B)). .

[0041] The input / output device 120 includes a position input unit 140 that supplies position information L-INF and an image information V The system includes a display unit 130 to which IDEO is supplied.

[0042] The position input unit 140 includes, for example, a first region 140(1) and a first region 140(1 A second region 140(2) opposite to ) and the first region 140(1) and the second region 14 It can be folded so that a third region 140(3) is formed between 0(2) and . It is flexible (see Figure 2(B)). Here, the third region 140(3) is the first region 14 Region 0(1) is adjacent to the second region 140(2), and these first to third regions are integrated as one. It forms an input section 140.

[0043] In contrast, separate position input units 140 may be provided in each region. As shown in Figures 17(C), (D), and (E), each region has a position input unit 140(A ), position input section 140(B), position input section 140(C), position input section 140(D), position The input section 140(E) may be provided independently. Alternatively, as shown in Figure 17(F), the position Input unit 140(A), position input unit 140(B), position input unit 140(C), position input unit 1 40(D), a portion of the position input section 140(E) may be omitted. Or, see Figure 17. As shown in (G)(H), it may be provided so as to enclose the entire structure.

[0044] Furthermore, the arrangement of the second region 140(2) opposite the first region 140(1) is as follows: Not limited to arrangements directly facing 140(1), but also facing the first region 140(1) with an inclination. This also includes arrangements such as [specific arrangements].

[0045] The display unit 130 is supplied with image information VIDEO and overlaps with the third region 140(3). They are arranged as shown (see Figure 2(B)). The arithmetic unit 110 consists of an arithmetic unit 111 and an arithmetic unit 11 It includes a storage unit 112 that stores the program to be executed by unit 1 (see Figure 1).

[0046] The information processing device 100 described here is a flexible position that detects objects that are nearby or in contact with it. It is configured to include an input unit 140. The position input unit 140 is a first region 140(1 ) and a second region 140(2) opposite the first region 140(1), and the first region 140 (1) and the third region 140(3) overlapping with the display unit 130 between the second region 140(2) and the second region 140(2) ) and can be bent so that a shape is formed. This allows for, for example, the palm or hand If any of the fingers are in close proximity to either the first region 140(1) or the second region 140(2) It is possible to know whether contact has been made. As a result, a human interface with excellent operability We can provide a face. Or, we can provide a novel information processing device with excellent operability.

[0047] The individual elements that make up the information processing device 100 are described below.

[0048] Input / Output Devices The input / output device 120 includes a position input unit 140 and a display unit 130. Also, the input / output unit 145 The system may also include a detection unit 150 and a communication unit 160, etc.

[0049] Position input section The position input unit 140 supplies position information L-INF. The user of the information processing device 100 is By bringing a finger or palm close to or in contact with the position input unit 140, position information L-INF is input. Power is supplied to the power unit 140, thereby supplying various operation commands to the information processing device 100. Yes, it is possible. For example, supplying operation commands that include termination commands (commands to terminate the program). This is possible (see Figure 1).

[0050] The position input unit 140 has a first region 140(1), a second region 140(2), and a first region A third region 140(3) is provided between region 140(1) and the second region 140(2) (Figure 2) (See C-1). First region 140(1), second region 140(2), and third region Each of the 140(3) has a proximity sensor 142 arranged in a matrix (Figure 2(C- (See 2).

[0051] The position input unit 140, for example, is a flexible substrate 141 and on the flexible substrate 141 It has a proximity sensor 142 (see Figure 2(D)).

[0052] The position input unit 140 includes, for example, a second region 140(2) and a first region 140(1). It can be folded so that they face each other (see Figure 2(B)).

[0053] The third area 140(3) of the position input unit 140 overlaps with the display unit 130 (Figure 2(B) See Figure 2(C-1). Note that the third area 140(3) is on the user side from the display unit 130. If positioned, the third region 140(3) is translucent.

[0054] The second region, when folded, is such that the user can grasp it with one hand. Separate from the area (see Figure 6(A-1)). The separation distance is preferably, for example, 17 cm or less. The distance between them should be 9 cm or less, more preferably 7 cm or less. If the distance between them is short, the gripping Using the thumb, positional information can be input over a wide area of ​​the third region 140(3). ru.

[0055] This allows the user to place the base of their thumb (near the thenar eminence) in the first region 140(1) or The fingers other than the thumb approach or touch either of the second regions 140(2) and bring the other fingers close to the other. The information processing device 100 can be grasped by touching or contacting it.

[0056] The shape of the base of the thumb differs from the shape of the other fingers, therefore, the first region 140(1) This provides positional information different from that of the second region 140(2). Specifically, the base of the thumb The shape of this part is characterized by being larger than or continuous with the shape of the other fingers.

[0057] The proximity sensor 142 is a sensor that can detect objects that are nearby or in contact with it (for example, fingers or palms). It is sufficient to have such a device, for example, a capacitive sensor or an image sensor. A substrate that does this is a capacitive touch sensor, and a substrate that has an image sensor is an optical touch sensor. It is possible.

[0058] A resin can be used as the flexible substrate 141. Examples of resins include polyester. Polyolefins, polyamides, polyimides, polycarbonates, or acrylic resins, etc. It can be listed.

[0059] Furthermore, a glass substrate, quartz substrate, semiconductor substrate, etc., with a thickness sufficient to be flexible can be used. It is possible.

[0060] Furthermore, specific configuration examples applicable to the position input unit 140 are given in Embodiment 6 and Embodiment 6. This will be explained in section 7.

[0061] 《Display section》 The display unit 130 is positioned at least in a location that overlaps with the third area 140(3) of the position input unit 140. It is arranged. Also, the display unit 130 is not only in the third region 140(3) but also in the first region 14 It may also be positioned so as to overlap with 0(1) and / or the second region 140(2).

[0062] The display unit 130 can be any unit capable of displaying the supplied image information VIDEO, and is not particularly limited It is not determined.

[0063] In the first region 140(1) and / or the second region 140(2), the third region 140( 3) Different operation commands can be associated with this.

[0064] This allows the user to use the display unit to access the first area 140(1) and / or the second area The operation commands associated with 140(2) can be checked. As a result, a variety of operations It allows for the association of commands. Furthermore, it reduces the likelihood of incorrect input of operation commands.

[0065] Specific configuration examples applicable to the display unit 130 are shown in Embodiments 6 and 7. I will describe and explain it.

[0066] 《Arithmetic device》 The arithmetic unit 110 includes an arithmetic unit 111, a storage unit 112, an input / output interface 115, and It is equipped with a transmission line 114 (see Figure 1).

[0067] The computing unit 110 receives position information L-INF and image information VIDEO.

[0068] For example, the arithmetic unit 110 contains image information VIDEO including an image for operating the information processing device 100. The signal is supplied to the input / output device 120. The display unit 130 displays an operation image.

[0069] The user touches the third area 140(3) that overlaps the display unit 130 with their finger, It can supply positional information L-INF for selecting images.

[0070] 《Calculation section》 The arithmetic unit 111 executes a program stored in the storage unit 112. For example, it executes a program for manipulating images. When position information L-INF associated with the displayed position is supplied, the calculation unit 111 The program pre-associated with the image in question is executed.

[0071] 《Memory Department》 The memory unit 112 stores the program to be executed by the arithmetic unit 111.

[0072] An example of a program to be processed by the arithmetic unit 110 is described in Embodiment 3. ru.

[0073] Input / Output Interfaces and Transmission Lines The input / output interface 115 supplies information, and information is supplied.

[0074] The transmission line 114 can supply information, and the arithmetic unit 111, storage unit 112 and input / output I The interface 115 is supplied with information. Also, the arithmetic unit 111, the storage unit 112 and input The output interface 115 can supply information, and the transmission line 114 supplies information. It will be done.

[0075] Detection Unit The detection unit 150 detects the state of the information processing device 100 and its surroundings and generates detection information SENS It supplies (see Figure 1).

[0076] The detection unit 150 can detect, for example, acceleration, direction, pressure, and navigation satellite systems (NSS: Naviga). (Satellite system) Detects signals, temperature, humidity, etc. They may also supply information such as GPS (Global Positioning). The system may detect a signal and supply the information.

[0077] Communications Department The communication unit 160 receives the information COM supplied by the arithmetic unit 110 from an external device of the information processing device 100. It supplies information to devices or communication networks. It also obtains and provides information COM from external devices or communication networks. To give.

[0078] Information COM can include various commands, etc. For example, image information VIDEO can be processed by the processing unit. The 111 may include a display command to generate or delete a display.

[0079] Communication means for connecting to external devices or communication networks, such as hubs, routers, or modems. This can be applied to the communication unit 160. Note that the connection method is not limited to wired methods, but can also be wireless (for example). Radio waves or infrared rays may also be used.

[0080] 《Input / output section》 For example, a camera, microphone, read-only external storage unit, external storage unit, scanner, speaker A printer or the like can be used in the input / output unit 145 (see Figure 1).

[0081] Specifically, digital cameras and digital video cameras can be used as cameras. ru.

[0082] A hard disk or removable memory can be used as the external storage unit. CD-ROMs, DVD-ROMs, etc., can be used as read-only external storage devices.

[0083] Cabinet The enclosure 101 protects the computing unit 110 and other components from external stresses.

[0084] Metal, plastic, glass, or ceramics can be used for the housing 101.

[0085] This embodiment can be appropriately combined with other embodiments shown herein. .

[0086] (Embodiment 2) In this embodiment, the configuration of an information processing device according to one aspect of the present invention is shown with reference to Figures 3 to 5. I'll explain while doing so.

[0087] Figure 3 is a block diagram illustrating the configuration of an information processing device 100B according to one embodiment of the present invention.

[0088] Figure 4 is a schematic diagram illustrating the external appearance of the information processing device 100B. Figure 4(A) shows the unfolded state. Figure 4(B) shows the information processing device 1 in a folded state, and Figure 4(C) shows it in a folded state. This is a schematic diagram illustrating the appearance of 00B.

[0089] Figure 5 is a schematic diagram illustrating the configuration of the information processing device 100B, and Figures 5(A) to 5(D) Figure 5(E) illustrates the configuration in the unfolded state, while Figure 5(E) illustrates the configuration in the folded state.

[0090] Figures 5(A) to 5(C) show the top view, bottom view, and side view of the information processing device 100B, respectively. Furthermore, Figure 5(D) shows the information processing device 1 at the cutting line Y1-Y2 shown in Figure 5(A). This is a cross-sectional view illustrating the structure of the cross-section of 00B. Figure 5(E) shows the information processing in the folded state. This is a side view of device 100B.

[0091] <Example of information processing device configuration> The information processing device 100B described herein includes position information L-INF and folding information. An input / output device 120B that supplies detection information SENS and image information VIDEO, and Detection information SENS, which includes position information L-INF and folding information, is supplied, and image information VI It includes a computing unit 110 that supplies DEO (see Figure 3).

[0092] The input / output device 120B includes a position input unit 140B, a display unit 130, and a detection unit 150. .

[0093] The position input unit 140B is in an unfolded state, and the first region 140B(1) and the first region A second region 140B(2) opposite region 140B(1), and the first region 140B(1) Fold so that a third region 140B(3) is formed between the second region 140B(2) and the second region 140B(2). It is flexible enough to be folded (see Figures 4 and 5).

[0094] The detection unit 150 detects the folded state of the position input unit 140B and includes folding information. It is equipped with a foldable sensor 151 that can supply detection information SENS.

[0095] The display unit 130 is supplied with image information VIDEO and overlaps with the third region 140B(3) The arithmetic unit 110 is arranged in such a way that it has the arithmetic unit 111 and the program that it has the arithmetic unit 111 execute. It includes a memory unit 112 for storing grams (see Figure 5(D)).

[0096] The information processing device 100B described here is in the first region 140B(1), in a folded state. Then, the second region 140B(2) and the first region 14 are opposite the first region 140B(1) The third region 140B overlaps with the display unit 130 between 0B(1) and the second region 140B(2). (3) A flexible position input unit 140 that can detect the palm or fingers approaching or in contact with (3) B and the flexible position input unit 140B can be known to be in a folded state or an unfolded state. The system includes a detection unit 150 which includes a foldable sensor 151 (Figures 3 and 3). (See 5). This allows, for example, either the palm or the fingers of the hand to reach the first region 140B(1). Alternatively, it is possible to determine whether the object has come into proximity with or contact with any of the second regions 140B(2). As a result, it is possible to provide a human interface with excellent operability. Or, regarding operability We can provide excellent and innovative information processing equipment.

[0097] The individual elements that make up the information processing device 100B are described below.

[0098] Furthermore, the information processing device 100B is configured such that the position input unit 140B is either deployed or folded. It has the flexibility to be folded, and the detection unit 150 of the input / output device 120B is foldable. The information processing device 100 described in Embodiment 1 differs in that it is equipped with a convex sensor 151. Here, we will explain the different configurations in detail, and the parts where similar configurations can be used are shown above. The explanation given above will be used as reference.

[0099] Input / Output Devices The input / output device 120B includes a position input unit 140B, a display unit 130, and a folding sensor 151. It is equipped with a detection unit 150. It also has an input / output unit 145, an indicator 159 and a communication unit 16 It may also have 0, etc. Furthermore, the input / output device 120B is supplied with information and can supply information ( Figure 3).

[0100] Cabinet The information processing device 100B is equipped with alternating highly flexible parts E1 and less flexible parts E2. It has a housing. In other words, the housing of the information processing device 100B is flexible in a striped (striped) pattern. It has a highly flexible area E1 and a less flexible area E2 (see Figures 5(A) and 5(B)).

[0101] This allows the information processing device 100B to be folded (see Figure 4). The status information processing device 100B is highly portable. Also, the third area of ​​the position input unit 140B By folding a portion of 140B(3) outwards, only that portion is used as the display area. This can be done (see Figure 4(C)).

[0102] For example, shapes such as parallel ends, triangular shapes, trapezoidal or fan shapes, are used in highly flexible parts. It can be used for the shapes of E1 and the less flexible part E2 (see Figure 5(A)).

[0103] The information processing device 100B can be folded to a size that can be held in one hand. The user inputs positional information into the third region 140B(3) with the thumb of the supporting hand. This makes it possible to provide an information processing device that can be operated with one hand. (See Figure 8(A)).

[0104] When folded, a portion of the position input section 140B is on the inside, and the user is on the inside. Since the affected part cannot be operated (see Figure 4(C)), the drive of this part is stopped. This is possible. As a result, power consumption can be reduced.

[0105] Furthermore, the position input section 140B in its deployed state has no seams and offers a wide operating area.

[0106] The display unit 130 is positioned superimposed on the third area 140B(3) of the position input unit (Figure 5(D (See reference). The position input unit 140B is sandwiched between the connecting member 13a and the connecting member 13b. The connecting members 13a and 13b are between the support members 15a and 15b. It is held between (see Figure 5(C)).

[0107] Display unit 130, position input unit 140B, connecting member 13a, connecting member 13b, support member 15a The support members 15b are made of adhesive, screws, or other materials that can be fitted together. It is secured in various ways.

[0108] Parts with high flexibility The highly flexible section E1 can be bent and functions as a hinge.

[0109] The highly flexible portion E1 has a connecting member 13a and a connecting member 13b that overlaps with the connecting member 13a. (See Figures 5(A) to 5(C)).

[0110] Parts with low flexibility The less flexible portion E2 comprises at least one of the support member 15a or the support member 15b. For example, it has a support member 15a and a support member 15b that overlaps with the support member 15a. Oh, the configuration that has only the support member 15b reduces the weight of the less flexible part E2 or The thickness can be reduced.

[0111] 《Connecting components》 The connecting members 13a and 13b are flexible. For example, flexible plastic Apply metal, alloy, and / or rubber to connecting member 13a and connecting member 13b. Specifically, silicone rubber can be used to connect member 13a and connecting member 13b. Applicable.

[0112] Support members Either support member 15a or support member 15b is connected to connecting member 13a and connecting member It has lower flexibility than 13b. Support member 15a or support member 15b is located in the position input section 140B This increases the mechanical strength and protects the position input section 140B from damage.

[0113] For example, plastic, metal, alloy, or rubber, etc., support member 15a or support member 15b It can be used for connecting members 13a and 1 made of plastic or rubber, etc. 3b, the support member 15a or support member 15b can be made lighter in weight. Alternatively, it can be made less prone to damage.

[0114] Specifically, engineering plastics and silicone rubber can be used. Furthermore, stainless steel, aluminum, or magnesium alloy, etc., are used for the support member 15a and support part It can be used for material 15b.

[0115] Position input section The position input unit 140B can be in an unfolded or folded state (Figure See Figures 4(A) through 4(C).

[0116] The third region 140B(3) is positioned on the upper surface of the information processing device 100B in its unfolded state. (See Figure 5(D)) These are arranged on the top and side surfaces of the folded information processing device 100B. (See Figure 5(E)).

[0117] When the position input section 140B is unfolded, a larger area can be used than when it is folded.

[0118] When the position input section 140B is folded, the operation command associated with the upper surface of the third area 140B(3) is activated. Different operational commands can be associated with the side. Note that the second area 140B(2 You may associate an operation command that is different from the operation command associated with ) This allows for position input Complex operation commands can be issued using section 140B.

[0119] The position input unit 140B supplies position information L-INF (see Figure 3).

[0120] The position input unit 140B is located between the support member 15a and the support member 15b. The connecting member 13a and The connecting member 13b may clamp the position input unit 140B.

[0121] The position input unit 140B has a first region 140B(1), a second region 140B(2), and a second region Between region 140B(1) and region 2, region 140B(2), there is region 3, 140B(3) and It is equipped with (see Figure 5(D)).

[0122] The position input unit 140B has a flexible substrate and a proximity sensor on the flexible substrate. The first region 140B(1), the second region 140B(2), and the third region 140B( 3) Proximity sensors are arranged in a matrix pattern in each of these locations.

[0123] Furthermore, specific configuration examples applicable to the position input unit 140B are described in Embodiment 6 and the Implementation Form This will be described in State 7.

[0124] Detection unit and label The information processing device 100B includes a detection unit 150. The detection unit 150 is a foldable sensor 151 It is equipped with (see Figure 3).

[0125] Furthermore, the folding sensor 151 and the marker 159 are in the folded state of the position input unit 140B. To enable detection of the state, it is placed on the information processing device 100B (Figures 4(A) and 4(B) ), Figures 5(A), 5(C), and 5(E)).

[0126] With the position input unit 140B unfolded, the sign 159 is separated from the folding sensor 151. It is located in the specified position (see Figures 4(A), 5(A), and 5(C)).

[0127] With the position input unit 140B bent at the connecting member 13a, the sign 159 is folded. Approaching NSA 151 (see Figure 4(B)).

[0128] With the position input unit 140B folded by the connecting member 13a, the sign 159 is folded. Facing Sa151 (see Figure 5(E)).

[0129] The detection unit 150 detects the sign 159, and the position input unit 140B is in a folded state. Based on this determination, detection information SENS, which includes folding information, is supplied.

[0130] 《Display section》 The display unit 130 overlaps with at least a portion of the third area 140B(3) of the position input unit 140B. They are arranged in such a way. The display unit 130 is capable of displaying the supplied image information VIDEO. That would be fine.

[0131] Since the display unit 130 is flexible, it can be unfolded or folded in conjunction with the position input unit 140B. This makes it possible to create a seamless display with excellent readability in the display unit 130. It is possible.

[0132] Furthermore, specific configuration examples applicable to the flexible display unit 130 are shown in Embodiment 6 and This will be explained in Embodiment 7.

[0133] 《Arithmetic device》 The arithmetic unit 110 includes an arithmetic unit 111, a storage unit 112, an input / output interface 115, and It is equipped with a transmission line 114 (see Figure 3).

[0134] This embodiment can be appropriately combined with other embodiments shown herein. .

[0135] (Embodiment 3) In this embodiment, the configuration of an information processing device according to one aspect of the present invention is shown in Figures 1, 2, and 6. This will be explained with reference to Figures 7, 18, and 19.

[0136] Figure 6 is a diagram illustrating the state in which an information processing device 100 according to one embodiment of the present invention is held by a user. There is. Here, among the position input unit 140, the third region 140(3) is the same as the first region 140. It is located between (1) and the second region 140(2), and between the first region 140(1) and the second Regions 140(2) are opposite each other. Figure 6(A-1) shows the information processing device 100 is used This diagram illustrates the appearance when the object is being held by a person, and Figure 6(A-2) is shown in Figure 6(A-1). This is an exploded view of the position input unit 140, showing the part where the proximity sensor detects the palm or fingers. Furthermore, the position input units are designated as separate units: position input unit 140(A) and position input unit 140(B). Figure 18(A) shows the case when the position input unit 140(C) is used. In this case as well, Figure 6(A- This can be considered in the same way as in (2).

[0137] Figure 6(B-1) shows the first location information L-INF(1) detected by the first region 140(1). And the second location information L-INF(2) detected by the second region 140(2) is used for edge detection. This is a schematic diagram showing the processing results with solid lines, and Figure 6(B-2) shows the first position information L-INF (1) and the second position information L-INF(2) are labeled, and the result is shown by hatching. This is a diagram.

[0138] Figure 7 illustrates a program to be executed by the arithmetic unit 111 of an information processing device according to one embodiment of the present invention. This is a flowchart.

[0139] <Example of information processing device configuration> The information processing device 100 described here has a first region 140(1) containing first position information LI NF(1) is supplied, and the second region 140(2) supplies the second position information L-INF(2). (See Figure 6(A-2)). The calculation unit 111 overlaps with the display unit of the third region 140(3). The image information VIDEO to be displayed at 130 is determined by the first position information L-INF(1) and the second position The point that the information L-INF(2) is generated based on the results of comparison is the information described in Embodiment 1. This is different from the information processing unit. (See Figures 1, 2, and 6). Details of the different configuration are provided below. Where a detailed explanation is provided and a similar configuration can be used, refer to the explanation above.

[0140] The individual elements that make up the information processing device 100 are described below.

[0141] Position input section The position input unit 140 has a first region 140(1) and a second region facing the first region 140(1). Between region 140(2) and the first region 140(1) and the second region 140(2), It can be folded so that a third region 140(3) overlapping with the indicated portion 130 is formed. It possesses flexibility (see Figure 2(B)).

[0142] The first area 140(1) and the second area 140( 2) detects part of the user's palm and part of their fingers. Specifically, the first area 140 ( 1) is a first position information LI which includes position information of the part of the index finger, middle finger, and ring finger that are in contact. NF(1) is supplied, and the second region 140(2) is in contact with the base of the thumb (near the thenar eminence). A second location information L-INF(2) is supplied, which includes the location information of the third region 14. 0(3) provides positional information for the location where the thumb makes contact.

[0143] 《Display section》 The display unit 130 is located in a position that overlaps with the third region 140(3) (Figure 6(A-1 (See Figure 6(A-2)). The display unit 130 is supplied with image information VIDEO, and image information Display a report video. For example, an image information VI containing an image for operating the information processing device 100. The DEO can be displayed. The user places their thumb over the third area 140 that overlaps the image. 3) By approaching or touching the image, positional information for selecting the image can be input. ru.

[0144] For example, as shown in Figure 18(B), when operating with the right hand, the keyboard 131 is on the right side. It displays icons and other elements. On the other hand, when operating with the left hand, as shown in Figure 18(C) On the left side, the keyboard (131 keys) and icons are displayed. This allows you to use your fingers It becomes easier to operate.

[0145] Furthermore, the detection unit 150 detects acceleration and determines the tilt of the information processing device 100. The display screen may be changed by doing so. For example, as shown in Figure 19(A), hold with your left hand Consider the state where it is tilted to the right when viewed from the direction of arrow 152 (see Figure 19(C)). By detecting this tilt, the screen for the left hand is displayed, as shown in Figure 18(C). Similarly, as shown in Figure 19(B), hold it in your right hand and tilt it to the left when viewed from the direction of arrow 152. Let's consider the case where this state occurs (see Figure 19(D)). Here, we will detect this tilt. Therefore, as shown in Figure 18(B), a screen for the right hand is displayed. In this way, the keyboard You can also control the display position of icons and other elements.

[0146] Furthermore, users can change the operation screen between the right-hand and left-hand versions by configuring the settings themselves. It may be changed.

[0147] 《Calculation section》 The calculation unit 111 uses the first position information L-INF(1) and the second position information L-INF(2) The first location information L-INF(1) and the second location information L-INF(2) are supplied and compared. Based on the results, image information VIDEO is generated to be displayed on the display unit 130.

[0148] <Program> The information processing apparatus described here has a storage unit that stores a program for causing the arithmetic unit 111 to execute the following six steps (see Fig. 7(A)). Hereinafter, the program will be described. (See Fig. 7(A)). Hereinafter, the program will be described. .

[0149] 《First Example》 In the first step, the length of the first line segment is determined from the first position information L-INF(1) supplied by the first region 140(1) (see Fig. 7(A)(S1)). (See Fig. 7(A)(S1)).

[0150] In the second step, the length of the second line segment is determined from the second position information L-INF(2) supplied by the second region 140(2) (see Fig. 7(A)(S2)). (See Fig. 7(A)(S2)).

[0151] In the third step, the lengths of the first line segment and the second line segment are compared with a predetermined length. If only one of them is longer, proceed to the fourth step; otherwise, proceed to the first step (see Fig. 7(A)(S3)). Note that the predetermined length is preferably 2 cm or more and 15 cm or less, particularly preferably 5 cm or more and 10 cm or less. If only one of them is longer, proceed to the fourth step; otherwise, proceed to the first step (see Fig. 7(A)(S3)). Note that the predetermined length is preferably 2 cm or more and 15 cm or less, particularly preferably 5 cm or more and 10 cm or less. (see Fig. 7(A)(S3)). Note that the predetermined length is preferably 2 cm or more and 15 cm or less, particularly preferably 5 cm or more and 10 cm or less. (see Fig. 7(A)(S3)). Note that the predetermined length is preferably 2 cm or more and 15 cm or less, particularly preferably 5 cm or more and 10 cm or less.

[0152] In the fourth step, the coordinates of the midpoint of the line segment longer than the predetermined length are determined (see Fig. 7(A)(S4)). (see Fig. 7(A)(S4)).

[0153] In the fifth step, the image information VIDEO to be displayed on the display unit 130 is generated based on the coordinates of the midpoint (see Fig. 7(A)(S5)). (see Fig. 7(A)(S5)).

[0154] In the sixth step, it ends (see Fig. 7(A)(S6)).

[0155] Note that before the first step, predetermined image information VIDEO (which can also be called an initial image) is displayed on the display unit. The procedure may include a step of displaying at 130. This allows for the first line segment or the second line segment If the lengths of any of them are longer or shorter than a predetermined length, the predetermined image information VID EO can be displayed.

[0156] The following describes the individual processes that the program will execute in the arithmetic unit.

[0157] Method for determining the coordinates of the midpoint of a line segment Below, the length of the first line segment is obtained from the first position information L-INF(1), and the length of the second position information L- This section explains how to determine the length of the second line segment from INF(2). It also explains the midpoint of the line segment. This explains how to determine the coordinates.

[0158] Specifically, we will explain an edge detection method for determining the length of a line segment.

[0159] The explanation will use the case where an image sensor is used as the proximity sensor as an example, but the proximity sensor is a capacitive element. The following may also be applied.

[0160] Let f(x,y) be the value obtained by the image pixel located at coordinates (x,y). In particular, the image If we use the value obtained by subtracting the background value from the value detected by the element for f(x,y), we can remove the noise. This is preferable because it allows for this.

[0161] Method for extracting edges (contours) The coordinates adjacent to coordinate (x,y) are (x-1,y), (x+1,y), and (x,y-1 The values ​​detected by the imaging pixels located at coordinates (x,y+1) and the coordinates (x,y) The sum of the differences in values ​​detected by the placed imaging pixels, Δ(x,y), is expressed by the following formula (1): It can be done.

number

[0162] For all imaging pixels in the first region 140(1), the second region 140(2), and the third region 140(3), find Δ(x, y), and by imaging this, as shown in FIG. 6(A-2) or FIG. 6(B-1), the edges (contours) of the fingers or palms that are close to or in contact with each other can be extracted. For all imaging pixels in the first region 140(1), the second region 140(2), and the third region 140(3), find Δ(x, y), and by imaging this, as shown in FIG. 6(A-2) or FIG. 6(B-1), the edges (contours) of the fingers or palms that are close to or in contact with each other can be extracted. For all imaging pixels in the first region 140(1), the second region 140(2), and the third region 140(3), find Δ(x, y), and by imaging this, as shown in FIG. 6(A-2) or FIG. 6(B-1), the edges (contours) of the fingers or palms that are close to or in contact with each other can be extracted. For all imaging pixels in the first region 140(1), the second region 140(2), and the third region 140(3), find Δ(x, y), and by imaging this, as shown in FIG. 6(A-2) or FIG. 6(B-1), the edges (contours) of the fingers or palms that are close to or in contact with each other can be extracted.

[0163] 《Method for Determining the Length of a Line Segment》 Determine the coordinates where the contour extracted in the first region 140(1) intersects a predetermined line segment W1, and cut the predetermined line segment W1 at the intersection point to divide it into a plurality of line segments. Among the plurality of line segments, the longest line segment is used as the first line segment, and its length is denoted as L1 (see FIG. 6(B-1)). Determine the coordinates where the contour extracted in the first region 140(1) intersects a predetermined line segment W1, and cut the predetermined line segment W1 at the intersection point to divide it into a plurality of line segments. Among the plurality of line segments, the longest line segment is used as the first line segment, and its length is denoted as L1 (see FIG. 6(B-1)). Determine the coordinates where the contour extracted in the first region 140(1) intersects a predetermined line segment W1, and cut the predetermined line segment W1 at the intersection point to divide it into a plurality of line segments. Among the plurality of line segments, the longest line segment is used as the first line segment, and its length is denoted as L1 (see FIG. 6(B-1)).

[0164] Determine the coordinates where the contour extracted in the second region 140(2) intersects a predetermined line segment W2, and cut the predetermined line segment W2 at the intersection point to divide it into a plurality of line segments. Among the plurality of line segments, the longest line segment is used as the second line segment, and its length is denoted as L2. Determine the coordinates where the contour extracted in the second region 140(2) intersects a predetermined line segment W2, and cut the predetermined line segment W2 at the intersection point to divide it into a plurality of line segments. Among the plurality of line segments, the longest line segment is used as the second line segment, and its length is denoted as L2. Determine the coordinates where the contour extracted in the second region 140(2) intersects a predetermined line segment W2, and cut the predetermined line segment W2 at the intersection point to divide it into a plurality of line segments. Among the plurality of line segments, the longest line segment is used as the second line segment, and its length is denoted as L2.

[0165] 《Method for Determining the Midpoint》 Compare L1 and L2 and select the longer one, and calculate the coordinates of the midpoint M. In this embodiment, L2 is longer than L1. Thus, the midpoint M of the second line segment is adopted to determine the coordinates. Compare L1 and L2 and select the longer one, and calculate the coordinates of the midpoint M. In this embodiment, L2 is longer than L1. Thus, the midpoint M of the second line segment is adopted to determine the coordinates. Compare L1 and L2 and select the longer one, and calculate the coordinates of the midpoint M. In this embodiment, L2 is longer than L1. Thus, the midpoint M of the second line segment is adopted to determine the coordinates.

[0166] 《Image Information Generated Based on the Coordinates of the Midpoint》 The coordinates of the midpoint M can be associated with the position of the base of the thumb or the movable range of the thumb, etc. Thus, image information for facilitating the operation of the information processing apparatus 100 can be generated based on the coordinates of the midpoint M. The coordinates of the midpoint M can be associated with the position of the base of the thumb or the movable range of the thumb, etc. Thus, image information for facilitating the operation of the information processing apparatus 100 can be generated based on the coordinates of the midpoint M. The coordinates of the midpoint M can be associated with the position of the base of the thumb or the movable range of the thumb, etc. Thus, image information for facilitating the operation of the information processing apparatus 100 can be generated based on the coordinates of the midpoint M.

[0167] For example, the image information V is such that the operating image is positioned on the display unit 130 within the range of motion of the thumb. IDEO can be generated. Specifically, a manipulation image (circle) is generated in an arc shape centered near the midpoint M. (See Figure 6(A-1)) can be placed. Also, among the operation images, those that are used frequently Arrange the items in an arc shape, and place the items used less frequently inside or outside the arc. This is also acceptable. As a result, a user-friendly human interface can be provided. This enables the provision of a novel information processing device with excellent operability.

[0168] Example 2 The program described here replaces the length of the first line segment with the area of ​​the first figure, and the second line The following six steps are involved in using the area of ​​the second figure instead of the length of minutes, as mentioned above. This program is different (see Figure 7(B)). Here, we will explain the different processes in detail. Where similar processing can be used, refer to the explanation above.

[0169] In the first step, the first location information L-INF supplied by the first region 140(1) (1) Determine the area of ​​the first figure (see Figure 7(B)(T1)).

[0170] In the second step, the second location information L-INF supplied by the second region 140(2) (2) Determine the area of ​​the second figure (see Figure 7(B)(T2)).

[0171] In the third step, compare the area of ​​the first figure and the area of ​​the second figure with a predetermined area. If only one of them is larger, proceed to step 4; otherwise, proceed to step 1. Proceed to the next step (see Figure 7(B)(T3)). Note that the specified area is 1 cm². 2 More than 8c m2 The following, especially 3cm 2 More than 5cm 2 The following is preferable.

[0172] In the fourth step, determine the coordinates of the centroid of a figure larger than a predetermined area (Figure 7(B) )(see T4)).

[0173] In the fifth step, the image information VIDE is displayed on the display unit 130 that overlaps with the third area. O is generated based on the coordinates of the centroid (see Figure 7(B)(T5)).

[0174] The process ends in the sixth step (see Figure 7(B)(T6)).

[0175] The following describes the individual processes that the program will execute in the arithmetic unit.

[0176] Method for determining the centroid of a geometric figure Below, the area of ​​the first figure is calculated from the first position information L-INF(1), and the area of ​​the second position information L- This section explains how to determine the area of ​​the second figure using INF(2). It also explains the centroid of the figure. This explains how to determine this.

[0177] Specifically, we will explain the labeling process used to determine the area of ​​a shape.

[0178] The explanation will use the case where an image sensor is used as the proximity sensor as an example, but what if a capacitive element is used as the proximity sensor? You may apply this.

[0179] Let f(x,y) be the value obtained by the image pixel located at coordinates (x,y). In particular, the image If we use the value obtained by subtracting the background value from the value detected by the element for f(x,y), we can remove the noise. This is preferable because it allows for this.

[0180] Labeling process One imaging pixel included in the first region 140(1) or the second region 140(2), and When both the image pixel and the adjacent image pixel obtain a value f(x,y) that exceeds a predetermined threshold, In this case, the area occupied by these image pixels is considered to be a single shape. Note that f(x,y) is an example If the value can take up to 256, the predetermined threshold is set to be between 0 and 150, especially between 0 and 50. This would be preferable.

[0181] With respect to all imaging pixels in the first region 140(1) and the second region 140(2) By performing the described process and imaging the results, we can obtain Figures 6(A-2) and 6(B-2) As shown in (), a region is obtained in which adjacent imaging pixels exceed a predetermined threshold. First region 1 The figure with the largest area among the figures in 40(1) is designated as the first figure. The second region 140( Let the figure with the largest area among the figures in (2) be the second figure.

[0182] Determining the centroid of a geometric figure Compare the area of ​​the first figure with the area of ​​the second figure, select the larger area, and calculate the centroid. C coordinates of the center of gravity (X,Y) This can be calculated using the following formula (2).

number

[0183] Note that in formula (2), x i , y i This refers to the x-coordinates and y-coordinates of each of the n image pixels that make up one figure. This represents coordinates. In the example shown in Figure 6(B-2), the area of ​​the second figure is greater than the area of ​​the first figure. It's large. In this case, we use the centroid C of the second figure to determine the coordinates.

[0184] Image information generated based on the coordinates of the center of gravity. The coordinates of the center of gravity C can be related to the position of the base of the thumb or the range of motion of the thumb, etc. This allows for easier operation of the information processing device 100 based on the coordinates of the centroid C. It can generate information.

[0185] As described above, the information processing device 100 described here detects objects that are nearby or in contact with it. The system includes a flexible position input unit 140 that can supply position information L-INF, and a calculation unit 111. It is composed of the following: The flexible position input section 140 is composed of the first region 140(1) and , a second region 140(2) opposite the first region 140(1) and the first region 140(1 ) and a third region 140(3) that overlaps with the display unit 130 between the second region 140(2) and It can be folded so that a first region 140(1) is formed, and the calculation unit 111 is configured The first location information L-INF(1) supplied by and the second region 140(2) supplied by The position information L-INF(2) is compared to generate image information VIDEO to be displayed on the display unit 130. It is possible.

[0186] This means that, for example, either the palm or the fingers of the hand are in the first area 140(1) or the second area Determine if it is adjacent to or in contact with any of the areas 140(2), and position it for easier operation. It is possible to generate an image information VIDEO that includes the selected image (e.g., an image for operation). As a result, a highly user-friendly human interface can be provided. We can provide a novel information processing device.

[0187] This embodiment can be appropriately combined with other embodiments shown herein. .

[0188] (Embodiment 4) In this embodiment, the configuration of an information processing device according to one aspect of the present invention is shown in Figures 3, 4, and 8. I will explain this while referring to Figure 11.

[0189] Figure 8(A) illustrates the state in which the information processing device 100B is folded and held by the user. Figure 8(B) is an exploded view of the information processing device 100B in the state shown in Figure 8(A), and This indicates the area of ​​the palm or fingers that the contact sensor detected.

[0190] Figure 9 shows a program to be executed by the arithmetic unit 111 of the information processing device 100B according to one embodiment of the present invention. This is a flowchart to explain the process.

[0191] Figure 10 shows an example of an image displayed on the display unit 130 of the information processing device 100B according to one embodiment of the present invention. A diagram for explanation.

[0192] Figure 11 shows a program to be executed by the arithmetic unit 111 of the information processing device 100B according to one embodiment of the present invention. This is a flowchart explaining the process.

[0193] <Example of information processing device configuration> The information processing device 100B described here has a first region 140B(1 ) supplies the first position information L-INF(1), and the second region 140B(2) is the second position Information L-INF(2) is supplied (see Figure 8(B)), and the detection unit 150 includes folded information The detection information SENS is supplied, and the calculation unit 111 displays the image information VIDEO on the display unit 130. This is the result of comparing the first location information L-INF(1) and the second location information L-INF(2). The fact that it is generated based on detection information SENS including folding information is explained in Embodiment 2. This differs from the information processing device 100B (see Figures 3, 4, and 8). Here, a different configuration is used. This will be explained in detail, and where a similar configuration can be used, refer to the explanation above. .

[0194] The individual elements that make up the information processing device 100B are described below.

[0195] Position input section The position input unit 140B is in an unfolded state or in the first region 140B(1), first region 1 40B(1) and the second region 140B(2) opposite it, and the first region 140B(1) and the Between the two regions 140B(2), there is a third region 140B(3) that overlaps with the display unit 130. It is flexible enough to be folded into a state as shown in Figures 4(A) to 4(A) (See 4(C)).

[0196] The first area 140B(1) and the second area 140B(2) are part of the user's palm and fingers. It detects a portion of the fingers. Specifically, the first region 140B(1) is the index finger, middle finger, and ring finger. A first location information L-INF(1) is supplied, which includes location information of a part of the second region 1. 40B(2) is a second position information L-INF(2) which includes position information of the base of the thumb making contact. ) is supplied. The third region 140B(3) supplies positional information of the position where the thumb makes contact. ru.

[0197] 《Display section》 The display unit 130 is located in a position that overlaps with the third region 140B(3) (Figure 8(A)). (See also Figure 8(B)). The display unit 130 is supplied with image information VIDEO, and for example, information processing The operating image for the control device 100B can be displayed. The user places their thumb over the image. By approaching or touching the third region 140B(3), the positional information for selecting the image is obtained. You can enter information.

[0198] 《Calculation section》 The calculation unit 111 uses the first position information L-INF(1) and the second position information L-INF(2) The first location information L-INF(1) and the second location information L-INF(2) are supplied and compared. Based on the results, image information VIDEO is generated to be displayed on the display unit 130.

[0199] <Program> The information processing device described here is programmed to have the arithmetic unit 111 execute the following seven steps. It includes a memory unit for storing gram data (see Figure 9). The program will be described below.

[0200] Example 1 In the first step, the length of the first line segment is obtained from the first position information supplied by the first region. Make a decision (see Figure 9 (U1)).

[0201] In the second step, the length of the second line segment is obtained from the second position information supplied by the second region. Make a decision (see Figure 9 (U2)).

[0202] In the third step, the lengths of the first and second line segments are compared with a predetermined length. If only one of them is longer, proceed to step 4; otherwise, proceed to step 1. Proceed to the next step (see Figure 9 (U3)). Note that the specified length should be between 2 cm and 15 cm. It is particularly preferable that the length be between 5 cm and 10 cm.

[0203] In the fourth step, determine the coordinates of the midpoint of a line segment longer than a predetermined length (Figure 9 (U4 )reference).

[0204] In the fifth step, the folding information is obtained, and the state in which the folding information is folded is... If you want to show it, proceed to step 6; if you want to show the unfolded state, proceed to step 7 (Figure 9). (See (U5)).

[0205] In the sixth step, the first image information to be displayed on the display unit is generated based on the coordinates of the midpoint. This is achieved (see Figure 9 (U6)).

[0206] In the seventh step, the second image information to be displayed on the display unit is generated based on the coordinates of the midpoint. This is achieved (see Figure 9 (U7)).

[0207] In the eighth step, the process ends (see Figure 9(U8)).

[0208] Furthermore, the information processing device 100B described here has a calculation unit 111 that receives predetermined image information VIDE The step of generating O and displaying it on the display unit 130 is performed before executing the first step. You may prepare this. This will allow you to, in the third step, the first line segment or the second line segment If either of them is longer than the specified length, or if either of them is shorter than the specified length, then the specified Image information (VIDEO) can be displayed.

[0209] The following describes the individual processes that the program will execute in the arithmetic unit.

[0210] The program to be executed by the arithmetic unit 111 is based on the folded state in the fifth step. The point where the processing branches is different from the program described in Embodiment 3. The process will be explained in detail, and where similar processes can be used, the above explanation will be used to support it. To use.

[0211] 《Process for generating the first image information》 If the acquired folding information indicates a folded state, the calculation unit 111 processes the first image information Generate. For example, similar to the fifth step of the program described in Embodiment 3, fold The first image information displayed on the display unit 130 overlaps with the folded third region 140B(3). The report video is generated based on the coordinates of the midpoint.

[0212] The coordinates of the midpoint M can be related to the position of the base of the thumb or the range of motion of the thumb, etc. This allows the folded information processing device 100B to be displayed based on the coordinates of the midpoint M. It can generate image information that facilitates operation.

[0213] For example, the first image is positioned on the display unit 130 within the range of motion of the thumb. Information VIDEO can be generated. Specifically, an operation image is generated in an arc shape centered near the midpoint M. (Indicated by a circle) can be placed (see Figure 8(A)). Also, among the operation images, the frequency of use is The more expensive items are arranged in an arc, and the less frequently used items are placed inside or outside the arc. This may be done. As a result, the folded information processing device 100B offers superior operability. It can provide a human interface. Or, it can provide a novel information processing system with excellent operability. We can provide the equipment.

[0214] 《Process for generating second image information》 If the acquired folding information indicates an unfolded state, the calculation unit 111 generates the second image information. To accomplish. For example, similar to the fifth step of the program described in Embodiment 3, the third The first image information VIDEO to be displayed in the display unit 130 that overlaps with region 140B(3) is set to the midpoint It is generated based on the coordinates of the midpoint M. The coordinates of the midpoint M are the position of the base of the thumb or the movement of the thumb. It can be associated with ranges, etc.

[0215] For example, the second image information V is used to avoid placing the operating image in an area that overlaps with the range of motion of the thumb. IDEO can be generated. Specifically, the manipulation image is located outside the arc centered near the midpoint M. (Shown as a circle) can be placed (see Figure 10). Also, the position input unit 140B is an arc and Information processing to detect objects approaching or touching areas other than the inside and to supply location information. The processing device 100B may be driven.

[0216] This allows the arc of the deployed position input unit 140B and the area inside it to be used on the other hand. The information processing device 100B can be supported by gripping it with the hand. Also, outside the arc The control image displayed can be manipulated using the other hand. As a result, the unfolded In the information processing device 100B in this state, a human interface with excellent operability is provided. We can provide this. Or, we can provide a novel information processing device with excellent operability.

[0217] Example 2 The program described here replaces the length of the first line segment with the area of ​​the first figure, and the second line The following seven steps are involved in using the area of ​​the second figure instead of the length of minutes, as mentioned above. This is different from the previous program (see Figure 11). Here, we will explain the different processes in detail. Where applicable, refer to the above explanation.

[0218] In the first step, from the first position information supplied by the first region 140B(1) Determine the area of ​​the figure (see Figure 11(V1)).

[0219] In the second step, the area of the second figure is determined from the second position information supplied by the second region 140B(2) (see Fig. 11(V2)). (See Fig. 11(V2)).

[0220] In the third step, the area of the first figure and the area of the second figure are compared with a predetermined area and if only one of them is larger, the process proceeds to the fourth step; otherwise, it proceeds to the first step (see Fig. 11(V3)). Note that the predetermined area is preferably 1 cm 2 or more and 8 cm 2 or less, particularly preferably 3 cm 2 or more and 5 cm 2 or less.

[0221] In the fourth step, the coordinates of the centroid of the figure larger than the predetermined area are determined (see Fig. 11( V4)).

[0222] In the fifth step, folding information is acquired, and if the folding information indicates a folded state, the process proceeds to the sixth step; if it indicates an unfolded state, the process proceeds to the seventh step (see Fig. 1 1(V5)). (See Fig. 11(V5)).

[0223] In the sixth step, the first image information to be displayed on the display unit is generated based on the coordinates of the centroid (see Fig. 11(V6)). (See Fig. 11(V6)).

[0224] In the seventh step, the second image information to be displayed on the display unit is generated based on the coordinates of the centroid (see Fig. 11(V7)). (See Fig. 11(V7)).

[0225] In the eighth step, the process ends (see Fig. 11(V8)).

[0226] As described above, the information processing apparatus 100B described here detects those that are close to or in contact with A flexible position input unit 140B that can know and supply position information L-INF, and a flexible position The input unit 140B can be used to determine whether it is folded or unfolded. The system is composed of a detection unit 150 including a sensor 151 and a calculation unit 111 (Figure 3). The flexible position input section 140B is a first region 140B(1) and a folded state In this state, the second region 140B(2) is opposite the first region 140B(1), and the first region 14 A third region 14 overlaps with the display unit 130 between 0B(1) and the second region 140B(2). 0B(3) and can be folded so that they are formed, and the calculation unit 111 is the first region 140B(1) provides the first location information L-INF(1) and the second region 140B(2). The second location information L-INF(2) supplied by is compared, and the display unit 1 is determined based on the folding information. It can generate a VIDEO image to display in 30.

[0227] This means that, for example, either the palm or the fingers of the hand are in the first region 140B(1) or the second region The position input unit 140B determines whether it has come into proximity to or contact with any of the regions 140B(2). The first image (for example, the operation image) is positioned to be easy to operate when folded. (Placed) or positioned so as to be easy to operate when the position input unit 140B is deployed. Image information VIDEO can be generated that includes one of the second images. As a result, It can provide a highly functional human interface. Or, it can provide a novel interface with excellent operability. We can provide information processing equipment.

[0228] This embodiment can be appropriately combined with other embodiments shown herein. .

[0229] (Embodiment 5) In this embodiment, the configuration of an information processing device according to one aspect of the present invention is shown in Figures 12 and 13. I will explain while referring to this.

[0230] Figure 12 shows a program to be executed by the arithmetic unit 111 of the information processing device 100B according to one embodiment of the present invention. This is a flowchart explaining the process.

[0231] Figure 13 is a schematic diagram illustrating an image displayed by an information processing device 100B according to one embodiment of the present invention. .

[0232] <Example of information processing device configuration> The display unit 130 of the information processing device 100B described here is superimposed on the position input unit 140B. Flexibility that allows it to be in an open state and a folded state, and in a folded state The first area 130(1) is exposed and the first area 130(1) is separated by a fold. The information processing device described in Embodiment 2 comprises a second area 130(2) (Figure 13(B)).

[0233] 《Display section》 The display unit 130 is flexible and can be extended by overlapping it with the third region 140(3) of the position input unit 140B. It can be in an open or folded state (Figure 13(A) and Figure 13( See B).

[0234] The display unit 130 is divided into a first area 130(1) and the first area 130(1) by a fold line. It is considered a second area 130(2), and each can be driven individually (Figure 13( See B).

[0235] Furthermore, the display unit 130 is divided into a first area 130(1) and a second area 13 0(2) and the third area 130(3) are considered to be separate and can be driven individually. To cut (Figure 13(C)).

[0236] Alternatively, the display section 130 may not be divided into sections at each fold, and the entire surface may be treated as the first area 130(1). (Not shown).

[0237] Specific configuration examples applicable to the display unit 130 are shown in Embodiments 6 and 7. I will describe and explain it. "program"

[0238] Furthermore, a program is stored that causes the arithmetic unit 111 to execute a process comprising the following steps. It includes a memory unit 112 (see Figures 3, 12(A), and 12(B)).

[0239] In the first step, initialization is performed (see Figure 12(A)(W1)).

[0240] In the second step, the initial image information VIDEO is generated (Figure 12(A)(W2)). reference).

[0241] In the third step, interrupt handling is enabled (see Figure 12(A)(W3)). The arithmetic unit 111, which has been authorized to perform interrupt processing, receives an interrupt processing execution instruction and performs the main... The process is interrupted, an interrupt handler is executed, and the result is stored in the memory. After that, the interrupt The main process will resume based on the results of the previous process.

[0242] In the fourth step, the folding information is obtained, and the state in which the folding information is folded is... If you want to show it, proceed to step 5; if you want to show the expanded state, proceed to step 6. See Figure 12(A)(W4).

[0243] In the fifth step, at least a portion of the supplied image information VIDEO is placed in the first region Display it here (see Figure 12(A)(W5)).

[0244] In the sixth step, a portion of the supplied image information VIDEO is placed in the first region, and the other portion is placed in the first region. The section is displayed in the second area, or in the second and third areas (see Figure 12(A)(W6)).

[0245] If an interrupt termination command is issued in step 7, the process proceeds to step 8. If no termination command is issued, proceed to the third step (Figure 12(A)(W7)). reference).

[0246] The process ends in step 8 (see Figure 12(A)(W8)).

[0247] Furthermore, the interrupt handling process comprises the following steps.

[0248] In step 9, if a page-forward command is issued, proceed to step 10. If no page-forward command is issued, proceed to step 11 (Figure 12(B)(X9) )reference).

[0249] In the tenth step, generate the image information VIDEO based on the page-turning command. (See Figure 12(B)(X10)).

[0250] In the 11th step, the system returns from the interrupt handler (see Figure 12(B)(X11)). .

[0251] Examples of images to be generated The arithmetic unit 110 generates image information VIDEO to be displayed on the display unit 130. In this example, we will explain the case where the computing device 110 generates a single image information VIDEO. The calculation device 110 displays the image information VIDEO in the second area 130(2) of the display unit 130. The image information VIDEO displayed in the first area 130(1) can also be generated separately.

[0252] For example, the computing unit 110 is drawn only in the first area 130(1) that is exposed when folded. An image can be generated, and this is a suitable driving method for the folded state (Figure 13(A ))

[0253] In response, the computing unit 110, in its unfolded state, has a first area 130(1) and a second area Using the entire display unit 130, including 130(2) and the third area 130(3), one image Images can be generated. Such images offer excellent overview (Figures 13(B) and 1). 3(C)).

[0254] For example, even if the operation image is placed in the first area 130(1) when it is folded good.

[0255] For example, in the expanded state, the operation image is placed in the first area 130(1), and the app The display area (also called a window) of the application software is the second area 130(2) Alternatively, they may be placed throughout the entirety of the second area 130(2) and the third area 130(3).

[0256] Furthermore, when a page-turning command is issued, the image that was located in the second area 130(2) is moved to the second area 130(2). The image is sent to area 130(1), and the new image is placed in area 230(2). You may do so.

[0257] Also, the first area 130(1), the second area 130(2), or the third area 130(3) When a page-turning command is issued to any of these areas, a new image is sent to that area, and the other areas... The image may be maintained within the region. Note that page turning commands are pre-programmed. A command to select and display one image from multiple image pieces associated with a page number. Yes, there is. For example, it relates to a page number one greater than the page number of the displayed image information. Examples of commands that select and display attached image information include the position input unit 1. Gestures using the finger touching 40B as a pointer (tap, drag, swipe) You can associate actions such as pinch-in with page-turning commands.

[0258] As described above, the information processing device 100B described here is in an unfolded state and a folded state. Flexibility that allows it to be folded, and a first area 13 that is exposed when folded. 0(1) and the second area 130(2) separated by a fold in the first area 130(1) It includes a display unit 130 equipped with, and a part of the generated image is in the first region 130(1) To, or to place in the second area 130(2), detection information SENS including folded information A program is described that causes the calculation unit 111 to execute a process that includes a step of displaying based on [the specified value]. It is equipped with a memory unit 112.

[0259] This allows, for example, a display unit to be exposed on the outer periphery of the information processing device 100B when it is folded. A portion of an image is displayed in 130 (the first area 130(1)), and the display unit is shown in its expanded state. In the second area 130(2) which is continuous with the first area 130(1) of 130, a portion of the image is It is possible to display a sequence of images or other related images. As a result, it offers excellent usability. It can provide a human interface. Or, it can be a novel information processing device with excellent operability. We can provide this.

[0260] This embodiment can be appropriately combined with other embodiments shown herein. .

[0261] (Embodiment 6) In this embodiment, the position input unit and display device of an information processing apparatus according to one aspect of the present invention are applied. The configuration of the display panel that can perform this function will be explained with reference to Figure 14. The display panel described in the installation form is equipped with a touch sensor (contact detection device) superimposed on the display unit. Therefore, it can be called a touch panel (input / output device).

[0262] Figure 14(A) is a top view illustrating the structure of the input / output device.

[0263] Figure 14(B) is a cross-sectional view of Figure 14(A) along cutting lines AB and CD.

[0264] Figure 14(C) is a cross-sectional view of Figure 14(A) at the cutting line EF.

[0265] <Explanation of the top view> The input / output device 300 has a display unit 301 (see Figure 14(A)).

[0266] The display unit 301 includes a plurality of pixels 302 and a plurality of imaging pixels 308. The imaging pixels 308 are It can detect fingers or other objects touching the display unit 301.

[0267] Pixel 302 comprises multiple sub-pixels (e.g., sub-pixel 302R), and the sub-pixels are light-emitting elements and It is equipped with a pixel circuit that can supply power to drive the light-emitting elements.

[0268] The pixel circuit can supply selection signals and image signals. The wiring is connected electrically.

[0269] Furthermore, the input / output device 300 is a scan line drive circuit that can supply a selection signal to the pixel 302. 303g(1) and an image signal line drive circuit 3 that can supply an image signal to pixel 302. It is equipped with 03s(1). Note that the image signal line drive circuit 303s avoids the part that can be bent. By placing (1), the occurrence of malfunctions can be reduced.

[0270] The imaging pixel 308 includes a photoelectric conversion element and an imaging pixel circuit that drives the photoelectric conversion element.

[0271] The imaging pixel circuit has wiring that can supply control signals and power supply potential. It is electrically connected to the available wiring.

[0272] As a control signal, for example, it is possible to select the imaging pixel circuit that reads out the recorded imaging signal. A signal that can be used, a signal that can initialize the imaging pixel circuit, and a signal that the imaging pixel circuit can detect light Examples include signals that can determine the timing of notification.

[0273] The input / output device 300 is an imaging pixel driving circuit that can supply control signals to the imaging pixel 308. It includes 303g(2) and an imaging signal line driving circuit 303s(2) that reads out the imaging signal. Oh, if the imaging signal line drive circuit 303s(2) is positioned to avoid the part that can be bent, it will be in a faulty position. This can reduce the occurrence of contamination.

[0274] <Explanation of the cross-section> The input / output device 300 has a substrate 310 and a counter substrate 370 facing the substrate 310. See Figure 14(B).

[0275] The substrate 310 is a flexible substrate 310b, which prevents unintended diffusion of impurities into the light-emitting element. Adhesive layer 310 for bonding the barrier film 310a and substrate 310b to the barrier film 310a. c is a laminated structure made up of stacked layers.

[0276] The opposing substrate 370 is a flexible substrate 370b, and the diffusion of unintended impurities into the light-emitting element is prevented. A barrier film 370a to prevent this and an adhesive layer 3 to bond the substrate 370b and the barrier film 370a. It is a 70c laminate (see Figure 14(B)).

[0277] The sealing material 360 bonds the opposing substrate 370 and the substrate 310 together. Also, the sealing material 360 It also serves as an optical junction layer. Pixel circuit and light-emitting element (e.g., first light-emitting element 350R) and The imaging pixel circuit and photoelectric conversion element (for example, photoelectric conversion element 308p) are located on the substrate 310 and the opposing substrate It is located between boards 370.

[0278] Pixel composition Pixel 302 has sub-pixels 302R, 302G, and 302B (Figure 14). (See (C)). In addition, sub-pixel 302R is equipped with light-emitting module 380R, and sub-pixel 302G The main pixel is equipped with a light-emitting module 380G, and the sub-pixel 302B is equipped with a light-emitting module 380B.

[0279] For example, the sub-pixel 302R powers the first light-emitting element 350R and the first light-emitting element 350R. The pixel circuit includes a transistor 302t that can supply power (see Figure 14(B)). (illumination). Also, the light-emitting module 380R is the first light-emitting element 350R and an optical element (for example). It is equipped with a colored layer (367R).

[0280] Transistor 302t includes semiconductor layers: amorphous silicon film, low-temperature polysilicon film. Various semiconductor films such as single-crystal silicon films and oxide semiconductor films are used in the semiconductor of the 302t transistor. It can be applied to the body layer. Also, the transistor 302t may have a back gate electrode. Alternatively, the threshold voltage of transistor 302t may be controlled using a buck gate electrode.

[0281] The first light-emitting element 350R consists of a first lower electrode 351R, an upper electrode 352, and a first lower electrode A layer 353 containing a luminescent organic compound is located between 351R and the upper electrode 352 (Figure 14). See C).

[0282] The layer 353 containing a luminescent organic compound includes luminescent unit 353a, luminescent unit 353b, An intermediate layer 354 is provided between the light-emitting unit 353a and the light-emitting unit 353b.

[0283] The first colored layer 367R of the light-emitting module 380R is provided on the opposing substrate 370. It is sufficient if it transmits light of a specific wavelength, for example, red, green, or blue. A material that selectively transmits the light it emits can be used. Alternatively, a colored layer can be omitted to allow light emission. A region that allows the light emitted by the element to pass through directly may be provided.

[0284] For example, the light-emitting module 380R has a first light-emitting element 350R and a first colored layer 367R. It has a sealing material 360 in contact with it.

[0285] The first colored layer 367R is located in a position that overlaps with the first light-emitting element 350R. A portion of the light emitted by the light-emitting element 350R passes through the sealing material 360 and the first colored layer 367R. After passing through the process, the light is emitted to the outside of the light-emitting module 380R, as shown by the arrow in the diagram.

[0286] The input / output device 300 further has a light-shielding layer 367BM on the opposing substrate 370. BM is provided so as to surround the colored layer (for example, the first colored layer 367R).

[0287] The input / output device 300 is equipped with an anti-reflective layer 367p in a position that overlaps with the display unit 301. For example, a circular polarizer can be used as the blocking layer 367p.

[0288] The input / output device 300 includes an insulating film 321. The insulating film 321 covers the transistor 302t. Furthermore, the insulating film 321 is used as a layer to flatten the irregularities caused by the pixel circuit. It is possible to do so. In addition, it is possible to suppress the diffusion of impurities into transistors such as transistor 302t. An insulating film in which layers are stacked can be applied to the insulating film 321.

[0289] The light-emitting element (for example, the first light-emitting element 350R) is provided on the insulating film 321.

[0290] The input / output device 300 has a partition wall 328 that overlaps the end of the first lower electrode 351R, and an insulating film 321 It is located above (see Figure 14(C)). It also controls the distance between substrate 310 and opposing substrate 370. A spacer 329 is provided on the partition wall 328.

[0291] 《Configuration of the image signal line driving circuit》 The image signal line driving circuit 303s(1) includes a transistor 303t and a capacitor 303c. The image signal line driving circuit 303s(1) is formed on the same substrate using the same process as the pixel circuit. It is possible.

[0292] 《Configuration of imaging pixels》 The imaging pixel 308 receives light from the photoelectric conversion element 308p and the light irradiated onto the photoelectric conversion element 308p. It is equipped with an imaging pixel circuit for detection. The imaging pixel circuit also uses a transistor 308t. include.

[0293] For example, a pin-type photodiode can be used as the photoelectric conversion element 308p.

[0294] Other configurations The input / output device 300 includes wiring 311 that can supply signals, and terminal 319 is connected to the wiring. It is located at 311. Furthermore, it can supply signals such as image signals and synchronization signals. The FPC309(1) is electrically connected to terminal 319. Preferably, the input and output The FPC 309(1) is positioned to avoid the bendable portion of the force device 300. Approximately the midpoint of one side selected from the region surrounding part 301, especially the side that is folded (the longer side in the diagram). It is preferable to place the FPC309(1) in the center. This allows the center of gravity of the external circuit to be the input / output device. It can be made to roughly coincide with the center of gravity of the 300. As a result, the handling of the information processing device is This makes it easier to use and prevents problems such as accidentally dropping the item.

[0295] Note that a printed circuit board (PWB) may be attached to FPC309(1). .

[0296] Although an example using a light-emitting element as the display element has been shown, this is just one embodiment of the present invention. The term "sama" is not limited to this.

[0297] For example, electroluminescent (EL) elements (EL elements including organic and inorganic materials, (Mechanical EL elements, inorganic EL elements, LEDs, etc.), light-emitting transistor elements (light-emitting depending on the current) Transistors, electron emission elements, liquid crystal elements, electron ink elements, electrophoretic elements, electro Lowwetting elements, plasma displays (PDPs), MEMS (microelectronics) (Tro-Mechanical System) Display (e.g., Grating Light Bulb (G LV), Digital Micromirror Device (DMD), Digital Microshutter (DMS) elements, Interference Modulation (IMOD) elements, etc.), pressure Electroceramic displays, etc., use electromagnetic effects to control contrast, brightness, reflectivity, etc. Some display media have varying transmittance and other properties. An example of a display device using an EL element is... Examples include EL displays. An example of a display device using an electron-emitting element is: Field emission display (FED) or SED type flat display (S ED:Surface-conduction Electron-emitter D Examples include (isplay). An example of a display device using liquid crystal elements is a liquid crystal display. (Transmissive liquid crystal display, semi-transmissive liquid crystal display, reflective liquid crystal display, direct Examples include viewing-type liquid crystal displays and projection-type liquid crystal displays. These use electronic ink elements or electrical components. An example of a display device that uses electrophoretic elements is electronic paper.

[0298] This embodiment can be appropriately combined with other embodiments shown herein. .

[0299] (Embodiment 7) In this embodiment, the position input unit and display device of an information processing apparatus according to one aspect of the present invention are applied. The configuration of the display panel that can be used will be explained with reference to Figures 15 and 16. In this embodiment, the display panel described is a touch sensor (contact detection device) in the display unit. Because it is built on top of other components, it can be called a touch panel (input / output device).

[0300] Figure 15(A) is a schematic perspective view of the touch panel 500 illustrated in this embodiment. For clarity, representative components are shown in Figure 15. Figure 15(B) shows the touch panel 500. This is a schematic diagram of the unfolded, oblique view.

[0301] Figure 16 is a cross-sectional view of the touch panel 500 shown in Figure 15(A) at X1-X2.

[0302] The touch panel 500 includes a display unit 501 and a touch sensor 595 (see Figure 15(B)). The touch panel 500 also has substrates 510, 570, and 590. For example, substrates 510, 570, and 590 all have flexibility. ru.

[0303] Various substrates with plasticity can be used as substrates. One example is semiconductor Substrates (e.g., single crystal substrates or silicon substrates), SOI substrates, glass substrates, quartz substrates, plastic These include plastic substrates and metal substrates.

[0304] The display unit 501 consists of a substrate 510, a plurality of pixels on the substrate 510, and a unit that supplies signals to the pixels. It includes multiple wirings 511 that can do this, and an image signal line driving circuit 503s(1). The wiring 511 is routed to the outer periphery of the circuit board 510, and a portion of it constitutes terminal 519. Terminal 519 is electrically connected to FPC509(1). A printed circuit board (PWB) may be attached to it.

[0305] <Touch sensor> The circuit board 590 includes a touch sensor 595 and multiple devices that are electrically connected to the touch sensor 595. It is equipped with wiring 598. Multiple wirings 598 are routed around the outer periphery of the circuit board 590, and a portion of them It has terminals for electrical connection to FPC509(2). 595 is located below substrate 590 (between substrate 590 and substrate 570), and in Figure 15(B) For clarity, electrodes and wiring are shown with solid lines.

[0306] A capacitive touch sensor is preferred for use in the touch sensor 595. Capacitive capacitance methods include surface capacitance and projected capacitance, and projected capacitance is one of them. Capacitive capacitance types are mainly categorized into self-capacitance types and mutual-capacitance types, based on differences in their driving methods. Therefore, using a mutual capacitance method is preferable because it enables simultaneous multi-point detection.

[0307] In the following section, we will discuss the case where a projected capacitive touch sensor is applied, as shown in Figure 15(B). I will use this as an example, but various other sensors can also be applied.

[0308] The touch sensor 595 has electrodes 591 and 592. Electrode 591 has multiple wires 59 Electrode 592 is electrically connected to one of the 8 wires, and electrode 592 is electrically connected to one of the other wires 598. Connect to it.

[0309] As shown in Figures 15(A) and (B), electrode 592 has a shape in which multiple quadrilaterals are continuous in one direction. It has a certain shape. Also, electrode 591 is quadrilateral. Wiring 594 extends along the side where electrode 592 extends. Two electrodes 591, which are aligned in a direction intersecting the direction, are electrically connected. At this time, electrode 5 A shape that minimizes the area of ​​the intersection between 92 and wiring 594 is preferable. This reduces the area where electrodes are not provided, thereby reducing unevenness in transmittance. As a result, This can reduce the brightness unevenness of the light transmitted through the touch sensor 595. However, the shape of electrode 592 is not limited to this and can take on various shapes.

[0310] Furthermore, multiple electrodes 591 are arranged so that there are as few gaps as possible, and the electrodes are separated by an insulating layer. Even if multiple electrodes 592 are provided spaced apart so that there is a region that does not overlap with electrode 591, Good. At this time, between the two adjacent electrodes 592, a dummy is electrically insulated from them. - Providing electrodes is preferable because it reduces the area of ​​regions with different transmittances.

[0311] The configuration of the touch panel 500 will be explained using Figure 16.

[0312] The touch sensor 595 includes a substrate 590, electrodes 591 arranged in a staggered pattern on the substrate 590, and Electrode 592, electrode 591 and the insulating layer 593 covering electrode 592 and adjacent electrode 591 It is equipped with electrical wiring 594.

[0313] The adhesive layer 597 is applied to substrate 590 and substrate 5 so that the touch sensor 595 and the display unit 501 overlap. It's made by pasting together 70s.

[0314] Electrodes 591 and 592 are formed using a light-transmitting conductive material. Examples of conductive materials include indium oxide, indium tin oxide, indium zinc oxide, Conductive oxides such as zinc oxide and zinc oxide with added gallium can be used.

[0315] After depositing a light-transmitting conductive material onto a substrate 590 by sputtering, a photo By using various patterning techniques such as lithography, unnecessary parts are removed, and electrode 591 And electrode 592 can be formed.

[0316] Materials used for the insulating layer 593 include, for example, acrylic resin, epoxy resin, and siloxane. In addition to resins with bonding properties, inorganic materials such as silicon oxide, silicon oxide nitride, and aluminum oxide are also used. Insulating materials can also be used.

[0317] Furthermore, an opening reaching electrode 591 is provided in the insulating layer 593, and the wiring 594 is adjacent to electrode 5 91 is electrically connected. Wiring 594, formed using a translucent conductive material, touch This is preferable because it allows for an increase in the aperture ratio of the panel. Also, electrodes 591 and 592 It is preferable to use a highly conductive material for the wiring 594.

[0318] One electrode 592 extends in one direction, and multiple electrodes 592 are arranged in a stripe pattern.

[0319] Wiring 594 is provided so as to intersect with electrode 592.

[0320] A pair of electrodes 591 are provided flanking one electrode 592, and are electrically connected to a wiring 594. Yes, they are.

[0321] Furthermore, the multiple electrodes 591 do not necessarily need to be arranged in a direction perpendicular to one electrode 592. Alternatively, they may be arranged to form an angle of less than 90 degrees.

[0322] One wire 598 is electrically connected to electrode 591 or electrode 592. It functions as a terminal. Wiring 598 can be, for example, aluminum, gold, platinum, silver, Nickel, titanium, tungsten, chromium, molybdenum, iron, cobalt, copper, or paraben Metallic materials such as um, or alloy materials containing such metallic materials, can be used.

[0323] Furthermore, an insulating layer is provided to cover the insulating layer 593 and the wiring 594 to protect the touch sensor 595. It is possible.

[0324] Furthermore, the connection layer 599 electrically connects the wiring 598 and the FPC 509(2).

[0325] The connecting layer 599 can be any anisotropic conductive film (ACF: Anisotropic Conductive film, or anisotropic conductive paste (ACP: Anisotropic Conductive Film) You can use pic (Practical Conductive Paste), etc.

[0326] The adhesive layer 597 is translucent. For example, a thermosetting resin or an ultraviolet curing resin can be used. Specifically, this can be done using acrylic resin, urethane resin, epoxy resin, or siloxane bonds. Resins such as resins having a specific property can be used.

[0327] <Display section> The touch panel 500 has multiple pixels arranged in a matrix. Pixels are display elements. It also includes a pixel circuit that drives the display elements.

[0328] In this embodiment, when a white organic electroluminescent element is applied as a display element... I will explain this further, but the display elements are not limited to these.

[0329] For example, as display elements, in addition to organic electroluminescent elements, electrophoretic methods and electronics are also used. Display elements that display information using a powder-fluid system (also called electronic ink), shutter-type M Using various display elements such as EMS display elements, optical interference type MEMS display elements, and liquid crystal elements. This is possible. Furthermore, a suitable configuration for the display element to be applied can be selected from various pixel circuits. It can be used.

[0330] The substrate 510 is a flexible substrate 510b, which prevents unintended impurities from diffusing into the light-emitting element. Adhesive layer 510 for bonding the barrier film 510a and substrate 510b to the barrier film 510a. c is a laminated structure made up of stacked layers.

[0331] The substrate 570 is a flexible substrate 570b, which prevents unintended diffusion of impurities into the light-emitting element. Adhesive layer 570 for bonding the barrier film 570a and substrate 570b to the barrier film 570a. It is a stack of c.

[0332] The encapsulant 560 bonds the substrate 570 and the substrate 510 together. Furthermore, the encapsulant 560 is optical. It also serves as a junction layer. The pixel circuit and light-emitting element (e.g., the first light-emitting element 550R) are on the substrate 51 It is located between 0 and board 570.

[0333] Pixel composition Each pixel includes a sub-pixel 502R, which in turn includes a light-emitting module 580R.

[0334] The sub-pixel 502R supplies power to the first light-emitting element 550R and the first light-emitting element 550R. It includes a pixel circuit containing a transistor 502t that can perform the following: Also, a light-emitting module 580R comprises a first light-emitting element 550R and an optical element (e.g., a colored layer 567R).

[0335] The first light-emitting element 550R has a lower electrode, an upper electrode, and a light-emitting element between the lower electrode and the upper electrode. It has a layer containing a compound.

[0336] The light-emitting module 580R has a first colored layer 567R on the substrate 570. The colored layer is specific Any material that transmits light having a certain wavelength is acceptable, for example, one that exhibits red, green, or blue light. A material that selectively transmits light can be used. Alternatively, without using a colored layer, the light-emitting element A region that allows the emitted light to pass through directly may be provided.

[0337] The light-emitting module 580R is in contact with the first light-emitting element 550R and the first colored layer 567R. It has a stopper 560.

[0338] The first colored layer 567R is located in a position that overlaps with the first light-emitting element 550R. A portion of the light emitted by the light-emitting element 550R penetrates the encapsulating material 560 and the first colored layer 567R. After passing through the process, the light is emitted to the outside of the light-emitting module 580R, as shown by the arrow in the diagram.

[0339] 《Configuration of the image signal line driving circuit》 The image signal line driving circuit 503s(1) includes a transistor 503t and a capacitor 503c. The image signal line driving circuit 503s(1) is formed on the same substrate using the same process as the pixel circuit. It is possible.

[0340] Other configurations The display unit 501 has a light-shielding layer 567BM on the substrate 570. The light-shielding layer 567BM is a colored layer It is provided so as to surround the first colored layer (for example, the first colored layer 567R).

[0341] The display unit 501 is provided with an anti-reflective layer 567p in a position that overlaps with the pixels. For example, a circular polarizer can be used.

[0342] The display unit 501 includes an insulating film 521. The insulating film 521 covers the transistor 502t. It is used. Furthermore, the insulating film 521 is used as a layer to flatten the irregularities caused by the pixel circuit. This can be done. Furthermore, it can suppress the diffusion of impurities into transistors such as transistor 502t. A layered insulating film can be applied to the insulating film 521.

[0343] The display unit 501 has a partition wall 528 on the insulating film 521 that overlaps the end of the first lower electrode. Furthermore, a spacer is provided on the partition wall 528 to control the distance between substrate 510 and substrate 570.

[0344] This embodiment can be appropriately combined with other embodiments shown herein. . [Explanation of symbols]

[0345] 13a Connecting member 13b Connecting member 15a Support member 15b Support member 100 Information Processing Devices 100B Information Processing Device 101 cabinets 110 Arithmetic equipment 111 Arithmetic section 112 Storage section 114 Transmission line 115 Input / Output Interfaces 120 Input / Output Devices 120B I / O device 130(1) First area 130(2) Second area 130(3) Third area 130 Display section 140(1) First area 140(2) Second Domain 140(3) Third Domain 140 Position input section 140B(1) First area 140B(2) Second area 140B(3) Third area 140B Position Input Section 141 circuit boards 142 Proximity Sensor 145 Input / output section 150 detection unit 151 Sensors 159 signs 160 Communications Department 300 Input / Output Devices 301 Display section 302 pixels 302B subpixels 302G sub-pixels 302R sub-pixel 302t transistor 303c capacity 303g(1) Scan line drive circuit 303g(2) Image Pixel Driving Circuit 303s(1) Image signal line driving circuit 303s(2) Imaging signal line drive circuit 303t transistor 308 image pixels 308p Photoelectric element 308t transistor 309 FPC 310 circuit board 310a Barrier film 310b board 310c adhesive layer 311 Wiring 319 terminals 321 Insulating film 328 Bulkhead 329 Spacer 350R light-emitting element 351R lower electrode 352 Upper electrode 353 layers 353a Light-emitting unit 353b Light-emitting unit 354 Middle Class 360 sealing material 367BM light shielding layer 367p anti-reflection layer 367R colored layer 370 Opposing substrate 370a Barrier film 370b board 370c adhesive layer 380B Light-Emitting Module 380G Light-Emitting Module 380R Light-Emitting Module 500 Touch Panels 501 Display section 502R sub-pixel 502t transistor 503c capacity 503s Image signal line drive circuit 503t transistor 509 FPC 510 circuit board 510a Barrier film 510b circuit board 510c adhesive layer 511 Wiring 519 terminals 521 Insulating film 528 Bulkhead 550R luminescent element 560 Sealing material 567BM light shielding layer 567p anti-reflection layer 567R colored layer 570 circuit boards 570a Barrier film 570b circuit board 570c ​​adhesive layer 580R Light-Emitting Module 590 circuit boards 591 Electrode 592 Electrode 593 Insulating layer 594 Wiring 595 Touch Sensor 597 Adhesive layer 598 Wiring 599 Connectivity Layer

Claims

[Claim 1] A display panel used in a foldable information processing device, The display panel has a first area, a second area, a third area, a fourth area, and a fifth area. The first region, the second region, the third region, the fourth region, and the fifth region each have the function of displaying an image and the function of a touch sensor. The first region is seamlessly continuous with the second region. The second region is seamlessly continuous with the third region. The third region is seamlessly continuous with the fourth region. The fourth region is seamlessly continuous with the fifth region. When the information processing device is folded, the first region overlaps with the third region. When the information processing device is folded, the second region has a curved shape. When the information processing device is folded, the third region overlaps with the fifth region. When the information processing device is folded, the fourth region has a curved shape. When the information processing device is folded, the display surface of the third region, the display surface of the fourth region, and the display surface of the fifth region are hidden. A display panel that, when the information processing device is folded, can make the operation commands associated with the second area different from the operation commands associated with the first area.

Citation Information

Patent Citations

  • Light-emitting device, and electronic appliance using light-emitting device

    JP2012190794A