Electronic device, storage medium, program and display method

Abstract

Notification procedure comprising the following steps: Determining a three-dimensional shape of a display in a deformed state, the display having flexibility; and Displaying an object (301; 302; 303; 306; 306a; 306b; 307) on the display, wherein the object is displayed such that it moves according to the three-dimensional shape of the display in the deformed state as if the object displayed on the display were attracted by gravity, and wherein a shape of the object is changed according to the three-dimensional shape of the display in the deformed state as if the object displayed on the display was attracted by gravity.

Description

Technical area

[0001] The present invention relates to an electronic device whose display screen has flexibility, a storage medium storing a program for performing a display in the electronic device, a program for performing a display in the electronic device, and a method for performing a display in the electronic device. State of the art

[0002] In recent years, portable information terminals such as mobile phones or smartphones, portable music players, portable game machines, and other high-performance portable electronic entertainment devices incorporating display devices have become so widespread that people's lifestyles are changing today.

[0003] The development of such wearable electronic devices is being further promoted; in addition to multifunctionality, developments in external features such as size and weight reduction are also being actively pursued. Furthermore, sheet-shaped flexible electronic devices are being actively researched and developed as next-generation wearable electronic devices.

[0004] The e-book reader in Patent Document 1 includes a flexible housing and a position sensor and a diffraction sensor that detect a curved part of the e-book reader. Content displayed on a display section is switched based on the detection results of the position sensor and the diffraction sensor, allowing a user to control the display without a mouse or buttons thanks to the flexibility of the housing. [Reference] [Patent document]

[0005] [Patent Document 1] Japanese Patent Laid-Open No. 2010-157060

[0006] US 2011 / 0 227 822 A1 discloses a flexible device. US 2009 / 0 219 247 A1 discloses a flexible information display device. US 8 922 531 B2 discloses a device for controlling an image output position of a flexible display. Disclosure of the invention

[0007] Meanwhile, in such a flexible portable electronic device, although operation is possible due to the flexibility, the displayed still or moving images are flat, and the flexibility of the display screen and the electronic device incorporating the display screen is not sufficiently utilized. Thus, product design fails to achieve a synergistic effect between the flexibility of the display screen and the multifunctionality of the electronic device, making the electronic device incorporating a flexible display section less attractive to users.

[0008] In view of the above, an object of an embodiment of the present invention is to provide an electronic device that displays an object (a body) on a flexible display screen according to a three-dimensional shape of the display screen by utilizing the flexibility of the display screen.

[0009] Another object of an embodiment of the present invention is to provide a program for displaying an object on a flexible display screen according to a three-dimensional shape of the display screen by utilizing the flexibility of the display screen.

[0010] Therefore, one embodiment of a structure of the invention disclosed in this specification is an electronic device including: a display section including a flexible display device that displays an object on a display screen; a detection section that detects position data of a specific part of the display screen; and an arithmetic section that calculates a three-dimensional shape of the display screen based on the position data and calculates a movement of the object so that the object is displayed to move according to a specific law corresponding to the calculated three-dimensional shape of the display screen.

[0011] Another embodiment of a structure of the invention disclosed in this specification is a computer-readable storage medium storing a program by which an electronic device including a flexible display device that displays an object on a display screen performs: a first step of detecting position data of a specific part of the display screen; a second step of calculating a three-dimensional shape of the display screen based on the position data; a third step of calculating the movement of the object so that the object is displayed to move according to a specific law corresponding to the calculated three-dimensional shape of the display screen; and a fourth step of displaying the calculated movement of the object on the display screen.

[0012] Another embodiment of a structure of the invention disclosed in this specification is a program by which an electronic device including a flexible display device that displays an object on a display screen performs: a first step of detecting position data of a specific part of the display screen; a second step of calculating a three-dimensional shape of the display screen based on the position data; a third step of calculating the movement of the object so that the object is displayed to move according to a specific law corresponding to the calculated three-dimensional shape of the display screen; and a fourth step of displaying the calculated movement of the object on the display screen.

[0013] Yet another embodiment of a structure of the invention disclosed in this specification is a display method using an electronic device including a flexible display device that displays an object on a display screen, comprising: a step of detecting position data of a specific part of the display screen; a step of calculating a three-dimensional shape of the display screen based on the position data; a step of calculating the movement of the object so that the object is displayed to move according to a specific law corresponding to the calculated three-dimensional shape of the display screen; and a step of displaying the calculated movement of the object on the display screen.

[0014] An electronic device according to an embodiment of the present invention includes in its category a portable electronic device such as a mobile phone, a PHS, a smartphone, a personal computer, a personal digital assistant (PDA), a tablet PC, a laptop PC, a minicomputer, an e-book reader (electronic paper), an electronic dictionary, an electronic notebook, a calculator, a navigation system, a digital photo frame, an image reproducing device, an IC recorder, or a portable game device.

[0015] In a flexible display screen and an electronic device incorporating the flexible display screen, a detection section in which a plurality of sensors are arranged in a matrix is ​​provided, for example, directly below a display device incorporating the flexible display screen. Position data detected by the sensors and the like are combined, and a curved shape of a display section is calculated. An object is displayed to move according to a certain law corresponding to the curved shape of the display screen (a three-dimensional shape of the display screen).

[0016] It should be noted that a "three-dimensional shape of the display screen" refers to a physical shape of the display screen that is deformed (e.g., curved or bent) by applying an external force to the electronic device or display device, which can be defined by three-dimensional spatial coordinates. Therefore, the three-dimensional shape in its category also includes a two-dimensional shape before or after deformation (i.e., a flat shape without curvature).

[0017] "An object is displayed to move according to a certain law corresponding to a three-dimensional shape of the display screen" means that, for example, in the case where the display screen is curved downward, the object (body) displayed on the display screen is displayed to move according to the imaginary force applied to the object, where the force is, for example, a force in the natural world, such as gravity. The object can be a solid (e.g., a cube, a falling leaf, or a glass ball) or a liquid (e.g., water). Furthermore, all things in nature, including gas and powder, can be defined as an object. Consequently, a user can feel a sense of reality as if the object were present on the surface of the electronic device.

[0018] Furthermore, the object can be a living being. For example, in electronic games or the like, the object can be a character in the form of a person, an animal, a plant, or an imaginary being.

[0019] A "particular law" refers to a law that can be represented by a particular equation. For example, it refers to a physical law of the natural world, specifically a law that defines the motion of a body. More concrete examples are laws that can be represented by equations of motion, which visually represent the mechanics of gravity, attractive force, frictional force, air resistance, motion of a rigid or fluid body, and the like. However, a "particular law" is not limited to physical laws of the natural world. For example, to enhance a visual effect, the particular law can be a law emphasized by deviating from a physical law of the natural world, or it can be a law that violates the natural law, where, for example, an object levitates despite gravity.Furthermore, such an equation does not necessarily represent an exact physical law of the natural world and may be a pseudo-equation or a simplified equation.

[0020] The detection section includes sensors provided at a plurality of specific positions to calculate a three-dimensional shape of the display screen of the electronic device. For example, it is possible to provide a plurality of position sensors as sensors in a matrix near the display screen so that the position sensors detect relative positional coordinates. It is also possible to provide a plurality of acceleration sensors in a matrix near the display screen so that the acceleration sensors detect relative changes in the acceleration of each part caused by the deformation of the display screen.The sensors are not limited to the above sensors and can be sensors using, for example, mechanical, electromagnetic, thermal, acoustic, or chemical means, as long as the sensors can detect parameters necessary for calculating a three-dimensional shape of the display screen. For example, an acceleration sensor, an angular velocity sensor, a vibration sensor, a pressure sensor, a gyro sensor, or the like can be used as sensors. Alternatively, these sensors can be combined and used.

[0021] It should be noted that the present invention includes within its scope a method, hardware (e.g., an electronic device, a computer, a semiconductor device, or a storage medium), a system, a program, software, and the like in which the operations of the present invention are achieved.

[0022] An electronic device may be provided that displays an object on a flexible display screen according to a three-dimensional shape of the display screen by utilizing the flexibility of the display screen.

[0023] A program for displaying an object on a flexible display screen according to a three-dimensional shape of the display screen by utilizing the flexibility of the display screen can be provided.

[0024] Therefore, a user interface (UI) can be provided that can give a user a sense of reality as if an object displayed on the display screen were present on the surface of the electronic device. Short description of the drawings Fig. 1A to Fig. 1D shows a mode of an electronic device. Fig. 2 is a block diagram showing a mode of a hardware structure of an electronic device. Fig. 3 is a block diagram showing a structure of a memory. Fig. Figure 4 is a functional block diagram showing a mode of an electronic device. Fig. 5A and Fig. 5B shows data structures. Fig. 6A to Fig. 6C show a movement of an object displayed on a display screen. Fig. Figure 7 is a flowchart showing steps for displaying an object. Fig. Figure 8 is a flowchart showing steps for displaying an item. Fig. 9 is a flowchart showing steps for displaying an object. Fig. 10 is a flowchart showing steps for displaying an item. Fig. 11 is a flowchart showing steps for displaying an item. Fig. 12 is a flowchart showing steps for displaying an item. Fig. 13 is a flowchart showing steps for displaying an item. Fig. 14A to Fig. 14C show a movement of an object displayed on a display screen. Fig. 15A and Fig. 15B show a movement of an object displayed on a display screen. Fig. 16A and Fig. 16B each shows a movement of an object displayed on a display screen. Fig. 17A and Fig. 17B each shows a movement of an object displayed on a display screen. Fig. 18A and Fig. 18B each show a movement of an object displayed on a display screen. Fig. 19 is a flowchart showing steps for displaying an item. Fig. 20A and Fig. 20B show a movement of objects displayed on a display screen. Best mode for carrying out the invention

[0025] Embodiments of the invention disclosed in this specification will be described below with reference to the accompanying drawings. It should be noted that the invention disclosed in this specification is not limited to the following description, and it will be readily understood by those skilled in the art that modes and details can be changed in various ways without departing from the spirit and scope of the invention. Therefore, the invention disclosed in this specification is not construed as being limited to the description of the following embodiments. (Embodiment 1)

[0026] In this embodiment, a mode of a structure of an electronic device including a flexible display screen and a mode of a method for performing a display on the display screen are described based on Fig. 1A to Fig. 1D, Fig. 2, Fig. 3, Fig. 4, Fig. 5A and Fig. 5B, Fig. 6Abis Fig. 6C, Fig. 7, Fig. 8, Fig. 9, Fig. 10, Fig. 11, Fig. 12 and Fig. 13 described. (Structure of the electronic device)

[0027] An example of a structure of the electronic device including a flexible display screen according to an embodiment of the present invention will be described with reference to Fig. 1A to Fig. 1D. This embodiment describes an example in which the electronic device is a portable information terminal capable of executing various applications, such as making a call with a mobile phone, sending emails, viewing and editing text, playing music, communicating on the Internet, and playing a computer game. Fig. 1A is a plan view of an electronic device 100. The electronic device 100 includes a housing 101, a display screen 102, and a home button 103.

[0028] The display screen 102 is a part of a display device that displays images including a still image and a moving image.As the display device including the display panel 102, there are a light-emitting device in which each pixel includes a light-emitting element, typically an organic light-emitting element (OLED); a liquid crystal display device; an electronic paper that performs display in an electrophoretic mode, an electronic liquid powder (registered trademark) mode, or the like; a digital micromirror device (DMD); a plasma display panel (PDP); a field emission display (FED); a surface-conduction electron-emitter display (SED); a light-emitting diode (LED) display; a carbon nanotube display; a nanocrystal display; a quantum dot display; and the like.The display screen according to an embodiment of the present invention is a part of each of these display devices, and a flexible display device is used as the display device including the display screen.

[0029] In this embodiment, a touch screen, which allows data to be input by a command means such as a finger or a stylus, is provided as input means on the display screen 102. Since the touch screen is provided, an area for a keyboard on the electronic device is unnecessary, and therefore the display screen can be provided in a large area. In addition, since data can be input with a stylus or a finger, a user-friendly interface can be obtained. Although the touch screen can be any of various types, such as a resistive type, a capacitive type, an infrared ray type, an electromagnetic induction type, and a surface acoustic wave type, a resistive type or a capacitive type is particularly preferable because the display screen 102 can be curved according to an embodiment of the present invention.

[0030] Since the display screen 102 is flexible, the housing 101 must also have deformability. The housing 101 is preferably formed using an elastic resin material, a plastically deformable metal material, a combination thereof, or the like. For example, a pressed metal plate may be used for the four corners of the housing 101, and a plastic molded body may be used for the other parts. Note that, although not shown, a material that is not flexible may also be used for the housing 101 if only the display device including the display screen 102 has flexibility and a space is provided between the display device and the housing 101. In this case, for example, the housing 101 may be partially pleated so that the housing 101 can be expanded and shrunk when the display screen 102 is curved.

[0031] As in Fig. As shown in Figure 1A, the electronic device 100 described in this embodiment has a rectangular shape in which a long side is longer than a short side. This is because with this shape, bending in a direction perpendicular to the long side is particularly easy, so that a user can more strongly feel a feature of the flexibility of the electronic device 100. However, by rotating the electronic device 100 90°, it can be used as a vertically oriented display device with a short side at the bottom. To achieve this, an acceleration sensor or the like may be provided in the electronic device 100, in which case the acceleration sensor detects rotation of the electronic device 100, and a display on the display screen 102 is switched from a landscape orientation to a portrait orientation.

[0032] The four corners of the electronic device 100 are rounded. Since the four corners of the electronic device 100 are rounded, stress concentration at the edges of the four corners due to bending or twisting can be relieved, which can lead to improved durability of the display device and the electronic device 100.

[0033] Furthermore, in order for the electronic device 100 to be easily bent, the thickness of the electronic device 100 is preferably as small as possible as long as a certain strength is secured.

[0034] The shape of the electronic device 100 used in Fig. The shape shown in Figure 1A is merely an example, and the present invention is not limited thereto. A square, a circle, an ellipse, or the like may be used depending on the user's needs.

[0035] The Home button 103 is provided in the lower middle part of the upper surface of the casing of the electronic device 100. When the Home button 103 is pressed, a Home screen is displayed on the display screen 102. Furthermore, the electronic device 100 may be configured such that the main power button of the electronic device 100 is turned off by pressing the Home button 103 for a certain period of time. A structure may also be used in which, when the Home button 103 is pressed, the device returns to a sleep state. In addition, the Home button may be used as a switch that initiates various functions, for example, according to the length of time it is pressed or by pressing the Home button together with another button.As described above, when the home button 103 has various functions, the number of buttons actually provided on the housing 101 can be reduced, so that the structure and design of the electronic device 100 can be simplified. The number of buttons on the housing 101 is preferably as small as possible, so that the electronic device 100 according to an embodiment of the present invention, which has flexibility, causes fewer problems, and has high reliability.

[0036] The lower surface (bottom surface) of the electronic device 100 is in Fig. 1B. The lower surface of the electronic device 100 has a slightly smaller area than the upper surface. In other words, a side surface of the electronic device 100 has a shape that slopes from the upper surface to the lower surface. As shown in Fig. As shown in Figure 1B, the side surface of the electronic device 100 has a variety of input / output functions, such as buttons.

[0037] A volume control button 104 and a mute button 105 are provided at the upper right corner of the side surface of the electronic device 100. A speaker 107 for outputting sound is provided at the lower left corner of the side surface of the electronic device 100. The speaker 107 outputs various types of sounds. Examples include sounds set for predetermined processing, such as the startup sound of an operating system (OS), sounds of sound files executed in various applications, such as music from application software for music playback, and notification of an incoming email. Specifically, in the electronic device 100 according to an embodiment of the present invention, the speaker 107 can output sound in response to a curvature of the display screen 102, or it can output sound in response to the movement of an object, which will be described below.

[0038] In addition, the volume of the sound output from the speaker 107 can be adjusted using the volume control button 104. The sound from the speaker 107 can be instantly muted by pressing the mute button 105. Although not shown, a connector for outputting the sound to a device such as headphones, earphones, or a headset may be provided along with or instead of the speaker 107 for outputting the sound.

[0039] A microphone 106, which can be used for sound input or recording, is provided at the lower right corner of the side panel of the electronic device 100. Furthermore, a sleep button 108 is provided at the upper left corner of the side panel of the electronic device 100. When the sleep button 108 is pressed, the electronic device 100 can be switched to the sleep state, in which case power can be saved by pausing any functions, such as a display on the display screen 102, while the main power switch remains on. In this way, the power consumption of a battery in the electronic device 100 can be suppressed.

[0040] When various input / output devices are provided locally at the four corners of the electronic device 100 as described above, parts that lack flexibility can be concentrated at the four corners, so that the electronic device 100 as a whole can exhibit flexibility. When a non-flexible component is used for the four corners, the structural strength of the electronic device 100 is increased, and the usability of the electronic device 100 can be improved. Therefore, a non-flexible component that is different from the materials of the other parts is preferably used for the four corners of the casing 101 of the electronic device 100.

[0041] In contrast, a camera 109 is provided at the upper center portion of the lower surface of the electronic device 100. Images captured with the camera 109 can be displayed on the display screen 102. Note that when the camera 109 is provided at the center portion, the user can know where the camera 109 is positioned even when the user operates the electronic device 100 while viewing the upper surface. Since the electronic device 100 according to an embodiment of the present invention has flexibility, it is possible to capture blur-free images by placing the electronic device 100, which is curved into a U-shape, on a table or the like without using a fixture such as a tripod.

[0042] It should be noted that, although not shown, the electronic device 100 may include a port for connecting an external storage drive. Examples of the external storage drive include storage media drives such as flash drives. Such as an external hard disk drive (HDD), a flash memory drive, a digital versatile disc (DVD) drive, a DVD-recordable (DVD-R) drive, a DVD-rewritable (DVD-RW) drive, a compact disc (CD) drive, a compact disc recordable (CD-R) drive, a compact disc rewritable (CD-RW) drive, a magneto-optical (MO) disk drive, a floppy disk drive (FDD), and a non-volatile solid state drive (SSD) device other than the above flash memory drive.Although the electronic device 100 has the touchscreen on the display screen 102, a keyboard may be provided on the housing 101 instead of the touchscreen or may be added externally.

[0043] The above electronic device 100 has flexibility as shown in Fig. 1C and Fig. 1D. For example, Fig. 1D shows the electronic device 100 whose right and left end portions are curved upward. In this way, the housing 101 and the display screen 102 can be curved. Note that the flexibility of the electronic device in this specification achieves at least part of the effect of the invention disclosed in this specification, and the degree, direction, or the like of the curvature of the electronic device is not particularly limited.

[0044] Fig. 2 is an example of a block diagram showing a hardware structure of the electronic device 100 in this embodiment, which has flexibility. The electronic device 100 includes a processor 151, a main memory 152, a memory controller 153, an auxiliary memory 154, a sensor controller 155, sensors 156, a display controller 157, a display device 158, a power source controller 159, a power source 160, a communication controller 161, a communication interface (I / F) 162, a sound controller 163, a speaker 164, a sound output connector 165, a microphone 166, an input interface 167, a body switch 168, a touchscreen 169, a keyboard 170, a camera 171, an external connector 172, an output interface 173, and a vibration motor 174.Among these, the processor 151, the main memory 152, the memory controller 153, the sensor controller 155, the display controller 157, the power source controller 159, the communication controller 161, the sound controller 163, the input interface 167, and the output interface 173 are connected to each other by one or more system buses 150 and can communicate with each other.

[0045] The above structure of the electronic device 100 is only an example, and some of the components may be omitted. For example, the keyboard 170 may be omitted, in which case a virtual keyboard is created using the touchscreen 169 and the display device 158 with software. Furthermore, a component other than the above components may be added to the structure.

[0046] For processor 151, a microprocessor such as a digital signal processor (DSP) or a graphics processing unit (GPU) can be used in addition to a central processing unit (CPU). Processor 151 interprets and executes instructions from various programs to process various types of data and control programs.

[0047] Note that a thin-film transistor in which a channel formation region comprises an oxide semiconductor can be used for the processor 151. Since the transistor has very low off-state current, a long data retention period can be ensured by using the transistor as a switch for holding the electric charge (data) flowing into a storage element. By utilizing the above characteristics for a register of the processor 151 or the like, the processor 151 can operate only when needed, and the contents of the previous processing can be stored in the storage element the rest of the time, so that normally off-state computing can be performed; thus, the power consumption of the electronic device can be reduced.

[0048] The main memory 152 is used as a main storage device. Fig. 3 is a block diagram showing a structure of the main memory 152. The main memory 152 includes volatile memory and non-volatile memory such as random access memory (RAM) 180 and read-only memory (ROM) 181.

[0049] For example, a dynamic RAM (DRAM) is used for the RAM 180, and a memory space as a working space for the processor 151 is virtually allocated and used. As shown in Fig. 3, an operating system 182, an application program 183, a program module 184, program data 185, and the like stored in the auxiliary memory 154, namely an HDD or the like, are downloaded into the RAM 180 and executed. The data, the program, and the program module downloaded into the RAM 180 are directly accessed and operated by the processor 151. It should be noted that it is assumed that Fig. 3, a memory controller for controlling the data or the like stored in the RAM 180 is integrated in the processor 151, and the memory controller is not shown; but a memory controller for controlling the main memory 152 may be provided separately.

[0050] The ROM 181 stores a basic input / output system (BIOS) 186, firmware, and the like, and does not require rewriting. Furthermore, display section physical characteristic data 187 including physical parameters of the flexible display screen 102 according to an embodiment of the present invention, and sensor characteristic data 188 relating to the characteristics of the sensors 156 that detect position data may be stored in advance in the ROM 181. A mask ROM, a one-time programmable read-only memory (OTPROM), or an erasable programmable read-only memory (EPROM) may be used as the ROM 181.EPROMs can include UV-erasable programmable read-only memory (UV-EPROM) that can erase stored data by irradiation with UV rays, electrically erasable programmable read-only memory (EEPROM), flash memory, and the like.

[0051] The auxiliary memory 154 in the electronic device 100 serves as an auxiliary storage device. The auxiliary memory 154 is a storage medium with a larger capacity than the main memory 152 and is connected to the system bus 150 through the memory controller 153. The memory controller 153 serves as an interface that controls, for example, the reading and writing of data to and from the auxiliary memory 154. For the auxiliary memory 154, a storage medium drive such as a hard disk drive (HDD) or a non-volatile solid-state drive (SSD) can be used.

[0052] It should be noted that although the auxiliary memory 154 in the electronic device 100 in Fig. 2, the auxiliary memory 154 may be an external storage device provided outside the electronic device 100 and connected through the external connector 172; furthermore, the external storage device and the auxiliary memory 154 may be combined to be used as an auxiliary storage device.

[0053] The sensors 156 detect parameters necessary for calculating a three-dimensional shape of the display screen of the electronic device 100. For example, a plurality of position sensors capable of specifying a relative positional relationship to each other may be provided as the sensors 156 in a matrix near the display screen, so that the position sensor detects position data relative to the other position sensors. It is also possible to provide a plurality of acceleration sensors in a matrix near the display screen as the sensors 156, so that the acceleration sensors detect relative changes in the acceleration of each part caused by the deformation of the display screen.The sensors 156 are not limited to the above sensors and may be sensors using, for example, mechanical, electromagnetic, thermal, acoustic, or chemical means, as long as the sensors can detect parameters necessary for calculating a three-dimensional shape of the display screen. For example, an acceleration sensor, an angular velocity sensor, a vibration sensor, a pressure sensor, a gyro sensor, or the like may be used as sensors. Alternatively, these sensors may be combined and used. Note that the sensors 156 may be incorporated into touch sensors on the display screen 102. By combining the touch sensors and the position sensors as a single component, the number of parts can be reduced, which can contribute to reducing the thickness of the electronic device 100.

[0054] The sensor controller 155 is an interface that performs centralized control of the plurality of sensors 156. The sensor controller 155 supplies power from the power source 160 to the plurality of sensors 156, receives input from the sensors 156, converts the input into a control signal, and outputs the signal to the system bus 150. The sensor controller 155 can handle errors caused by the sensors 156 or can calibrate the sensors 156.

[0055] The display device 158 is connected to the system bus 150 through the display controller 157.As the display device 158, a display device having flexibility is used, which is selected from the following: a light-emitting device in which each pixel includes a light-emitting element, typically an organic light-emitting element (OLED); a liquid crystal display device; an electronic paper that performs display in an electrophoretic mode, an electronic liquid powder (registered trademark) mode, or the like; a digital micromirror device (DMD); a plasma display panel (PDP); a field emission display (FED); a surface-conduction electron-emitter display (SED); a light-emitting diode (LED) display; a carbon nanotube display; a nanocrystal display; a quantum dot display; and the like.In response to drawing commands input from the processor 151 through the system bus 150, the display controller 157 controls the display device 158 so that a predetermined image is displayed on the display screen 102 of the display device 158.

[0056] The power source 160 supplies power to a variety of components of the electronic device 100. For example, one or more primary batteries or secondary batteries are included as the power source 160. In the case of indoor use or the like, an alternating current (AC) power source may be used as an external power source. Particularly in the case of using the electronic device 100 separately from the external power source, it is preferable that the power source have a high charge / discharge capacity so that the electronic device 100 can be used for a long time. When charging the power source 160, a charger provided separately from the electronic device 100 may be used. In addition, since the electronic device 100 is flexible in this embodiment, it is preferable that the power source 160 is also flexible.As a secondary battery having such a feature, for example, a lithium-ion secondary battery and a lithium-ion polymer secondary battery can be specified. It is preferable that a laminate package be used as the battery container so that the battery has flexibility.

[0057] Although not shown, the power source 160 may further include a power source management unit (battery management unit: BMU). For example, the BMU collects data on the battery's cell voltage or cell temperature, monitors overcharging and overdischarging, controls a cell balancer, handles a battery degradation condition, calculates the remaining battery power (state of charge: SOC), and controls fault detection.

[0058] The power source controller 159 controls the transmission of power from the power source 160 to each component through the system bus 150 or a power supply line. The power source controller 159 includes a multi-channel power converter or inverter, a protection circuit, and the like. Furthermore, the power source controller 159 has a function for reducing power consumption. For example, after detecting no input to the electronic device 100 for a certain period of time, the power source controller 159 reduces the clock frequency or stops the input of clocks to the processor 151, stops the operation of the processor 151 itself, or stops the rotation of the HDD, thereby reducing power consumption. This function is performed only with the power source controller 159 or with the power source controller 159 coupled to the processor 151.

[0059] The communication interface (I / F) 162 is connected to the system bus 150 through the communication controller 161. The communication controller 161 and the communication I / F 162, in response to commands from the processor 151, control a connection signal for connecting the electronic device 100 to a computer network and transmit the signal to the computer network. Thus, communication can be performed by connecting the electronic device 100 to a computer network, such as the Internet (which is an infrastructure of the World Wide Web (WWW)), an intranet, an extranet, a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), or a global area network (GAN).

[0060] In the case where communication between the electronic device 100 and another device is performed without a transmission line, i.e., wirelessly, a radio frequency (RF) circuit may be provided in the communication interface (I / F) 162 so that an RF signal is transmitted and received. The RF circuit performs conversion between an electromagnetic signal and an electrical signal in a frequency range determined by national law and performs wireless communication with another communication device using the electromagnetic signal. A practical frequency range from several tens of kilohertz to several tens of gigahertz is generally used.The RF circuit includes an RF circuit section and an antenna that can accommodate a variety of frequency ranges; the RF circuit section may include an amplifier, a mixer, a filter, a digital signal processor (DSP), an RF transceiver, or the like. In the case of wireless communication, it is possible to use a communication standard such as Global System for Mobile Communication (GSM) (registered trademark), Enhanced Data Rates for GSM Evolution (EDGE), Code Division Multiple Access 2000 (CDMA2000), or Wideband Code Division Multiple Access (W-CDMA), or a communication standard developed by IEEE, such as Wireless Fidelity (Wi-Fi) (registered trademark), Bluetooth (registered trademark), or ZigBee (registered trademark), as the communication protocol or communication technology.

[0061] Furthermore, in the case where the electronic device 100 is used as a telephone for a telephone conversation, the communication controller 161 and the communication I / F 162, in response to commands from the processor 151, control connection signals for connecting the electronic device 100 to a telephone line and transmit the signal to the telephone line.

[0062] The speaker 164, the sound output connector 165, and the microphone 166, which are responsible for sound, are connected to the sound controller 163 to be connected to the processor 151 through the system bus 150. The sound controller 163 generates analog sound signals audible to the user in response to commands from the processor 151 and outputs the signals to the speaker 164 or the sound output connector 165. Sound data input to the microphone 166 is converted to a digital signal at the sound controller 163 and processed by the sound controller 163 and the processor 151. A sound output device such as headphones, earphones, or a headset is connected to the sound output connector 165, and sound generated in the sound controller 163 is output to the device.

[0063] One or more switches on the housing (hereinafter referred to simply as the housing switches 168), the touch screen 169 near the display screen 102, the keyboard 170 on the housing 101, the camera 171 on the bottom surface of the housing 101, and the external connector 172 to which other input components can be connected are controlled by the input interface 167, and the input interface 167 is connected to the processor 151 and the like through the system bus 150.

[0064] The housing switches 168 correspond, for example, to the home button 103, the volume control button 104, the mute button 105, the sleep button 108 and the like, which are shown in Fig. 1A to Fig. 1D. In addition to these housing switches 168, the touchscreen 169, the keyboard 170, the camera 171, and the external connector 172, the microphone 166 for sound input and the sensors 156 that detect deformation of the display screen 102 serve as interfaces between the user and the electronic device 100.

[0065] The touchscreen 169 is provided on the display screen 102 and can be used as an input device, where data is input using a command means such as a finger or a stylus. Since the touchscreen 169 is provided, an area for a keyboard on the electronic device is unnecessary, and therefore the display screen can be provided in a large area. Furthermore, since data can be input using a stylus or a finger, a user-friendly interface can be obtained. Although the touchscreen 169 can be any of various types, such as a resistive type, a capacitive type, an infrared ray type, an electromagnetic induction type, and a surface acoustic wave type, a resistive type or a capacitive type is particularly preferable because the display screen 102 can be curved according to an embodiment of the present invention.Note that the touchscreen 169 may include the sensors 156 to serve as a single component. With this structure, the number of parts can be reduced, which can contribute to reducing the thickness of the electronic device 100.

[0066] The vibration motor 174 is connected to the system bus 150 through the output interface 173. In response to commands from the processor 151, the output interface 173 controls the vibration time and the like and causes the vibration motor 174 to vibrate. Consequently, the electronic device 100 vibrates, and the vibration can be used as a haptic effect on the user when receiving emails or running applications such as computer games. The vibration motor 174 can vibrate according to the degree of curvature of the display screen 102; for example, if the flexibility of the display screen 102 is limited to a predetermined degree, the vibration motor 174 can be used to notify the user that the threshold is exceeded.Although not shown, in addition to the vibration motor 174, various output devices that allow the user to perceive using the five senses may be connected to the output interface 173. For example, a light-emitting device for indicating an operating state of the electronic device 100, an aroma diffuser that emits fragrance in response to vibration, or the like may be connected to the output interface 173. (Functions of the electronic device)

[0067] Next, Fig. 4 is a block diagram showing the main functions of the electronic device 100 in this embodiment. The electronic device 100 has at least four functional blocks, namely a display section 201, a detection section 202, an arithmetic section 203, and a storage section 204. An input section 205 and an output section 206 may be additionally included.

[0068] The display section 201 includes the display device 158 and the display controller 157, which are based on Fig. 2, and the like, and displays a field, an object, or the like on the display screen of the display device 158. At least the display device 158 has flexibility and can be deformed. On the display screen 102 of the display device 158, an object that moves according to the change in the shape of the display screen 102 is displayed. Here, the object is a body displayed on the display screen 102 and moves in response to the deformation of the display screen 102. Further, the field is a background of the object in motion and a cause that affects the movement of the object. A graphic expression of the field may be an arrangement of textures representing materials or may be transparent.

[0069] The detection section 202 includes the sensors 156 and the sensor controller 155, which are based on Fig. 2, and the like, and detects position data of the display screen 102 of the display device 158. For example, the plurality of sensors 156 are provided in a matrix, and at the respective location, each of the sensors 156 obtains position data relative to the other sensors 156. The position data obtained with the sensors 156 is output to the arithmetic section 203 by the sensor controller 155.

[0070] The arithmetic section 203 includes the processor 151, which uses Fig. 2, and the like. The position data of the locations of the display screen 102 output from the detection section 202 is input to the arithmetic section 203, and the arithmetic section 203 calculates a three-dimensional shape of the display screen 102 based on the data. The calculation of a three-dimensional shape of the display screen 102 can be performed appropriately in consideration of the sensors 156 or a calculation mode used. At the time of calculating a three-dimensional shape of the display screen 102, computational loads on the processor 151 can be reduced if comparison is performed with the latest data among the data on a three-dimensional shape of the display screen 102 that has already been calculated and the amount of change is calculated to obtain a new three-dimensional shape of the display screen 102.At least the most recent data among the data on the three-dimensional shape of the display screen 102 that has already been calculated is stored in the storage section 204. It is also possible to calculate a three-dimensional shape of the display screen 102 by comparing position data already obtained from the sensors 156 and position data newly obtained from the sensors 156, and adding the amount of change to the three-dimensional shape of the display screen 102. In this case, at least the most recent data among the position data already obtained from the sensors 156 is stored in the storage section 204.

[0071] After calculating the three-dimensional shape of the display screen 102, the arithmetic section 203 moves the object on the field according to the calculated three-dimensional shape of the display screen 102.

[0072] The memory section 204 includes the main memory 152, the auxiliary memory 154 and the memory controller 153, which are Fig. 2, and the like. At least data about the object, data about the field, and data about a law defining the movement of the object are stored in the storage section 204. This data may be included in the operating system or stored in the storage section 204 as an application program, program module, or program data. This data is stored, for example, in the HDD used as the auxiliary storage 154 and downloaded to the main memory 152, which includes a DRAM and the like, by starting up the electronic device 100 as needed.

[0073] As in Fig. 5A, the data about the object (object data 250) includes an object ID 251, an object shape 252, a physical quantity 253 of the object, such as a set mass or a set surface condition (friction coefficient), an object image 254, and a default setting 255 of the object, such as an initial position; this data can be stored as a structured list, table, or database in the storage section 204. In an example in Fig. 5A, the data is linked to the item ID 251 to form a layered structure.

[0074] As in Fig. 5B, the data about the field (field data 260) is a field ID 261, a field shape 262, a physical quantity 263 of the field, a field image 264, and a default setting 265 of the field; this data can be stored in the storage section 204 as a structured list, table, or database. In an example in Fig. 5B, the data is linked to field ID 261 to form a layered structure.

[0075] The law that defines the motion of an object refers to a law that can be represented by a particular equation that defines the motion of the object. For example, it refers to a physical law of the natural world, specifically a law that defines the motion of a body. More concrete examples are laws that can be represented by equations of motion, which visually represent the mechanics of gravity, attractive force, frictional force, air resistance, motion of a rigid or fluid body, and the like. However, a "particular law" is not limited to physical laws of the natural world. For example, to enhance a visual effect, the particular law can be a law emphasized by deviating from a physical law of the natural world, or it can be a law that violates the natural law, whereby an object floats despite gravity.Furthermore, such an equation does not necessarily represent an exact physical law of the natural world and may be a pseudo-equation or a simplified equation. Data about a law defining the motion of an object is a group of equations that form the basis for simulating the motion of the object. Although not shown, the data about the law defining the motion of the object may also be stored as a structured list, table, or database in the storage section 204.

[0076] The arithmetic section 203 looks up the physical quantities, position data, and the like associated with the object ID and field ID stored in the storage section 204 and the three-dimensional shape of the display screen 102 calculated based on the data from the detection section 202, and simulates the movement of the object based on the data about the law defining the movement of the object, so that the object moves according to the above law.In other words, in response to a change in the shape of the display screen 102, the arithmetic section 203 retrieves the object data, the field data, the data on the law defining the movement of the object, and the like, as well as the data on the change in shape, into the workspace, inserts parameters into equations of the data on the law defining the movement of the object, and calculates the movement of the object. While calculating the movement of the object until the movement of the object substantially subsides, the detection section 202 monitors further changes in the shape of the display screen 102 and immediately modifies the movement of the object when the change in shape is detected.

[0077] As described above, the modification due to the change in the shape of the display screen 102 is repeatedly performed, and the simulation continues until the movement of the object subsides (that is, the movement of the object stops), whereby the user can feel the realistic movement of the object corresponding to the deformation of the display screen 102. The movement of the object simulated by the arithmetic section 203 is output to the display section 201 and displayed on the display screen 102. Note that it is preferable that the change in the shape of the display screen 102 has a certain threshold, and that the arithmetic section 203 performs a calculation only when the threshold is exceeded.In this case, an increase in the calculation amount of the arithmetic section 203 can be suppressed, and the movement of the object can be stopped at a predetermined degree.

[0078] The input section 205 includes the microphone 166, the body switch 168, the touch screen 169, the keyboard 170, the camera 171, the external connector 172, the sound control 163 and the input interface 167, which are configured by Fig. 2, and the like. For example, the object displayed on the display screen 102 may move in response to the sound input with the microphone 166. Furthermore, although sensors for calculating the shape of the display screen 102 are indicated as the sensors 156, sensors in addition to these sensors may be used as an input interface. For example, using acceleration sensors for the electronic device 100, the object may move according to the inclination of the electronic device 100. The sensors 156 may be used as such sensors for input.

[0079] The output section 206 includes the speaker 164, the sound output connector 165, the tone controller 163, the vibration motor 174 and the output interface 173, which are based on Fig. 2, and the like. For example, while the object whose movement is determined as described above is moving, the electronic device 100 is vibrated by controlling the vibration motor 174, allowing the user to feel a sense of reality through a haptic sense. (Example of operation of the electronic device)

[0080] Next, an example of operation of the electronic device 100 will be described using Fig. 6A to Fig. 6C.

[0081] Fig. 6A is a perspective view showing the top surface of the electronic device 100, and an object 301 is displayed on the display screen 102 of the electronic device 100. To describe a display operation for the object 301, other displays are not shown in the drawing; however, in fact, any other display objects, such as a background image, an icon, a toolbar, a pointer, a window, text, a moving image, or a web browser, may be displayed at the same time as the object 301.

[0082] The item 301 in Fig. 6A is designed as a spherical solid and is at rest in a specific position. The range of motion of object 301 is defined as a field, which serves as the ground that influences the movement of object 301.

[0083] Fig. 6B shows the electronic device 100 whose right end portion is lifted and curved. When the electronic device 100 is deformed, the display screen 102 is also deformed. Data from the plurality of sensors 156 that have detected the deformation are combined, and the arithmetic section 203 calculates the changed shape of the display screen 102. In addition, various types of data are retrieved from the storage section 204, and the movement of the object is simulated by the above method. The simulation results are displayed as the movement of the object on the display screen 102. Since the right side of the display screen 102 in Fig. 6B, the object 301 moves toward the center of the display screen 102 as if pulled by gravity (in a direction shown by an arrow in the drawing).

[0084] In Fig. 6B, the object 301 is a solid sphere. Therefore, according to Newtonian mechanics, the object 301 rolls to the center of the display screen 102. Here, the object 301 has a certain physical quantity. Therefore, the moving speed and the rolling speed depend on the mass or the like. The field also has a predetermined physical quantity or the like. For example, the object 301 moves while being subjected to the air resistance, gravitational acceleration, and friction set for the field.

[0085] By applying various laws to the movement of the object 301 as described above, the user can feel a sense of reality.

[0086] It should be noted that not necessarily all physical quantities and the like of the object 301 and the field are used as references, and only some of them can be used as references. If only some are used as references, burdens on the arithmetic section 203 can be reduced. Similarly, only a part of the group of equations stored in the storage section 204 can be used in the simulation. Although only one object 301 on the field in Fig. 6B, the plurality of items 301 may be displayed. In this case, the amount of data or the number of parameters, such as a physical quantity used as a reference or the set of equations, may be appropriately controlled depending on the number of items 301 displayed on the display screen 102.

[0087] Fig. Fig. 6C shows the movement of the object 301 in the case where the electronic device 100 is deformed by further bending it to protrude downward. For example, the spherical object 301, which is shown in Fig. 6B, into the recess formed by curving the display screen 102. The object 301 that has fallen into the recess is enclosed by high walls of the display screen 102 on both sides and therefore cannot move from side to side; the object 301 moves at the bottom of the recess and stops after a while.

[0088] In the above manner, data about the three-dimensional shape of the display screen 102 is calculated using the sensors 156 and the processor 151, whereby the object 301 moving according to the shape can be displayed. Consequently, the user can feel a sense of reality as if the object 301 displayed on the display screen 102 were present on the surface of the electronic device 100.

[0089] Note that although the deformation of the display screen 102 serves as the condition for starting the movement of the object 301 here, the condition is not limited thereto. For example, when acceleration sensors are provided as the input interface 167 in the electronic device 100, detection of the acceleration by the acceleration sensors may serve as the condition for starting the movement of the object 301. The object 301 may move in a direction corresponding to the inclination detected by the acceleration sensors. Furthermore, for example, when the microphone 166 is used as the input interface 167, the object 301 may move according to the volume of the input sound. Alternatively, the object 301 may move in a direction corresponding to a direction input using the keyboard 170.Furthermore, the object 301 can be reset to its initial position when the home button 103 provided on the housing 101 of the electronic device 100 is pressed. (Process for display processing of an object)

[0090] Next, a process for display processing of an object in the electronic device 100 according to an embodiment of the present invention will be described with reference to Fig. 7, Fig. 8, Fig. 9, Fig. 10, Fig. 11, Fig. 12 and Fig. 13 described.

[0091] Fig. 7 is a flowchart illustrating a process 500 for displaying an item in the electronic device 100 according to an embodiment of the present invention. Here, as an example of the process for displaying an item, an application for displaying the item will be described. An example of such an application is a background of a home screen of the electronic device 100, and the like.

[0092] As a result, the following object display processing procedure is performed using an application program. The program is stored in a computer-readable storage medium, such as the auxiliary memory 154 or the main memory 152.

[0093] Furthermore, although the program here corresponds to software, such a processing means can also be an electronic circuit or mechanical hardware.

[0094] First, an application for displaying an object is launched in the electronic device 100 according to an embodiment of the present invention (S001). Here, the application program or the like stored in the auxiliary memory 154 is downloaded to the main memory 152. Note that launching the application may be performed at the same time as the startup of the operating system.

[0095] Then, initial conditions related to the object and field are set (S002 and S003). The initial conditions related to the object and field can be set so that the conditions are carried over to the previous use when the application is closed, or the conditions can be reset to the default setting each time the application is used. Furthermore, the user can select any of these settings.

[0096] With the initial conditions of the item, the item ID 251, which is the item data 250 in the storage section 204, display positions, and the like are set. Furthermore, with the initial conditions of the field, the field ID 261, which is the field data 260 in the storage section 204, and the like are set. Specifically, the setting means reading the item ID 251 and the physical quantity 253 of the item and the like associated with the item ID 251 from the auxiliary memory 154 and storing them in the main memory 152. Parameters for the field data 260 are also set in a similar manner.

[0097] The order in which the initial conditions related to the object (S002) and the initial conditions related to the field (S003) are set is not limited to the above order. The initial conditions related to the field can be set first, or the initial conditions related to the object (S002) and the initial conditions related to the field (S003) can be set simultaneously.

[0098] Then, position data at the respective positions is obtained using the plurality of sensors 156 provided near the display screen 102 (S004). After that, based on the position data obtained using the plurality of sensors 156, the three-dimensional shape of the display screen 102 is calculated by the arithmetic section 203 (S005). In the case where the shape of the display screen 102 has already been obtained using another system or application after starting the operation of the electronic device 100 and before starting the application, the three-dimensional shape of the display screen 102 can be calculated using the obtained shape data.

[0099] Then, the shape of the display screen 102 calculated in step S005 is compared with the initial state of the object, and it is determined whether the object is being moved (S006). For example, the initial position of the object set in step S002 corresponds to a position with an inclination exceeding a predetermined threshold with respect to a horizontal surface due to a curved surface of the display screen 102. In this case, the arithmetic section 203 determines that the movement of the object is necessary. In contrast, in the case where the initial position of the object corresponds to a position parallel to the horizontal surface even though the display screen 102 has a curved part, the object is at rest, and therefore the arithmetic section 203 determines that the movement of the object is unnecessary.If the arithmetic section 203 determines that the movement of the object is necessary, processing is shifted to an object movement mode 510 (or an object movement mode 520, which will be described as another example) (S007). If the arithmetic section 203 determines that the movement of the object is unnecessary, processing is shifted to an object standby mode 530 (S008).

[0100] When the subject standby mode 530 is terminated, it is judged in step S009 whether the application is terminated; in the case where the conditions are met (ie, in the case where an application termination flag, which will be described below, is "1"), the application is terminated (S010), and in the case where the conditions are not met (ie, in the case where the application termination flag, which will be described below, is "0"), the processing returns to step S004.

[0101] When the application is terminated, various types of data stored in the main memory 152 are preferably stored in the auxiliary memory 154. Consequently, the data can be used as initial settings the next time the application is started.

[0102] Fig. 8 is a flowchart illustrating the object movement mode 510 in a process for displaying an object in the electronic device 100 according to an embodiment of the present invention. In the object movement mode 510, the simulation of the object's movement is repeated, and the results are displayed each time on the display screen 102. The simulation and display of the object are repeated every specified period (hereinafter referred to as Δt).

[0103] After the object movement mode has started (S020), the object's movement is determined according to the previously calculated display screen shape (S021). Here, the object's movement before Δt is determined.

[0104] The movement of the object is simulated according to a predetermined law in the arithmetic section 203. The simulation is performed using the physical quantity of the object, the physical quantity of the field, and the like, which were set in step S002 and step S003. Through this simulation, the movement direction, movement speed, and the like of the object are determined. For the simulation of the movement direction, movement speed, and the like of the object, the field data 260 via the linked field ID 261 is also used as a reference. For example, in the case where the selected physical quantity 263 of the field of the field ID 261 includes data about an elastic material such as rubber, the movement of the object is simulated to bounce after falling into a depression formed by curvature of the display screen 102.Data about the simulated movement of the object is stored in the main memory 152 of the storage section 204.

[0105] Simulations can be performed to display the rotation, deformation, or the like of the object so that the user can feel more realistic. However, if the simulation is complicated, the arithmetic section 203 becomes overloaded, so that processing delays in the arithmetic section 203 prevent appropriate display; thus, the user's sense of reality is deteriorated. Therefore, it is preferable to simplify calculations or provide a database of calculation results to avoid, for example, a reduction in calculation speed.

[0106] Subsequently, according to the movement of the object determined by the simulation, the movement of the object is displayed on the display screen 102 for a period Δt (S022). The movement of the object is influenced by friction coefficients, air resistance, gravity, or the like depending on the physical quantity of the field 263. Note that the movement of the object includes stopping the object. Therefore, step S023 includes a movement sequence from stopping the object to moving the object and a movement sequence from moving the object to stopping the object.

[0107] Then, the three-dimensional shape of the display screen 102 is recalculated (step S023). Specifically, in this step, data stored in the storage section 204, which is data about the previously calculated three-dimensional shape of the display screen 102, is overwritten with data about the three-dimensional shape of the display screen 102 newly obtained by a three-dimensional shape of the display screen recalculation process 511.

[0108] Now, the recalculation process 511 for the three-dimensional shape of the display screen is executed based on Fig. 9. When the three-dimensional shape recalculation process 511 of the display screen begins (S040), position data of specific parts of the display screen 102 are again obtained by the sensors 156 (S041). Then, the three-dimensional shape of the display screen 102 is recalculated based on the position data (S042). At the same time as the recalculation, data on the three-dimensional shape of the display screen 102 is stored in the storage section 204, and then the three-dimensional shape recalculation process 511 of the display screen is terminated (S043).

[0109] Through the display screen three-dimensional shape recalculation process 511, the data on the previously calculated three-dimensional shape of the display screen 102 is updated by overwriting it with the newly obtained data on the three-dimensional shape of the display screen 102. Alternatively, without overwriting, an address other than that of the storage section 204 in which the data on the previously calculated three-dimensional shape of the display screen 102 is stored may be set to store the newly obtained data.

[0110] Further, at the same time as the three-dimensional shape display screen recalculation process 511, data input with an input device such as a touch screen may be read from the input interface 167 in step S023.

[0111] Then, to update the data on the movement of the object stored in the main memory 152, the movement of the object is simulated again (S024). The simulation of the movement of the object can be performed without exception. Alternatively, it is also possible to perform the simulation of the movement of the object only when there is a difference between the data on the previously calculated three-dimensional shape of the display screen 102 and the data on the three-dimensional shape of the display screen 102 recalculated in step S023 when these data are compared with each other.In this case, the amount of change preferably has a predetermined threshold for comparison between the three-dimensional shape data, in which case noise or burden due to unnecessary calculation by the arithmetic section 203 can be reduced in a range unnoticeable to the user. In other words, it is preferable that it is determined that the three-dimensional shape of the display screen 102 has been changed only when the amount of change of the data on the recalculated three-dimensional shape of the display screen 102 from the data on the previously calculated three-dimensional shape of the display screen 102 exceeds the predetermined threshold, and that the processing proceeds to step S024; if there is no change, the processing proceeds to step S025.

[0112] Next, in step S025, it is determined whether the object is moving or at rest. In the object movement mode 510, simulation of the object's movement is performed every period Δt. Therefore, in some cases, the results of the simulation in step S021 indicate that the object is moving after Δt. Depending on the results of the recalculation of the three-dimensional shape of the display screen 102 in step S023 and the like, further movement of the object may be performed by the simulation in step S024. In this case, it is determined that the object is not at rest but is moving, so the processing returns to step S022.

[0113] In contrast, when it is determined that the object is at rest, the object movement mode 510 is terminated (S026).

[0114] As described above, a display is performed, dividing the period of movement of the object into periods each having a length of Δt, and the simulation is repeated while changing the shape of the display screen, whereby the movement of the object can be modified and displayed at any time; consequently, the user can feel a sense of reality.

[0115] Fig. Fig. 10 is a flowchart showing a procedure for processing in the object movement mode 520, which is different from the processing procedure described by Fig. 8 has been described.

[0116] In the processing in the object movement mode 510 described above, time is allocated for displaying the movement of the object, and simulation for the next display is performed after an intended display is completed; meanwhile, in the processing in the object movement mode 520, the movement of the object is displayed for a certain period, and during this period, simulation for the next display is performed.

[0117] When the object movement mode 520 starts (S050), the movement of the object is determined by simulation based on the data about the three-dimensional shape of the display screen 102 that has already been calculated (S051).

[0118] Then, the movement determined by the simulation is displayed for a certain period (here, Δt), and during the period Δt, the movement of the object is simulated in the next period Δt. The display of the movement of the object is performed according to an object movement display process 521, and the next movement of the object is performed according to an object movement calculation process 522 (S052).

[0119] Here, the display sequence 521 for the movement of the object is shown using Fig. 11. After the process starts (S060), the time t is initialized to "0" (S061). Then, in steps S062 to S065, the movement of the object is displayed. In other words, displaying the movement of the object for each time t (S063), updating t by adding t (S064), and displaying the movement of the object again are repeated until the time t becomes Δt (S065). Consequently, the movement of the object remains displayed until the time t becomes Δt. When the time t becomes Δt, the object movement display process 521 is terminated (S066).

[0120] Next, the calculation process 522 for the movement of the object is executed based on Fig. 12. As with the object movement display routine 521, after the routine starts (S070), time t is initialized (S071). Then, in steps S072 to S077, the object movement is simulated in the period Δt corresponding to the three-dimensional shape of the display screen 102.

[0121] Position data of specific parts of the display screen 102 are obtained using the sensors 156 (S073). Then, the three-dimensional shape of the display screen 102 is calculated based on the obtained position data (S074). Based on the data on the calculated three-dimensional shape of the display screen 102, the movement of the object is simulated and determined for the period Δt (S075). Then, t is updated by adding t (S076).

[0122] The above-described steps S073 to S076 are repeated until t becomes Δt (S077). Here, the period Δt is equal to the period Δt determined in the object movement display process 521. By synchronizing the processes, the processes are performed simultaneously during the same period (Δt). In other words, in the object movement display process 521, while the object movement is being displayed, the object movement for the next period can be determined in advance by the object movement calculation process 522.

[0123] In the object movement calculation process 522, when the shape of the display screen 102 is changed during the period Δt, the determined object movement is modified by overwriting. It should be noted that in Fig. 12, the simulation of the movement of the object is repeated regardless of whether the shape of the display screen 102 is changed or not; however, a step for judging the change in the shape of the display screen 102 may be employed, in which case the simulation may be omitted if the shape is not changed. Furthermore, the calculation of the three-dimensional shape of the display screen 102 may be performed only when the position data obtained by the sensors shows a change greater than or equal to a predetermined value.

[0124] When t becomes Δt as a result of the operation repeated as described above, the object movement calculation process 522 is terminated (S078).

[0125] After step S052, as in Fig. As shown in Figure 10, it determines whether the object is moving or at rest (S053). If the object is moving, processing returns to step S052, while if the object is at rest, the object moving mode 520 is terminated (S054) and processing shifts to the object standby mode 530.

[0126] As described above, in the object movement mode 520 in Fig. 10, a display of the object's movement and a simulation of the object's movement for the next period are performed in parallel during a specific period. Through such processing, the user can feel a sense of reality.

[0127] Next, the item standby mode 530 will be described. Fig. 13 is a flowchart showing a processing procedure in the object standby mode 530. The object standby mode refers to internal processing of the electronic device 100 performed during a period in which the object displayed on the display screen 102 is idle, and the application is running.

[0128] When the object standby mode starts (S030), in step S031, the application termination flag indicating whether the application is terminated and a mode termination flag indicating whether the object standby mode 530 is terminated are initialized. For example, both flags are set to "0."

[0129] Then, using the sensors 156, it is checked whether the display screen 102 is deformed or not (S032) by comparing the data on the three-dimensional shape of the display screen 102 already calculated in step S005, step S042, or step S074 with the data on the three-dimensional shape of the display screen 102 recalculated in step S032 (S032). Note that the amount of change preferably has a predetermined threshold value for the comparison between the three-dimensional shape data, in which case noise or burden due to unnecessary calculation by the arithmetic section 203 can be reduced in a range unnoticeable to the user.In other words, it is preferable that it is determined that the three-dimensional shape of the display screen 102 has been changed only when the amount of change of the data on the recalculated three-dimensional shape of the display screen 102 from the data on the previously calculated three-dimensional shape of the display screen 102 exceeds the predetermined threshold, and the processing proceeds to step S034.

[0130] In the case where it is determined that the three-dimensional shape of the display screen 102 has been changed, the mode termination flag is set to "1" (S034). In the case where there is no change in the shape of the display screen 102, it is then checked whether or not there is an input from the input interface 167. The input from the input interface 167 here is limited to an input that affects the movement of the object. Similarly, if there is an input, the mode termination flag is set to "1" (S034). In the case where there is neither a change in the shape of the display screen 102 nor the input from the input interface 167, the processing proceeds to the next step while the mode termination flag remains at "0".

[0131] In step S035, it is checked whether or not there is a notification of an application termination command. If there is a notification, the application termination flag for the application is set to "1" (S036). The application termination command includes, for example, a user-issued application termination command via processor 151 and a command to terminate the application from another application, program, or operating system. If there is no notification of the application termination command, the application termination flag remains at "0," which is the initial value.

[0132] The flag is judged in step S037. That is, if the mode termination flag and / or the application termination flag are set to "1," the object standby mode is terminated (S038). On the other hand, if both flags are "0," the object standby mode continues. In other words, the processing returns to step S032.

[0133] As described above, in the object standby mode 530, an input state is monitored by repeatedly checking whether or not there is a specific input. If there is any input, the object standby mode 530 is terminated, and processing proceeds to step S009.

[0134] This embodiment can be appropriately combined with any of the other embodiments. Note that the present invention includes within its scope a method, hardware (e.g., an electronic device, a computer, a semiconductor device, or a storage medium), a system, a program, software, and the like in which the operations of the present invention are achieved. (Embodiment 2)

[0135] Although the object 301, which is a spherical solid, has been described as an example of an object in Embodiment 1, the object is not limited to this. In this embodiment, the case where the object is designed like a liquid will be described based on Fig. 14A to Fig. 14C described.

[0136] Fig. Fig. 14A is a perspective view showing the electronic device 100 in which a liquid object 303 is displayed on the display screen 102. As in the case of the electronic device 100 in Fig. 6A to Fig. 6C, in order to describe a display operation for the object 303, other displays are not shown in the drawing; however, any other display object, such as a background image, an icon, a toolbar, a pointer, a window, text, a moving image, or a web browser, may actually be displayed at the same time as the object 303.

[0137] The item 303 in Fig. 14A is designed like a fluid body and is at rest in a specific position. The range of motion of the object 303 is defined as a field, which serves as the ground that influences the movement of the object 303.

[0138] Fig. 14B shows the electronic device 100 whose right end portion is lifted and curved. When the electronic device 100 is deformed, the display screen 102 is also deformed. The movement of the liquid object 303 is simulated by the arithmetic section 203 such that the object moves according to the shape of the display screen 102. Since the right side of the display screen 102 in Fig. 14B, the liquid object 303 moves toward the center of the display screen 102 as if pulled by gravity (in a direction shown by an arrow in the drawing).

[0139] The object 303 is defined as a liquid by the physical quantity 253 of the object in the object data 250. The arithmetic section 203 performs a simulation using the data or a parameter stored in the physical quantity 253 of the object as a reference, which indicates that the object is a liquid. A simulation in which the object 303 moves like a real liquid according to a law of fluid mechanics (hydraulics) is performed, thereby displaying the movement of the object as if a liquid were flowing from a higher level to a lower level.As data or parameters indicating that the object is a liquid, for example, a value of density, viscosity, compaction property, surface tension, or the like can be prepared as a physical quantity. For convenience, the degree of a physical quantity such as viscosity can be divided into several levels to prepare some data. Furthermore, a set of images of liquids in various forms is stored in advance in the object image 254 so that the user can visually recognize that the liquid is flowing.

[0140] A physical quantity and the like are also set for the field; for example, the liquid object moves while the friction determined for the field acts on it.

[0141] By applying the various laws to the movement of the liquid object 303, the user can feel a sense of reality as described above.

[0142] It should be noted that not necessarily all physical quantities and the like of the object 303 and the field are used as references, and only some of them can be used as references. If only some are used as references, burdens on the arithmetic section 203 can be reduced. Similarly, only a part of the group of equations stored in the storage section 204 can be used in the simulation. Although only one object 303 on the field in Fig. 14B, the plurality of objects 303 may be displayed. For example, in the case where a more complicated calculation is possible, the liquid object 303 may be divided into a plurality of objects by movement, or the plurality of objects may be combined into one object. In this case, each of the objects may be provided with the object ID 251 in response to the creation and disappearance of the objects so that it can be defined, or the state of an object with an item ID that is divided into a plurality of objects may be stored as object shape data 252 or the like. In addition, to simplify the calculation, an image representing splashes may be appropriately displayed around the liquid object 303.

[0143] Fig. Fig. 14C shows the movement of the liquid object 303 in the case where the electronic device 100 is deformed by further bending it so that it protrudes downward. For example, the liquid object 303, which flows as shown in Fig. 14B, into the recess formed by the curvature of the display screen 102. The object 303 that has flowed into the recess is enclosed by high walls of the display screen 102 on both sides and therefore cannot move from side to side; the object 303 collects at the bottom of the recess and stops after a while.

[0144] In the above manner, data about the three-dimensional shape of the display screen 102 is calculated using the sensors 156 and the processor 151, whereby the liquid object 303 moving according to the shape can be displayed. Consequently, the user can feel a sense of reality as if the liquid object 303 displayed on the display screen 102 were present on the surface of the electronic device 100.

[0145] This embodiment can be appropriately combined with any of the other embodiments. Note that the present invention includes within its scope a method, hardware (e.g., an electronic device, a computer, a semiconductor device, or a storage medium), a system, a program, software, and the like in which the operations of the present invention are achieved. (Embodiment 3)

[0146] In this embodiment, an electronic device in which a touch screen is used as an input device in an input section and the object can be controlled by input from the touch screen is described by Fig. 15A and Fig. 15B.

[0147] Fig. 15A is a perspective view showing the curved electronic device 100. An object 302, which is a spherical solid, is displayed on the right end portion of the display screen 102 of the electronic device 100. When a user touches the object 302 (actually, the user touches the touchscreen on the display screen 102 where the object 302 is displayed) and slides the display screen 102 to the left (in a direction indicated by an arrow in Fig. 15A), for example, the object 302 rolls in response to the movement of the finger in the direction of the flick. In Fig. 15B, the display screen 102 is curved at the center to have a steep step from right to left; thus, the object 302 is displayed as if the object 302 were falling and rolling due to this curvature.

[0148] With such a structure, where the electronic device 100 includes the touch screen in the input section, the processing procedure for displaying the object is basically the same as that in Embodiment 1. However, the conditions for starting the movement of the object are access to the object through the touch screen and detection of the deformation of the display screen 102, which were described in Embodiment 1. Therefore, in the processing procedure in Embodiment 1, the steps for determining the movement of an object (S006, S025, and S053) include checking whether or not an input through the touch screen is detected.

[0149] In a similar manner, in the object movement mode 510 in Fig. 8 Data is updated via the input from the touch screen in the step of updating the change of the three-dimensional shape of the display screen (S023). Furthermore, in the object movement mode 520, Fig. 10 Data about the input from the touch screen are checked in the step of obtaining the position data with the sensors (S073) and the step of calculating the three-dimensional shape of the display screen (S074). Furthermore, in the object standby mode 530 in Fig. 13 Data about the input from the touch screen in the step of checking whether there is an input from the input interface 167 or not (S033) is checked.

[0150] It should be noted that although the example in which the touch screen is used to move the object 302 is described in this embodiment, the object 302 can be moved using, apart from the touch screen, any of various input devices in the input section 205; for example, a case switch on the case 101, a keyboard built into the electronic device 100 or provided outside the electronic device 100, a pointing device (e.g., a mouse or a controller) connected to the external terminal, a microphone for sound input, and the like can be used. When a microphone is used, for example, the movement of the object 302 can be appropriately controlled depending on the volume of the input sound to be displayed (see Fig. 16A). It is also possible, for example, to analyze the user's voice input "Move left," recognize the meaning, and move the object to the left according to the content (see Fig. 16B). In addition, a gesture device that detects a user's gesture (movement) and converts it into an input signal may be provided in the input section 205 of the electronic device 100 to move the object 302.

[0151] As described above, the input section 205 may include various input devices with which the object 302 displayed on the display screen 102 can be moved so that the user can feel a sense of reality as if the object were present on the surface of the electronic device 100.

[0152] This embodiment can be appropriately combined with any of the other embodiments. Note that the present invention includes within its scope a method, hardware (e.g., an electronic device, a computer, a semiconductor device, or a storage medium), a system, a program, software, and the like in which the operations of the present invention are achieved. (Embodiment 4)

[0153] In this embodiment, the case where processing for displaying an item on the display screen is performed at the same time as another application is described by Fig. 17A and Fig. 17B.

[0154] In Fig. 17A, other application software is running, and an electronic document is displayed in a window 305 of the application software on the display screen 102. Furthermore, a plurality of icons 304 of the home screen displayed by the operating system of the electronic device 100 are displayed on the display screen 102.

[0155] Although application software for text editing is considered as other application software in Fig. 17A, the present invention is not limited thereto; various types of application software for spreadsheets, database administration, calling, emailing, web browsing, blogging, video conferencing, music playback, moving image playback, digital cameras, digital video cameras, e-book readers, computer games, and the like are included.

[0156] An object 306a and an object 306b according to an embodiment of the present invention are displayed on the display screen 102. The object 306a and the object 306b move in response to an input from the sensors or the input section described in Embodiments 1 to 3. Here, the object 306a and the object 306b are set such that the objects cannot move within the entire area of ​​the display screen 102 and cannot enter certain areas. That is, in Fig. 17A, the areas in which the plurality of icons 304 and the application software window 305 are displayed are defined as the areas into which objects cannot enter, so that the object 306a and the object 306b move while avoiding the areas. Furthermore, if these areas into which objects cannot enter are regarded as bodies with specific physical quantities, the movement of the objects is defined depending on the physical quantities.

[0157] In addition, as in Fig. As shown in Figure 17B, the movement of an object 306, which moves according to the deformation of the display screen 102, is also influenced by the icons 304. Therefore, the actual shape of the display screen 102 and the shapes of the virtual icons 304 similarly influence the movement of the object 306, allowing the user to further feel a sense of reality.

[0158] In this way, if not only an object and a field but also various images displayed on the display screen 102, such as icons or windows of application software, have physical quantities and are handled as a body, the movement of the object can be more realistic.

[0159] It should be noted that an object provided with a physical quantity and handled as a body is not limited to an image displayed on the display screen, and may be one end (four sides) of the screen, a user's finger detected with the touch screen, or the like.

[0160] To achieve such a display, images such as icons or windows can be considered as secondary objects, and object IDs, object shapes, physical quantities of the object, or the like can be set in advance. The conditions of the secondary objects can be included in the simulation of the object's movement by the arithmetic section.

[0161] Alternatively, images such as icons or windows can be defined as parts of a field and integrated into field data to be reflected in the simulation of the object's movement.

[0162] It should be noted that not all images, such as icons or windows, are necessarily considered bodies; only predetermined icons or windows can be considered bodies. Alternatively, the object can be displayed moving on these images so that the images are viewed as the background of the object without being viewed as a body. It is also possible for the user to decide whether to view these images as bodies.

[0163] When performing such object movement processing that integrates images such as icons or application software windows or display screen ends as a body, the display of these images and the like is controlled by the operating system; therefore, the processing must be coupled with the operating system. Therefore, by integrating the object display processing process into the operating system as a module, a series of steps of object display processing can be efficiently performed.

[0164] This embodiment can be appropriately combined with any of the other embodiments. Note that the present invention includes within its scope a method, hardware (e.g., an electronic device, a computer, a semiconductor device, or a storage medium), a system, a program, software, and the like in which the operations of the present invention are achieved. (Embodiment 5)

[0165] In this embodiment, display processing in which a specific area of ​​a curved display screen is selected and an object moves only in the area is carried out based on Fig. 18A and Fig. 18B.

[0166] Fig. 18A and Fig. 18B are perspective views of the electronic device 100 in which an object 307 is displayed on a portion of the curved display screen 102. The display screen 102 is curved at the center to have a steep slope from right to left.

[0167] In Fig. 18A, the object 307 is displayed on a high right part (a region 308a) of the curved display screen 102. The object 307 detects the high part of the curved display screen 102, ie, the region 308a, and selectively moves within the region 308a.

[0168] In Fig. 18B, the object 307 is displayed on a lower left part (a region 308b) of the curved display screen 102. The object 307 detects the lower part of the curved display screen 102, ie, the region 308b, and selectively moves into the region 308b.

[0169] Such a display of an object can be used for a home screen or a screen saver of the operating system or various types of application software.

[0170] To perform the above display of an object, the processing procedure described in Embodiment 1 can be used. However, in the object movement mode of the processing procedure, a range in which an object can move must be appropriately defined according to the three-dimensional shape of the display screen 102. Thus, in the object movement mode, for example, the processing procedure described in Fig. 19 is used.

[0171] Fig. 19 is a flowchart showing a processing procedure in an object movement mode 540 in this embodiment, which is obtained by adding several steps to the object movement mode 510. After the object movement mode starts (S080), a range in which the object can move is determined in step S081 based on the data on the three-dimensional shape of the display screen 102 already calculated by the arithmetic section 203.

[0172] In this embodiment, the range within which the object can move is defined as a specific height of the display screen 102. For example, if the center position of the display screen is held as the reference position, a two-dimensional space positioned a specific height above (or below) the reference position may be defined as the range within which the object can move. Alternatively, a three-dimensional space positioned a specific range of heights above (or below) the reference position may be defined as the range within which the object can move. Such a two-dimensional or three-dimensional space may be defined as a value in advance, or a specific space including a range within which an object is displayed may be defined as the range within which the object can move.

[0173] After the range in which the object can move has been determined, the movement of the object within the range is determined in step S082. In simulating the movement of the object at this time, data about the range determined in step S081 is used as constraints. Subsequent processing steps for display and the like (S083 to S089) are similar to those in the object movement mode 510 shown in Fig. 8. Note that in the case where the shape of the display screen 102 is changed during the movement of the object, a range in which the object can move is determined again in step S086, and a display of the movement of the object is overwritten.

[0174] This embodiment can be appropriately combined with any of the other embodiments. Note that the present invention includes within its scope a method, hardware (e.g., an electronic device, a computer, a semiconductor device, or a storage medium), a system, a program, software, and the like in which the operations of the present invention are achieved. (Embodiment 6)

[0175] In this embodiment, a computer game that utilizes a display of an object that moves according to the shape of the display screen is Fig. 20A and Fig. 20B described.

[0176] Fig. 20A and Fig. 20B are perspective views showing the electronic device 100 with images of a computer game displayed on the display screen 102. In Fig. In Figure 20A, the display screen 102 is flat. A river 309 flows through the center of the display screen 102, and a character 310a and a character 310b, which can be controlled by the user, are displayed on the left bank of the river 309. In this computer game, the river 309 flowing through the center prevents the character 310a and the character 310b from crossing to the right bank.

[0177] As in Fig. 20B, the user bends the display screen 102 such that the center of the display screen 102 protrudes downward (the user moves the display screen 102 in the directions indicated by arrows in Fig. 20B), whereby the river 309 moves to the part which is bent downwards, and the two banks are brought closer to each other; thus the character 310a and the character 310b can cross over to the right bank.

[0178] Here, by considering the river 309 as the object described above, the water flow in the river 309 is coupled with the deformation of the display screen 102, allowing the user to feel a sense of reality. In addition, by calculating the shape of the display screen 102 using the sensors 156, the range of movement of the character can be controlled according to the shape.

[0179] To achieve such a computer game, the object display processing operations described in each of Embodiments 1 to 5 can be applied to bodies including characters in the computer game. The object display processing operation can be incorporated as a module in a computer program, or can be performed while being coupled with an operating system in which the object display processing operation is integrated. Such a program, module, or the like can be stored in a computer-readable storage medium such as the auxiliary memory 154 or the main memory 152, or alternatively, such processing means can be implemented in the form of an electronic circuit or mechanical hardware.

[0180] As described above, the game can proceed in response to a change in the shape of the display screen 102, so that the user can enjoy the reality of the computer game.

[0181] This embodiment can be appropriately combined with any of the other embodiments. Note that the present invention includes within its scope a method, hardware (e.g., an electronic device, a computer, a semiconductor device, or a storage medium), a system, a program, software, and the like in which the operations of the present invention are achieved. Explanation of reference symbols

[0182] 100: electronic device, 101: housing, 102: display screen. 103: Home button, 104: Volume control button, 105: Mute button, 106: Microphone, 107: Speaker, 108: Sleep button, 109: Camera, 150: System bus, 151: Processor, 152: Main memory, 153: Memory control, 154: Auxiliary memory, 155: Sensor control, 156: Sensor, 157: Display control, 158: Display device, 159: Power source control, 160: Power source, 161: Communication control, 162: Communication I / F, 163: Sound control, 164: Speaker, 165: Sound output connector, 166: Microphone, 167: Input interface, 168: Chassis switch, 169: Touch screen, 170: Keyboard, 171: Camera, 172: External connector, 173: Output interface, 174: Vibration motor, 180: RAM, 181: ROM, 182: Operating system, 183: Application program, 184: Program module, 185: Program data, 186: BIOS, 187: Display section-physical property data, 188: Sensor property data, 201: Display section, 202: Detection section, 203: Arithmetic section,204: Storage section, 205: Input section, 206: Output section, 250: Item data, 251: Item ID, 252: Item shape, 253: Physical quantity of an item, 254: Item image, 255: Default setting of an item, 260: Field data, 261: Field ID, 262: Field shape, 263: Physical quantity of a field, 264: Field image, 265: Default setting of a field, 301: Item, 302: Item, 303: Item, 304: Icon, 305: Window, 306: Item, 306a: Item, 306b: Item, 307: Item, 308a: Area, 308b: Area, 309: Flow, 310a, Character and 310b: Character.,

[0183] This application is based on Japanese Patent Application Serial No. 2012-109132, filed with the Japan Patent Office on May 11, 2012, the entire contents of which are hereby incorporated by reference.

Claims

[1] Notification procedure comprising the following steps: Determining a three-dimensional shape of a display in a deformed state, the display having flexibility; and Displaying an object (301; 302; 303; 306; 306a; 306b; 307) on the display, wherein the object is displayed such that it moves according to the three-dimensional shape of the display in the deformed state as if the object displayed on the display were attracted by gravity, and wherein a shape of the object is changed according to the three-dimensional shape of the display in the deformed state as if the object displayed on the display is attracted by gravity. [2] A display method according to claim 1, further comprising the step of storing data about the three-dimensional shape of the display. [3] Notification procedure comprising the following steps: detecting position data of a display screen (102), the display screen having flexibility; Determining a three-dimensional shape of the display screen based on the position data; Simulating a movement of an object (301; 302; 303; 306; 306a; 306b; 307) displayed on the display screen; and Determining the movement of the object, wherein the movement of the object is determined by changing the three-dimensional shape of the display screen, wherein the object is displayed in such a way that it moves according to the change in the three-dimensional shape of the display screen, as if the object displayed on the display screen were attracted by gravity, and wherein a shape of the object is changed according to the change of the three-dimensional shape of the display screen, as if the object displayed on the display screen is attracted by gravity. [4] A display method according to claim 3, further comprising the step of storing data about the three-dimensional shape of the display screen. [5] The display method of claim 3, wherein the display screen includes a touch screen (169) thereover. [6] The display method according to claim 5, wherein the touch screen is a resistive type or a capacitive type. [7] Electronic device that includes: a display section configured to display an object (301; 302; 303; 306; 306a; 306b; 307) on a display screen (102), the display screen having flexibility; and an arithmetic section configured to determine a three-dimensional shape of the display screen, wherein the object is displayed in such a way that it moves according to a change in the three-dimensional shape of the display screen, as if the object displayed on the display screen were attracted by gravity, and wherein a shape of the object is changed according to the change of the three-dimensional shape of the display screen, as if the object displayed on the display screen is attracted by gravity. [8] The electronic device according to claim 7, further comprising a detection section (202) configured to detect position data of the display screen, the position data being output to the arithmetic section. [9] The electronic device according to claim 7, further comprising a storage section (204) configured to store data about the three-dimensional shape of the display screen. [10] The electronic device of claim 7, further comprising an input portion (205) comprising a touch screen (169). [11] The electronic device according to claim 10, wherein the touch screen is a resistive type or a capacitive type. [12] The electronic device according to claim 7, wherein the electronic device is an electronic game device.

Images