Information processing apparatus, processing method, computer program product, and readable medium

Abstract

The present disclosure relates to an information processing apparatus, an information processing method, a computer program product, and a computer-readable medium. The information processing apparatus includes a processor that, when displaying electronic information including at least one of a document and an image, displays the electronic information in a form consistent with at least one of a usage status of the electronic information or environmental information representing a surrounding environment of a place where the electronic information is displayed.

Description

Technical Field

[0001] This disclosure relates to an information processing apparatus, an information processing method, and a computer-readable medium. Background Technology

[0002] Japanese Patent Application Publication No. 2000-155709 discloses an electronic document viewing system that can clearly display the parts of a shared electronic document that have been edited by the user since the last viewing, relative to other parts. Summary of the Invention

[0003] For example, electronic information such as electronic documents or e-books can be displayed using e-book readers. When the electronic information is editable, the content displayed before and after editing may differ. However, since only the electronic information itself has changed, only the displayed content differs. Physical changes, such as bent or wet paper, that occur in bound books depending on usage or the surrounding environment of the reading place cannot be reflected in the display of electronic information.

[0004] Therefore, the purpose of this disclosure is to change the display form of electronic information.

[0005] According to a first aspect of this disclosure, an information processing apparatus is provided, including a processor that, when displaying electronic information by executing software capable of displaying electronic information comprising at least one of documents and images, displays the electronic information in a form consistent with at least one of the usage status of the electronic information or environmental information indicating the surrounding environment of the place where the electronic information is displayed.

[0006] According to the second aspect of this disclosure, the usage status of the electronic information includes at least one of the number of times the electronic information is viewed, the number of times the electronic information is forwarded, and the number of times the electronic information is copied. When the usage status of the electronic information exceeds a predetermined threshold, the processor adds predetermined supplementary information to the electronic information and displays the electronic information.

[0007] According to the third aspect of this disclosure, the threshold is provided with multiple stages, and the processor increases the degree of change that causes the form of the displayed electronic information to change from the form before the addition of the additional information as the stage of the threshold is exceeded.

[0008] According to the fourth aspect of this disclosure, the processor displays the electronic information by adding acquisition information consistent with the acquisition result of the acquisition unit, and the acquisition unit acquires at least one of the usage status of the electronic information or the environmental information.

[0009] According to the fifth aspect of this disclosure, the processor, by adding the acquired information, causes the overall form of the displayed electronic information to change from its form before the acquisition information was added.

[0010] According to the sixth aspect of this disclosure, the processor, by adding the acquired information, causes a portion of the displayed electronic information to change its form from the form before the acquisition information was added.

[0011] According to the seventh aspect of this disclosure, when the processor generates environmental information for the display unit displaying the electronic information, it changes the degree of change that alters the form of the displayed electronic information from its form before the acquisition of the information, based on the position of the display unit that generated the environmental information.

[0012] According to the eighth aspect of this disclosure, as the position of the display unit that generated the environmental information, the processor changes the degree of change based on the trajectory of the environmental information from the initial position to the end position of the display unit that generated the environmental information.

[0013] According to the ninth aspect of this disclosure, the processor changes the degree of change that alters the form of the displayed electronic information from its form before the acquisition of the information, based on the acquisition time of at least one of the usage status of the electronic information by the acquisition unit or the acquisition time of the environmental information.

[0014] According to the tenth aspect of this disclosure, when the processor acquires multiple acquisition results, it preferentially uses a form corresponding to the acquisition result with the highest predefined priority to display the electronic information.

[0015] According to the eleventh aspect of this disclosure, the electronic information is an electronic book, and the processor obtains whether there is an advertisement in the environmental information related to the electronic book. If there is an advertisement, the processor adds advertising information consistent with the advertisement and displays the electronic book.

[0016] According to the twelfth aspect of this disclosure, when the processor changes the form of the displayed electronic information in accordance with at least one of the usage status of the electronic information or the environmental information, it restores the form of the displayed electronic information to its state before the change by the fulfillment of a pre-defined condition.

[0017] According to the thirteenth aspect of this disclosure, the change in the form of the electronic information includes: a reversible change that restores the form to its original form upon the fulfillment of the pre-defined conditions; and an irreversible change that does not restore the form to its original form even if the pre-defined conditions are fulfilled.

[0018] According to the fourteenth aspect of this disclosure, a computer-readable medium is provided, which stores a program that causes a computer to perform processing, wherein the processing, when displaying electronic information by executing software capable of displaying electronic information comprising at least one of documents and images, displays the electronic information in a form consistent with at least one of the usage status of the electronic information or environmental information indicating the surrounding environment of the place where the electronic information is displayed.

[0019] According to the fifteenth aspect of this disclosure, an information processing method is provided in which, when displaying electronic information by executing software capable of displaying electronic information comprising at least one of documents and images, the electronic information is displayed in a form consistent with at least one of the usage status of the electronic information or environmental information representing the surrounding environment of the place where the electronic information is displayed.

[0020] (Effect)

[0021] According to the first scheme, the display form of electronic information can be changed.

[0022] According to the second scheme, the form of the displayed electronic information can be changed to a form with pre-defined additional information.

[0023] According to the third scheme, the display form can be changed in stages compared to a structure with a pre-defined threshold of one stage.

[0024] According to the fourth scheme, the form of the displayed electronic information can be changed to include the form of acquiring information.

[0025] According to the fifth scheme, compared to a structure in which the form of a portion of the displayed electronic information changes, the user can easily recognize the surrounding environment of the place where the electronic information is being viewed.

[0026] According to the sixth scheme, compared with a structure in which the overall form of the displayed electronic information changes, the range of changes in the display form of the displayed electronic information can be limited.

[0027] According to the seventh solution, the degree to which the display form of electronic information changes can be altered depending on the position of the display unit that generates the environmental information.

[0028] According to the eighth solution, the degree to which the display form of electronic information changes can be altered based on the trajectory of the environmental information from the initial position to the end position of the display unit that generated the environmental information.

[0029] According to the ninth scheme, the degree to which the display form of electronic information changes can be altered based on the acquisition time.

[0030] According to the tenth scheme, the display form of electronic information can be changed according to priority.

[0031] According to the eleventh scheme, the displayed e-book has a more elaborate form compared to a structure that only displays the text of the e-book.

[0032] According to the twelfth scheme, compared with the structure that still maintains the form of the changed electronic information, the form of the displayed electronic information is increased.

[0033] According to the thirteenth scheme, it is possible to suppress the situation where the body reverts to its original form.

[0034] According to the fourteenth scheme, the display form of electronic information can be changed.

[0035] According to the fifteenth scheme, the display form of electronic information can be changed. Attached Figure Description

[0036] Figure 1 It is a block diagram representing the hardware structure of an information processing device.

[0037] Figure 2 This is a flowchart representing the first step in the electronic information display and processing.

[0038] Figure 3 This is an example of displaying image information without any additional information.

[0039] Figure 4 This is the first example of displaying image information with additional information added.

[0040] Figure 5 This is a second display example of image information with additional information added.

[0041] Figure 6 This is a flowchart representing the second process of electronic information display processing.

[0042] Figure 7 It is the first example of adding electronic data for obtaining information.

[0043] Figure 8 It is a second display example that includes electronic data for obtaining information.

[0044] Figure 9 It is a third display example that includes electronic data for obtaining information.

[0045] Figure 10 This is a fourth display example that includes electronic data for obtaining information.

[0046] Figure 11 This is a flowchart representing the third stage of electronic information display processing.

[0047] Figure 12 This is the first example of an e-book that does not include information retrieval.

[0048] Figure 13 This is the first example of an e-book that provides information.

[0049] Figure 14 This is the second example of an e-book that does not include information retrieval.

[0050] Figure 15 This is a second example of an e-book that provides information.

[0051] Figure 16 This is a third example of an e-book that does not include the information retrieval feature.

[0052] Figure 17 It is a third display example that includes e-books for obtaining information.

[0053] Figure 18 This is a flowchart representing the fourth step in the electronic information display processing.

[0054] Figure 19 This is an example of displaying electronic materials without the information to be obtained.

[0055] Figure 20 This is a fourth display example that includes electronic data for obtaining information.

[0056] Figure 21 This is the first display example showing what it looks like when the camera is taking pictures.

[0057] Figure 22 This is the fifth example, which includes electronic data for obtaining information.

[0058] Figure 23 This is a flowchart representing the fifth step in the electronic information display processing.

[0059] Figure 24 This is an example of an e-book display with added advertising information.

[0060] Figure 25 This is the first example of a view showing an overview of e-books.

[0061] Figure 26 This is a second example of a view showing an overview of e-books.

[0062] Figure 27 This is a flowchart representing the sixth step in the electronic information display processing.

[0063] Figure 28 This is an example of displaying electronic materials published from a data publishing server.

[0064] Figure 29 This is the sixth display example, which includes electronic data for obtaining information.

[0065] Figure 30 This is the seventh display example, which includes electronic data for obtaining information.

[0066] Figure 31 This is the eighth display example, which includes electronic data for obtaining information.

[0067] Figure 32 This is a second display example showing what it looks like when the camera is taking pictures.

[0068] Figure 33 This is the third display example showing what it looks like when the camera is taking pictures.

[0069] Figure 34 This is a display example indicating the end position of the probe when it stops contacting the display.

[0070] Figure 35 This is a display example showing the trajectory L1 of the contact position of the detection unit to the display unit.

[0071] Figure 36 This is a fourth example of displaying e-books for obtaining information.

[0072] Figure 37 This is a display example showing the trajectory L2 of the contact position of the detection unit to the display unit.

[0073] Figure 38 This is the fifth example of adding e-books for obtaining information. Detailed Implementation

[0074] The information processing apparatus 10 of this embodiment will now be described.

[0075] (First Implementation)

[0076] As an example, the information processing device 10 is a mobile terminal such as a smartphone, tablet terminal, or portable personal computer (PC) that can execute software capable of displaying electronic information comprising at least one of documents and images. Hereinafter, the software will be referred to as "specific software." Examples of specific software include document creation software, spreadsheet software, presentation software, image capture software that can capture images using a camera, viewer software that can view data created by document creation software or data captured by image capture software, and software for reading e-books, i.e., an e-book reader.

[0077] Figure 1 This is a block diagram showing the hardware structure of the information processing device 10.

[0078] like Figure 1 As shown, the information processing device 10 includes a central processing unit (CPU) 20, a read-only memory (ROM) 22, a random access memory (RAM) 24, a storage unit 26, an input unit 28, a display unit 30, a detection unit 32, an imaging unit 34, and a communication unit 36. These components are communicatively connected to each other via a bus 38. The CPU 20 is an example of a "processor".

[0079] The CPU 20 is a central processing unit that executes various programs or controls various components. Specifically, the CPU 20 reads programs from the ROM 22 or storage unit 26 and executes the programs using the RAM 24 as the working area. The CPU 20 performs control and various arithmetic operations on the aforementioned structures according to the programs recorded in the ROM 22 or storage unit 26. In the first embodiment, the ROM 22 or storage unit 26 stores an information processing program for displaying electronic information in a form consistent with at least one of the usage status of the electronic information or environmental information indicating the surrounding environment of the location where the electronic information is displayed. Furthermore, the information processing program can be pre-installed in the information processing device 10, stored in a non-volatile storage medium, or distributed via a network for appropriate installation in the information processing device 10. Examples of non-volatile storage media include Compact Disc-Read Only Memory (CD-ROM), optical disks, Hard Disk Drives (HDDs), Digital Versatile Disc Read Only Memory (DVD-ROMs), flash memory, memory cards, etc.

[0080] ROM 22 stores various programs and data. RAM 24 serves as the operating area to temporarily store programs or data. Storage unit 26 includes storage devices such as HDD, solid state drive (SSD), or flash memory, storing various programs including the operating system and various data.

[0081] The input unit 28 is used for various input operations. The display unit 30 is, for example, a liquid crystal display (LCD) that displays various information. Furthermore, the display unit 30 is a touch panel and also functions as the input unit 28.

[0082] The detection unit 32 includes multiple sensors such as a contact sensor, a pressure sensor, an acceleration sensor, a gyroscope sensor, a humidity sensor, and a temperature sensor. Alternatively, the detection unit 32 may include other sensors besides those mentioned above, or it may exclude a portion of the aforementioned sensors.

[0083] Furthermore, the detection unit 32, as an example of an acquisition unit, can detect at least one of the usage status of electronic information or environmental information indicating the surrounding environment of the location where the electronic information is displayed. For example, the usage status of electronic information that the detection unit 32 can detect includes the internal temperature of the information processing device 10, and the environmental information that the detection unit 32 can detect includes contact with the information processing device 10, the pressure and acceleration generated on the information processing device 10, the temperature of the surrounding space of the information processing device 10 (i.e., external temperature), and humidity. Moreover, the definition of "the surrounding area of ​​the location where the electronic information is displayed" in the environmental information definition can be specified in terms of the prefecture or municipality where the information processing device 10 is located when the electronic information is displayed, or it can be specified using the distance of the information processing device 10 from the current location when the electronic information is displayed (e.g., within a 10-kilometer radius). In addition, the environmental information is not limited to the information that can be detected by this detection unit 32, but also includes information captured by the imaging unit 34 (described later) and information that can be acquired via the communication unit 36.

[0084] The imaging unit 34 is, for example, a camera that includes solid-state imaging elements such as charge-coupled devices (CCD) or complementary metal-oxide-semiconductor (CMOS).

[0085] The communication unit 36 ​​is an interface for the information processing device 10 to communicate with other machines. This communication may use wired communication standards such as Ethernet or Fiber Distributed Data Interface (FDDI), or wireless communication standards such as 4G, 5G, or Wi-Fi.

[0086] When executing the information processing program, the information processing device 10 uses the hardware resources to perform processing based on the information processing program.

[0087] Next, the function of the information processing device 10 will be explained.

[0088] Figure 2This is a flowchart illustrating the first process of electronic information display processing performed by the information processing device 10. The CPU 20 reads the information processing program from the ROM 22 or the storage unit 26, expands it in the RAM 24, and executes it, thereby performing electronic information display processing.

[0089] Figure 2 In step S10, as shown, the CPU 20 uses reader software to execute a file containing image information captured by the imaging unit 34. Then, it proceeds to step S11. In the first embodiment, as an example, the electronic information is set as "image information" and the specific software is set as "reader software".

[0090] In step S11, CPU 20 acquires the usage status of image information. Then, proceed to step S12.

[0091] The usage status of image information includes at least one of the following: the number of times the image information is viewed, the number of times the image information is forwarded, and the number of times the image information is copied. These viewing counts, forwarding counts, and copying counts are stored in the storage unit 26, and the stored counts are updated whenever the image information is viewed, forwarded, or copied. In step S11, the CPU 20 retrieves the "viewing counts" from the storage unit 26, for example, as the usage status of the image information.

[0092] In step S12, the CPU 20 determines whether the number of views, representing the usage status of image information, does not exceed a predetermined threshold. If it determines that the number of views does not exceed the predetermined threshold (step S12: Yes), it proceeds to step S13. On the other hand, if the CPU 20 determines that the number of views exceeds the predetermined threshold (step S12: No), it proceeds to step S14. In the first embodiment, when the number of views is 10 or less, the CPU 20 determines that it does not exceed the predetermined threshold.

[0093] In step S13, the CPU 20 displays image information without the pre-defined additional information. Then, the process ends. Details regarding the additional information will be described later.

[0094] Figure 3 This is an example of displaying image information without any additional details. For example... Figure 3 As shown, on the display unit 30, as image information, for example, the captured image 40 taken by the imaging unit 34, namely the first image 40A showing a person and the second image 40B showing a tree, are directly displayed in this form.

[0095] return Figure 2In step S14, the CPU 20 displays image information with the added information. Then, the processing ends. The added information is information that provides the user of the information processing device 10 with a visual effect that makes them feel comfortable using it. Examples of added information include scratches, dirt, wrinkles, cracks, flexing, dents, etc.

[0096] Figure 4 This is the first example of displaying image information with additional details. For example... Figure 4 As shown, on the display unit 30, images are displayed as image information. Figure 3 An image 40 containing the same content is accompanied by a rift display 42. The rift display 42, which is triangular in shape, is displayed at a position where the image 40 overlaps with a portion of the first image 40A. Furthermore, Figure 4 In the example, the captured image 40 is information captured by the imaging unit 34, and the split display 42 is information added by the reader software as supplementary information.

[0097] In the first embodiment, for the overlapping portion of the first image 40A and the cracked display 42, the CPU 20 controls the priority display of the cracked display 42, thereby making only the cracked display 42 identifiable in the overlapping portion. Furthermore, the CPU 20 displays the cracked display 42 in the same color as the background color of the display unit 30. Therefore, Figure 4 In the example shown, in the overlapping portion, a portion of the first image 40A ( Figure 4 The human foot becomes unrecognizable, thus giving the user the impression that the displayed photo has been broken.

[0098] As described above, in the first embodiment, when the CPU 20 executes reader software to display image information, the image information is displayed in a form consistent with the usage status of the image information. Specifically, as a predetermined condition for executing reader software to display image information, when the usage status of the image information exceeds a predetermined threshold, the CPU 20 displays the image information with additional information in a form consistent with the usage status of the image information. Furthermore, in the first embodiment, the image information also reflects changes that might occur if the photograph were printed on photo paper. For example, if the same part of the photograph is touched repeatedly while viewing it, fingerprints or other marks from the user's fingers may adhere to that part and become smudged. In the first embodiment, by adding information such as possible changes that might occur with the photograph as described above, as additional information that provides the user of the information processing device 10 with a visual effect that enhances their experience of using the device, these possible changes are also reflected in the image information.

[0099] Therefore, according to the first embodiment, the display format of the image information can be changed. Furthermore, according to the first embodiment, the format of the displayed image information can be changed to a format with added information.

[0100] In addition, in the first embodiment, in step S11, the "number of views" is obtained from the storage unit 26 as the usage status of the image information, but the usage status of the image information obtained here is not limited to the "number of views". In step S11, as the usage status of the image information, it is sufficient to obtain at least one of the number of views, the number of forwards, and the number of copies. For example, the number of forwards can also be obtained, as well as the number of views and the number of forwards.

[0101] In the first embodiment, by overlaying the crack display 42 as additional information onto the captured image 40, in the overlapping portion, a portion of the first image 40A ( Figure 4 The human foot becomes unrecognizable. However, this is not the only possibility; as additional information, a portion of the captured image 40 can also be removed, and in the removed portion, a portion of the first image 40A (…) Figure 4 The human foot becomes unrecognizable. That is, the addition of additional information is not limited to overlaying other images onto the captured image 40, but can also be to remove a part of the captured image 40.

[0102] (Second Implementation)

[0103] Next, for the second embodiment, the parts that are repeated with other embodiments will be omitted or simplified and will be described.

[0104] The second embodiment differs from the first embodiment in that it has multiple stages for the pre-defined threshold of image information usage. Specifically, the threshold has two stages: a first threshold and a second threshold that is larger than the first threshold. In the second embodiment, the first threshold is set to ten times, and the second threshold is set to twenty times. Furthermore, in the second embodiment, as the threshold exceeds a certain stage, the CPU 20 increases the degree to which the form of the displayed image information changes from its form before the addition of additional information.

[0105] For example, in the second embodiment, if CPU 20 is in Figure 2 In step S12, if the usage status of image information (e.g., number of views) exceeds the first threshold but is below the second threshold, then... Figure 4 The image information is displayed in the form shown. That is, at this time, the image information is displayed in a form with the added information of the crack display 42 (see reference). Figure 4 ).

[0106] Furthermore, in the second embodiment, if CPU 20 is in Figure 2In step S12, if the usage of image information (e.g., number of views) exceeds the second threshold, then... Figure 5 The image information is displayed using the shapes shown.

[0107] Figure 5 This is a second display example of image information with additional details added. For example... Figure 5 As shown, on the display unit 30, images are displayed as image information. Figure 3 and Figure 4 Image 40, a captured image containing the same content, and a rupture display 42 and a rupture display 44. The triangular rupture display 44 is displayed at a position where the captured image 40 overlaps with a portion of the second image 40B. Furthermore, Figure 5 In the example, the captured image 40 is information captured by the imaging unit 34, and the shattered display 42 and shattered display 44 are information added by the reader software as supplementary information.

[0108] Similar to the overlap between the first image 40A and the cracked display 42 (hereinafter referred to as the "first overlap"), the CPU 20 also controls the priority display of the cracked display 44 in the overlap between the second image 40B and the cracked display 44 (hereinafter referred to as the "second overlap"). Thus, in the second overlap, only the cracked display 44 becomes identifiable. Furthermore, the CPU 20 displays the cracked display 44 in the same color as the background color of the display unit 30. Therefore, Figure 5 In the explicit example, in the first overlapping portion, a portion of the first image 40A ( Figure 5 The human foot in the middle becomes unrecognizable in the second overlapping part, a portion of the second image 40B ( Figure 5 The roots of the tree become unrecognizable, thus giving the user the impression that multiple parts of the displayed photo have been broken.

[0109] As explained above, in the second embodiment, as the usage of image information exceeds a predetermined threshold, the displayed broken display increases, and the area of ​​the captured image 40 recognizable on the display unit 30 decreases, thereby increasing the degree of variation of the displayed image information. Therefore, according to the second embodiment, compared to a structure where the threshold is a single stage, the display form of the image information can be changed in stages.

[0110] In addition, in the second embodiment, two stages, a first threshold and a second threshold, are provided as thresholds for multiple stages, but it is not limited to this, and the thresholds may be set to three or more stages.

[0111] In the second embodiment, the crack display 44 is superimposed on the captured image 40 as additional information, thereby making a portion of the second image 40B (in the superimposed portion) appear as additional information. Figure 5 The root of the tree in the middle becomes unrecognizable. However, this is not the only possibility; as additional information, a portion of the captured image 40 can also be removed, and in the removed portion, a portion of the second image 40B (…) Figure 5 The roots of the tree (in the middle) became unrecognizable.

[0112] (Third Implementation)

[0113] Next, for the third embodiment, the parts that are repeated with other embodiments will be omitted or simplified and will be described.

[0114] The third embodiment differs from the aforementioned embodiments. When displaying electronic information by executing specific software, the CPU 20 displays the electronic information in a form consistent with the environmental information. In the third embodiment, the environmental information is set as information that can be obtained via the communication unit 36, specifically, weather information described later.

[0115] Figure 6 This is a flowchart representing the second process of electronic information display processing performed by the information processing device 10.

[0116] Figure 6 In step S20, CPU 20 uses reader software to execute a file containing electronic data created using presentation software. Then, it proceeds to step S21. In the third embodiment, as an example, electronic information is defined as "electronic data," and specific software is defined as "reader software."

[0117] In step S21, CPU 20 acquires the communication result from communication unit 36. Then, it proceeds to step S22. In the third embodiment, CPU 20 acquires weather information within a 5-kilometer grid of the location where electronic data is to be displayed, received from the weather server via communication unit 36, as the communication result of communication unit 36. Furthermore, the location where electronic data is to be displayed is determined based on the Global Positioning System (GPS) information of information processing device 10. Moreover, communication unit 36 ​​is an example of an "acquisition unit," and communication result is an example of an "acquisition result."

[0118] In step S22, the CPU 20 displays electronic data containing acquired information consistent with the communication result of the communication unit 36. Then, the process ends.

[0119] Figure 7 This is an example of adding electronic data for obtaining information as the first display. For example... Figure 7As shown, the display unit 30 displays a first data image 50, a raindrop display 52, and a page number display 54 as electronic data. The first data image 50 displays "the number of units sold for each season of product A" in tabular format. The raindrop display 52, which includes multiple wavy lines, is displayed in the lower left corner of the display unit 30. The page number display 54, indicating the page number, is displayed in the upper right corner of the display unit 30. Figure 7 The text indicates "1 / 5 page". Furthermore, Figure 7 In the example, the first data image 50 and the page number display 54 are information created using presentation software, and the raindrop display 52 is information added using reader software to obtain information.

[0120] In this third embodiment, if the weather information obtained in step S21 is rain, the CPU 20 displays the electronic data along with the raindrop display 52. ​​Therefore, in this third embodiment, it is expected that the viewed... Figure 7 The example displayed shows that the weather around the place where the user is reading electronic materials is rainy.

[0121] As described above, in the third embodiment, when the CPU 20 displays electronic data while executing reader software, it also displays the electronic data by adding acquisition information consistent with the communication result of the communication unit 36. Therefore, according to the third embodiment, the form of the displayed electronic data can be changed to include the acquisition information. Furthermore, in the third embodiment, the electronic data also reflects the changes that might occur with paper data. For example, when reading paper data outdoors on a rainy day, the paper data may sometimes get wet. In the third embodiment, a raindrop display 52 is added as an acquisition information display, thereby reflecting the changes that might occur with paper data as described above in the electronic data.

[0122] Furthermore, in the third embodiment, the CPU 20 changes the overall form of the displayed electronic data from its form before the acquisition information is added by adding the acquisition information.

[0123] Figure 8 This is an example of adding a second display of electronic materials for obtaining information. For example... Figure 8 As shown, the display unit 30 displays a second data image 56, a raindrop display 52, and a page number display 54 as electronic data. The second data image 56 displays the "analysis results" of "the number of units sold for each season of product A". Furthermore, in... Figure 8 In the example, the second data image 56 and the page number display 54 are information created using presentation software, while the raindrop display 52 is information added using reader software to obtain information.

[0124] Here, Figure 8The page number 54 shown is displayed as "page 2 / 5", indicating that it is... Figure 7 The next page will display the example. Furthermore, Figure 8 In the example, as the page changes, the display content in the center of the display unit 30 changes from the first data image 50 (refer to...). Figure 7 The image was changed to the second data image 56. However, Figure 8 In the example, even after page changes, it still displays the same as before. Figure 7 The same raindrop display shows 52.

[0125] That is, in the third embodiment, when the CPU 20 is used to acquire information and display electronic data, the raindrop display 52, which is used for acquiring information, is displayed on all pages of the electronic data. Furthermore, in the third embodiment, the illustration of the display example after "page 3 / 5" is omitted, but the raindrop display 52 is also displayed on these pages.

[0126] According to the third embodiment, the above structure allows the user to easily recognize the surrounding environment of the place where the electronic data is being viewed, compared to a structure where the form of a portion of the displayed electronic data changes.

[0127] Furthermore, in the third embodiment, only weather-related information such as "rain" is acquired as weather information, but the weather information acquired here is not limited to "weather-related information." Specifically, in addition to weather-related information such as "rain" and "sunny," the weather information also includes information such as temperature, humidity, and wind speed. Moreover, in the third embodiment, as weather information, it is sufficient to acquire at least one of the aforementioned information; for example, temperature information can also be acquired, as well as both temperature and humidity information.

[0128] In the third embodiment, a raindrop display 52 is added to display electronic data, thereby suggesting to the user the weather around the location where the electronic data is being viewed. However, the method of suggesting the weather is not limited to this. For example, as information acquisition, the CPU 20 may replace the raindrop display 52 or, in addition to the raindrop display 52, mark the display unit 30 with a color corresponding to the weather information. Specifically, if the weather information acquired in step S21 is rain, the CPU 20 may display the background of the display unit 30 in "blue" to acquire the information, or if the weather information is sunny, it may display the background of the display unit 30 in "red" to acquire the information. In this way, the weather around the location where the electronic data is being viewed can also be suggested to the user based on the color of the background of the display unit 30. Moreover, if the weather information acquired in step S21 is rain, the CPU 20 may also change the display form of the graphics or text displayed in the electronic data to give the impression that the electronic data has been swollen and softened.

[0129] Furthermore, in the third embodiment, the temperature around the location where the electronic data is being viewed can be implied to the user by changing the speed at which the electronic data is being fed to the page. For example, if the temperature obtained based on weather information is below a predetermined temperature (0°C), the speed at which the electronic data is fed to the page can be slower than if the temperature exceeds the predetermined temperature (0°C). Similarly, the number of pages turned can be changed when a page feeding instruction is issued. For example, it can be configured such that if the electronic data is displayed in an environment where the weather information indicates rain and the surroundings are wet, more pages are turned than if the electronic data is displayed in a sunny environment where the surroundings are dry. Thus, it is expected that the user will be given the impression that multiple pages are being turned together because they are wet from rain.

[0130] In the third embodiment, displaying raindrops 52 on all pages of the electronic document as a means of acquiring information is taken as an example of "a change in the overall form of the electronic information," but this example is not limited to this. For example, changing the background color of the entire page of the electronic document being viewed to acquire information may also be taken as an example of "a change in the overall form of the electronic information."

[0131] (Fourth Implementation)

[0132] Next, for the fourth embodiment, the parts that are repeated with other embodiments will be omitted or simplified and will be described.

[0133] Figure 9 This is an example of adding a third display of electronic information for obtaining data. For example... Figure 9 As shown, on the display unit 30, electronic data is displayed, including... Figure 7 The first data image 50, page number display 54, raindrop display 52, and raindrop display 58 all contain the same content. The raindrop display 58, which includes multiple ripples, is displayed in the lower right corner of the display unit 30. Furthermore, Figure 9 In the example, the first data image 50 and the page number display 54 are information created using presentation software, while the raindrop display 52 and the raindrop display 58 are information added using reader software to obtain information.

[0134] In this fourth embodiment, the CPU 20 adjusts the degree of change in the form of the displayed electronic data from its state before the acquisition of the weather information obtained via the communication unit 36, based on the acquisition time of the weather information. Specifically, the CPU 20 adjusts the degree of change by adding raindrop displays when the weather information obtained via the communication unit 36 ​​remains unchanged for a predetermined time period (e.g., ten minutes).

[0135] For example, if the weather information acquired by CPU 20 at time T1 is rain, it will add raindrop display 52 and display electronic data (see reference). Figure 7 Furthermore, if the weather information from time T1 until time T2, after a predetermined time (e.g., ten minutes) is rainy, the CPU 20 further adds a raindrop display 58 and displays electronic data (see reference). Figure 9 ).

[0136] Based on the above structure and the fourth embodiment, the degree of change in the form of the displayed electronic data from the form before the acquisition of the weather information obtained via the communication unit 36 ​​is adjusted according to the acquisition time.

[0137] In the fourth embodiment, the time of obtaining weather information is determined by the continuous duration of a specific event, namely, "no change in weather information within a predetermined time period (e.g., ten minutes)". However, it is not limited to this; the cumulative duration of a specific event can also be used for determination. For example, if the weather information "rain occurs for ten minutes out of thirty minutes" is obtained, even if the rain duration is not continuous within the predetermined time period (e.g., ten minutes), it is still considered that the rain duration has accumulated within the predetermined time period, and the degree of change in the displayed electronic data is changed.

[0138] (Fifth implementation method)

[0139] Next, for the fifth embodiment, the parts that are repeated with other embodiments will be omitted or simplified and will be described.

[0140] In the fifth embodiment, the same usage as in the third embodiment is performed. Figure 6 The flowchart shown illustrates electronic information display processing, but the communication result of the communication unit 36 ​​in step S21 differs from that in the third embodiment. In the fifth embodiment, the environmental information is set as information obtainable via the communication unit 36; specifically, it is GPS information, as described later.

[0141] In the fifth embodiment, Figure 6 In step S21 shown, the CPU 20 obtains the GPS information of the information processing device 10 via GPS communication as the communication result of the communication unit 36.

[0142] Figure 10 This is an example of adding a fourth display for obtaining electronic information. For example... Figure 10 As shown, on the display unit 30, electronic data is displayed, including... Figure 7 The first data image 50, page number display 54, and shadow display 59 all contain the same content. The triangular shadow display 59 is displayed in the lower left corner of the display unit 30. Furthermore, Figure 10In the example, the first data image 50 and the page number display 54 are information created using presentation software, and the shadow display 59 is information added using reader software to obtain information.

[0143] In the fifth embodiment, the CPU 20 displays the shadow display 59 in a color different from the background color of the display unit 30, thereby representing a shadow. Therefore, Figure 10 In the example, by displaying the shadow 59, it is possible to give the user the impression that there is a shadow reflected in the displayed material.

[0144] Furthermore, in the fifth embodiment, the electronic data also reflects the variations that might occur with paper documents. For example, when reading paper documents outdoors on a sunny day, shadows may sometimes be cast on the paper documents. In the fifth embodiment, a shadow display 59 is added as a means of acquiring information, thereby reflecting in the electronic data the variations that might occur with paper documents as described above.

[0145] In addition, in the fifth embodiment, the CPU 20 displays the shadow display 59 based on the GPS information of the information processing device 10, but it is also possible to display the shadow display 59 based on other factors instead of this or other factors. Examples of such other factors include the time of reading electronic materials, image information captured by the camera unit 34, etc.

[0146] (Sixth Implementation Method)

[0147] Next, for the sixth embodiment, the parts that are repeated with other embodiments will be omitted or simplified and will be described.

[0148] The sixth embodiment differs from the aforementioned embodiments. When displaying electronic information by executing specific software, the CPU 20 adds acquisition information consistent with the detection result of the detection unit 32 and displays the electronic information. In the sixth embodiment, the environmental information is defined as information that can be detected by the detection unit 32; specifically, it is defined as the presence or absence of contact with the display unit 30 from the outside, as described later. Furthermore, the detection unit 32 is an example of an "acquisition unit," and the detection result is an example of an "acquisition result."

[0149] Figure 11 This is a flowchart representing the third process of electronic information display processing performed by the information processing device 10.

[0150] Figure 11 In step S30, as shown, CPU 20 uses an e-book reader to execute a file containing an e-book published from a content publishing server. Then, it proceeds to step S31. In the sixth embodiment, as an example, electronic information is designated as "e-book," and specific software is designated as "e-book reader."

[0151] In step S31, the CPU 20 determines whether there is no detection by the detection unit 32. If it determines that there is no detection (step S31: yes), it proceeds to step S32. On the other hand, if the CPU 20 determines that there is detection (step S31: no), it proceeds to step S33.

[0152] In step S32, CPU 20 displays the e-books for which no information has been acquired. Then, the process ends.

[0153] Figure 12 This is the first example of an e-book that does not include information retrieval. For example... Figure 12 As shown, on the display unit 30, the text display 60, representing the main text of an e-book, is directly displayed in this format. Furthermore, Figure 12 In the text, the phrase "Good morning." is displayed alongside the dotted line surrounding it as the main text. Furthermore, Figure 12 The image shows a finger display F, which schematically represents the user's finger.

[0154] return Figure 11 In step S33, the CPU 20 displays the e-book containing the acquired information. Then, the process ends.

[0155] Figure 13 This is an example of an e-book that provides information. For example... Figure 13 As shown, on the display unit 30, as an electronic book, there is a display with... Figure 12 The same content is displayed as both text (60) and a breakout display (62). The triangular breakout display (62) is displayed in the lower left corner of the display unit 30. Furthermore, Figure 13 In the explicit example, the body text 60 shows information published from the content publishing server, while the broken text 62 shows information added by an e-book reader when retrieving information.

[0156] The breakage indicator 62 is displayed when the detection unit 32 detects contact with the display unit 30 from the outside. For example, Figure 13 In the explicit examples, when in Figure 12 In the state shown in the display example, when the user's finger touches the lower left part of the display unit 30, the detection unit 32 detects the contact, and the CPU 20 adds a cracked display 62 that matches the detection result of the detection unit 32 to display the electronic book.

[0157] In this sixth embodiment, a plurality of detection units 32 are provided to detect the contact between the display unit 30 and the detection area. For example, it is conceivable that the detection area be the upper left part of the display unit 30, i.e., the first detection area; the upper right part of the display unit 30, i.e., the second detection area; the left center part of the display unit 30, i.e., the third detection area; the right center part of the display unit 30, i.e., the fourth detection area; the lower left part of the display unit 30, i.e., the fifth detection area; and the lower right part of the display unit 30, i.e., the sixth detection area.

[0158] Furthermore, the CPU 20 causes the fracture display 62 to appear at a position corresponding to the detection area where the detection unit 32 detects contact with the display unit 30. For example, Figure 13 This is an example of a display when a user's finger touches the fifth detection area. In this example, the CPU 20 adds a broken display 62 to the lower left of the display unit 30 to display an e-book. Furthermore, in the sixth embodiment, illustrations are omitted, but for example, when... Figure 13 In the state shown in the example display, when the user's finger touches the sixth detection area, the CPU 20 causes other crack displays to be further displayed in the lower right corner of the display unit 30. Furthermore, in the sixth embodiment, the page displaying the crack display 62 is only in... Figure 11 In step S31, the CPU 20 determines that the page is displayed when there is a probe, but does not display any subsequent pages.

[0159] As described above, in the sixth embodiment, the CPU 20 acquires information, thereby changing the form of a portion of the displayed e-book from its form before acquiring the information. Therefore, according to the sixth embodiment, compared to a structure where the overall form of the displayed e-book changes, the range of changes in the display form of the displayed e-book can be limited.

[0160] Furthermore, in the sixth embodiment, similar to the aforementioned embodiments, by displaying the broken display 62 as information on the electronic book, a portion of the electronic book becomes unrecognizable in the displayed portion. However, this is not a limitation; as information acquisition, a portion of the electronic book can also be removed, making that portion unrecognizable. That is, adding information is not limited to overlaying other images onto a portion of the electronic book; it can also involve removing a portion of the electronic book.

[0161] In the sixth embodiment, only Figure 11In step S31, the CPU 20 determines that when a probe is detected, the page displays a broken display 62 as information acquisition. This is considered an example of "a change in the form of a part of electronic information," but this example is not limited to it. For example, even if information is displayed on all pages of an e-book, as long as the form of only a part of a page is changed, as in the case of broken display 62, it is included in "a change in the form of a part of electronic information."

[0162] In the sixth embodiment, the crack display 62 is displayed when the detection unit 32 detects contact with the display unit 30 from the outside. However, the detection unit 32 can also further detect the pressure caused by the contact and change the degree of change that alters the form of the e-book from its form before information acquisition based on the detected pressure. For example, the CPU 20 can also make the area and shape of the displayed crack display 62 different when the pressure detected by the detection unit 32 is above a predetermined threshold and when it is below the threshold.

[0163] (Seventh Implementation)

[0164] Next, for the seventh embodiment, the parts that are repeated with other embodiments will be omitted or simplified and will be described.

[0165] Figure 14 This is a second example of an e-book display without the information retrieval feature. For example... Figure 14 As shown, on the display unit 30, as an electronic book, and Figure 12 For text with the same content, display 60 directly in this format. Furthermore, Figure 14 In this case, by displaying the finger indicator F in the left center of the display unit 30, it is indicated that the user's finger has touched the area in the left center of the display unit 30, which is the third detection area.

[0166] Figure 15 This is a second display example that includes e-books for accessing information. For example... Figure 15 As shown, on the display unit 30, as an electronic book, there is a display with... Figure 14 The same content is displayed as text 60 and a breakout display 64. The circular breakout display 64 is displayed in the left center of the display section 30. Furthermore, Figure 15 In the explicit example, the body text 60 shows information published from the content publishing server, while the broken text 64 shows information added by an e-book reader when retrieving information.

[0167] Here, in the seventh embodiment, when the detection unit 32 detects contact with the display unit 30 to generate environmental information about the display unit 30, the CPU 20 changes the degree of change that alters the form of the displayed e-book from its form before the information was acquired, based on the position of the display unit 30 where the detection unit 32 detected contact with the display unit 30.

[0168] For example, in the seventh embodiment, when the user's finger touches the lower left area of ​​the display unit 30, i.e., the fifth detection area, the CPU 20 displays a crack display 62 (see figure 62) on the lower left of the display unit 30, similar to the sixth embodiment. Figure 13 Furthermore, in the seventh embodiment, when the user's finger touches the area of ​​the left center of the display unit 30, i.e., the third detection area, the CPU 20 displays a cracked display 64 in the left center of the display unit 30 (see reference). Figure 15 ).

[0169] In the seventh embodiment, when the detection unit 32 detects contact with the third detection area and when it detects contact with the fifth detection area, the area and shape of the displayed crack display 62 and crack display 64 are made different, thereby changing the degree of change of the displayed e-book.

[0170] According to the seventh embodiment, based on the above structure, the position of the display unit 30 that is in contact with the display unit 30 is detected by the detection unit 32, and the degree of change that alters the form of the displayed e-book from its form before information acquisition is added is changed.

[0171] Furthermore, in the seventh embodiment, the electronic book also reflects the variations that might occur with a bound book. For example, in such a book, sometimes the ends of the paper are easily torn, but the center of the paper is less likely to tear than the ends. In the seventh embodiment, the degree of variation of the displayed electronic book is changed based on the position of the display unit 30 detected by the detection unit 32 as it contacts the display unit 30, thereby reflecting the variations that might occur with a book as described above in the electronic book.

[0172] Furthermore, in the seventh embodiment, similar to the aforementioned embodiments, the broken display 64 is displayed on the e-book as information acquisition, thereby making a portion of the e-book unreadable in the displayed portion. However, it is not limited to this; as information acquisition, a portion of the e-book can also be removed, making that portion of the e-book unreadable in the removed portion.

[0173] (Eighth Implementation)

[0174] Next, for the eighth embodiment, the parts that are repeated with other embodiments will be omitted or simplified and will be described.

[0175] Figure 16 This is a third-party example of an e-book that does not include the information retrieval feature. For example... Figure 16 As shown, on the display unit 30, as an electronic book, and Figure 12 For text with the same content, display 60 directly in this format. Furthermore, Figure 16 In the middle, a canned beverage D containing a hot beverage is placed on the upper part of the display section 30.

[0176] Figure 17 This is an example of adding a third display for e-books that provide information. For example... Figure 17 As shown, on the display unit 30, as an electronic book, there is a display with... Figure 16 The same text content is displayed on display 60 and trace display 66. The trace display 66, in a semi-circular shape, is displayed on the upper part of the display unit 30. Furthermore, Figure 17 In the explicit example, the text shows that 60 is information published from a content publishing server, while the traces show that 66 is information added by an e-book reader when retrieving information.

[0177] In the eighth embodiment, CPU 20 only makes Figure 16 The portion of the canned beverage D placed inside that overlaps with the display unit 30 is displayed as a trace of the canned beverage D, i.e., a trace display 66. Therefore, Figure 17 In the example, by displaying trace 66, it is possible to give the user the impression that there is trace of canned beverage D in the image of the displayed e-book.

[0178] In addition, the processing of whether CPU 20 displays trace display 66 can be implemented, for example, in the following manner.

[0179] For example, the CPU 20 determines whether to display the trace of the canned beverage D, i.e., the trace display 66, based on the temperature of the object in contact with the display unit 30 detected by the detection unit 32 (hereinafter referred to as the "object temperature"). If the object temperature is within a predetermined range (e.g., between 35°C and 40°C), the CPU 20 determines that the user's finger has touched the display unit 30 and does not display the trace of the contacted object. On the other hand, if the object temperature is outside the predetermined range (e.g., 10°C or 60°C), the CPU 20 determines that the canned beverage D has touched the display unit 30 and displays the trace of the contacted object as the trace display 66.

[0180] Furthermore, in the eighth embodiment, the electronic book also reflects changes that might occur with a bound book. For example, if a canned beverage D is placed on the book, the book may dent due to the weight of the canned beverage D. In the eighth embodiment, a trace display 66 for acquiring information is added, thereby reflecting changes that might occur with a book as described above in the electronic book.

[0181] In the eighth embodiment, the CPU 20 determines whether to display the trace display 66 based on the object's temperature. However, it is also possible to determine whether to display the trace display 66 based on other factors, or alternatively. Examples of such other factors include the object's contact time, shape, weight, and image information captured by the imaging unit 34.

[0182] (Ninth Implementation)

[0183] Next, for the ninth embodiment, the parts that are repeated with other embodiments will be omitted or simplified and will be described. The environmental information in the ninth embodiment is information that can be obtained via the communication unit 36, specifically, weather information described later and image information captured by the imaging unit 34.

[0184] Figure 18 This is a flowchart representing the fourth process of electronic information display processing performed by the information processing device 10.

[0185] Figure 18 In step S40, as shown, CPU 20 uses reader software to execute a file containing electronic data created using document creation software. Then, it proceeds to step S41. In the ninth embodiment, as an example, electronic information is defined as "electronic data," and specific software is defined as "reader software."

[0186] In step S41, CPU 20 acquires the communication result from communication unit 36. Then, it proceeds to step S42. In the ninth embodiment, CPU 20 acquires weather information within a 5 km grid of the location where electronic data is to be displayed, received from the weather server via communication unit 36, as the communication result of communication unit 36.

[0187] In step S42, the CPU 20 displays electronic data containing acquired information consistent with the communication result of the communication unit 36. Then, it proceeds to step S43.

[0188] In step S43, the CPU 20 acquires the image capture result from the imaging unit 34. Then, it proceeds to step S44. In the ninth embodiment, in step S43, the CPU 20 executes image capture software, and the imaging unit 34 captures images of the area around the location where the user is viewing electronic materials. Furthermore, the CPU 20 acquires the image information captured by the imaging unit 34 as the image capture result of the imaging unit 34. Additionally, the imaging unit 34 is an example of an "acquisition unit," and the image capture result is an example of an "acquisition result."

[0189] In step S44, the CPU 20 preferentially displays the electronic data using a format corresponding to the pre-defined high-priority information being acquired. Then, the process ends.

[0190] The following is for Figure 18 The example of electronic information display processing shown uses... Figures 19 to 22 Let me explain.

[0191] Figure 19 This is an example of displaying electronic materials without the information being retrieved. For example... Figure 19 As shown, on the display unit 30, meeting minutes display 70, which represents meeting minutes created using document creation software, is displayed directly in this format as electronic data. Furthermore, Figure 19 In the middle, the text "Meeting Minutes" and other text outside the text are indicated by dotted lines to represent the meeting minutes 70.

[0192] And, when in Figure 19 When processing step S42 during the viewing of the display example, the electronic data is in the form of... Figure 20 It changes as shown.

[0193] Figure 20 This is an example of adding a fourth display for obtaining electronic information. For example... Figure 20 As shown, on the display unit 30, electronic data is displayed. Figure 19 The meeting minutes shown in the image have text bleeding display 70, and the resulting text bleeding display 72 and raindrop display 74 are also shown. Figure 20 In the middle, as an infiltration indicator 72, through the analysis of... Figure 19 The text in the meeting minutes displayed on screen 70 is surrounded by color to represent text bleeding. Raindrop patterns with multiple ripples, display 74, are shown in the lower left corner of display unit 30. Furthermore, Figure 20 In the example, the seepage display 72 and the raindrop display 74 are information added by the reader software to obtain information.

[0194] Here, in the ninth embodiment, if the weather information obtained in step S41 is rain, the CPU 20 displays electronic data in step S42 by adding a seepage display 72 and a raindrop display 74. Therefore, in the ninth embodiment, it is expected that the viewer will be able to... Figure 20 The example displayed shows that the weather around the place where the user is reading electronic materials is rainy.

[0195] Figure 21 This is the first display example showing what the camera unit 34 is capturing. For example... Figure 21 As shown, the display unit 30 displays a shooting image 76 representing an image being captured and a shutter button 78 for capturing the image.

[0196] Here, during the image capture by the imaging unit 34, the CPU 20 performs known image recognition processing on the captured image 76 to identify objects in the image. For example, the CPU 20... Figure 21 In the case shown, the result of image recognition processing is that the object in the photo is identified as a "fire basin".

[0197] In the ninth embodiment, the ROM 22 or the storage unit 26 stores visual effects corresponding to various objects in advance as information for acquiring electronic data. For example, the ROM 22 or the storage unit 26 stores information such as "make the displayed raindrop display 74 dry and disappear" as a visual effect corresponding to objects associated with "fire" such as braziers and stoves.

[0198] And, when in Figure 20 During the viewing of the display example, when performing steps S43 and S44, the electronic data is in the following format: Figure 22 The changes are as shown. For example, in step S43, the CPU 20 obtains the information "the displayed raindrop display 74 has dried and been eliminated" from the ROM 22 or the storage unit 26 as a visual effect corresponding to the object "fire pit" acquired as a result of the imaging unit 34. Subsequently, in step S44, the CPU 20 prioritizes displaying the electronic data showing that the displayed raindrop display 74 has been eliminated, using a mode corresponding to the higher priority acquired information. This will be explained in detail below.

[0199] Figure 22 This is a fifth display example that includes access to electronic information. For example... Figure 22 As shown, on the display unit 30, only data related to electronic information is displayed. Figure 20 Displaying 72 instances of the same content seeping in. That is, in Figure 22 In the explicit examples, with Figure 20 The display examples differ; 74 is displayed when raindrops are not shown. Therefore, in Figure 22In the explicit examples, by from Figure 20 The display example eliminates the raindrop display 74, thus giving the user the impression that the data has dried after being soaked in water.

[0200] Thus, in the ninth embodiment, when the CPU 20 acquires multiple results, such as the communication result from the communication unit 36 ​​and the image capture result from the imaging unit 34, it prioritizes displaying the electronic data in a format corresponding to the result with the highest priority among the multiple results. In the ninth embodiment, for example, the image capture result from the imaging unit 34 is given higher priority than the communication result from the communication unit 36. Therefore, in the ninth embodiment, when the CPU 20 acquires an image capture result 76 (associated with fire and associated with water) after displaying a raindrop display 74 (associated with water and associated with raindrops), and uses this image capture result as the image capture result from the imaging unit 34, it prioritizes displaying the electronic data (without the raindrop display 74) in a format corresponding to the image capture result from the imaging unit 34. Figures 20 to 22 ).

[0201] In other words, the ninth embodiment can also be described as follows: After the CPU 20 changes the form of the displayed electronic data based on the communication result of the communication unit 36, it restores the form of the displayed electronic data to its state before the change by acquiring the imaging result of the imaging unit 34, which has a higher priority than the communication result of the communication unit 36. Furthermore, acquiring the imaging result of the high-priority imaging unit 34 is an example of "the fulfillment of a pre-defined condition".

[0202] Based on the above structure and according to the ninth embodiment, when the multiple results are obtained, the display format of the electronic data is changed according to a predetermined priority. Furthermore, according to the ninth embodiment, compared to a structure that maintains the format of the electronic data after the change, the displayed format of the electronic data is enhanced.

[0203] Here, in the ninth embodiment, when electronic data is displayed in a form corresponding to the image capture result of the high-priority imaging unit 34, it is also displayed that... Figure 20 as well as Figure 22 The same content is displayed in the middle as seepage display 72. Thus, in the ninth embodiment, there are: a reversible change that restores the form before the change due to the acquisition of the shooting result of the high-priority shooting unit 34, and an irreversible change that does not restore the form before the change even if the shooting result of the shooting unit 34 is acquired.

[0204] In the ninth embodiment, relative to Figure 19 The display example is shown Figure 20 The raindrop shown represents a change of 74 that is equivalent to a reversible change, from Figure 19 The meeting minutes shown indicate 70 directions Figure 20The change shown in the seepage display 72 is equivalent to an irreversible change. Furthermore, in the ninth embodiment, the changes that might occur in paper documents are also reflected in electronic documents. Specifically, in paper documents, when blank areas without text or images are soaked in water, they will return to their original form if the water is dried; therefore, this change is also reflected in the electronic documents as a reversible change. Moreover, in paper documents, when areas with text or images are soaked in water, even if the water is dried, the soaked text will not return to its original form; therefore, this change is also reflected in the electronic documents as an irreversible change.

[0205] With the above structure, according to the ninth embodiment, it is possible to limit the situation where the electronic data is restored to its original display form.

[0206] Furthermore, in the ninth embodiment, the electronic data also reflects the changes that might occur with paper data, but it is not limited to this. It is also possible to set the changes that might occur with the paper data reflected in the electronic data on the user side. For example, in the ninth embodiment, from... Figure 19 The meeting minutes shown indicate 70 directions Figure 20 The change in the seepage display 72 shown is set to an irreversible change, but it can also be set to a reversible change by the user.

[0207] In the ninth embodiment, the imaging result of the imaging unit 34 is given higher priority than the communication result of the communication unit 36, but the method for determining the priority is not limited. For example, the communication result of the communication unit 36 ​​may be given higher priority than the imaging result of the imaging unit 34, or the information associated with "water" may be given higher priority than the information associated with "fire". That is, in the ninth embodiment, when multiple results such as the communication result of the communication unit 36 ​​and the imaging result of the imaging unit 34 are obtained, the order of the changes and the final priority of the form corresponding to the multiple results can be appropriately determined.

[0208] The change in the form of electronic data that is consistent with the shooting result of the shooting unit 34, as described in the ninth embodiment, is one example. The shooting result of the shooting unit 34 can also be used to change the form of the displayed electronic data as follows.

[0209] For example, when the CPU 20 acquires a dynamic image of the user's finger movement as the image capture result of the imaging unit 34, it can also vary the area and shape of the acquired information displayed based on the speed of the user's finger movement. Ideally, the faster the user's finger movement, the greater the variation in the displayed electronic data. Furthermore, when the CPU 20 acquires images of the user holding an object (e.g., a stylus) and not holding it as the image capture result of the imaging unit 34, it can also vary the area and shape of the acquired information displayed based on each state. Ideally, the variation in the displayed electronic data when the user is holding an object (e.g., a stylus) is greater than the variation in the displayed electronic data when the user is not holding it.

[0210] In the ninth embodiment, the acquisition of the imaging result of the high-priority imaging unit 34 is defined as an example of "the fulfillment of a pre-defined condition," but this example is not limited to this. For example, a pre-defined time may have elapsed after the form of the displayed electronic data has changed based on the communication result of the communication unit 36 ​​or the imaging result of the imaging unit 34. Another example may be that after acquiring one result, another result associated with the opposite attribute or effect is acquired, such as the case where the imaging result of the imaging unit 34 associated with "fire" is acquired after acquiring the communication result of the communication unit 36 ​​associated with "water."

[0211] (Tenth Implementation)

[0212] Next, for the tenth embodiment, the parts that are repeated with other embodiments will be omitted or simplified and will be described.

[0213] Figure 23 This is a flowchart representing the fifth process of electronic information display processing performed by the information processing device 10.

[0214] Figure 23 In step S50, as shown, CPU 20 uses an e-book reader to execute a file containing an e-book published from a content publishing server. Then, it proceeds to step S51. In the tenth embodiment, as an example, electronic information is designated as "e-book," and specific software is designated as "e-book reader."

[0215] In step S51, the CPU 20 determines whether there are any advertisements as environmental information related to the e-book. If it determines that there are no advertisements (step S51: Yes), it proceeds to step S52. On the other hand, if the CPU 20 determines that there are advertisements (step S51: No), it proceeds to step S53. In the tenth embodiment, the CPU 20 obtains the presence or absence of advertisements as environmental information related to the e-book from the e-book's publishing source server via the communication unit 36, and uses this as the communication result of the communication unit 36. At this time, the CPU 20 determines "no advertisements" when there are no advertisements provided from the publishing source server, and determines "advertisements are present" when advertisements are provided.

[0216] In step S52, the CPU 20 displays an e-book without advertising information. Then, the process ends. At this time, the CPU 20 displays the e-book without acquisition information as in the sixth embodiment. Figure 12 The same content is displayed on display section 30.

[0217] In step S53, CPU 20 displays the e-book with added advertising information. Then, the process ends.

[0218] Figure 24 This is an example of an e-book display with added advertising information. For example... Figure 24 As shown, on the display unit 30, as an electronic book, there is a display with... Figure 12 The display unit 30 contains both main text (60) and an advertisement (80) with the same content. The advertisement (80), containing the text "It has been decided to make it into a film," is displayed in the center of the display unit 30. Figure 24 In the example, the body text 60 is information published from the content publishing server, and the advertisement 80 is information added by the e-book reader as advertising information.

[0219] In the tenth embodiment, for the overlapping portion of the text display 60 and the advertisement display 80, the CPU 20 controls the priority display of the advertisement display 80, thereby making only the advertisement display 80 identifiable in the overlapping portion. Furthermore, the CPU 20 removes the advertisement display 80 from the display unit 30 after a fixed period of time.

[0220] As described above, in the tenth embodiment, the CPU 20 obtains whether an advertisement, which is environmental information related to the e-book, is present. If the advertisement is present, it adds advertising information consistent with the advertisement and displays the e-book. Therefore, according to the tenth embodiment, the displayed e-book format is expanded compared to a structure that only displays the text of the e-book.

[0221] Furthermore, in the tenth embodiment, the electronic book also reflects the variations that might occur with a bound book. For example, the book may sometimes have a tape wrapped around it with different content recorded at fixed intervals. In the tenth embodiment, an advertisement display 80 as advertising information is added, thereby reflecting the variations that might occur with a book as described above in the electronic book.

[0222] In addition, in the tenth embodiment, the CPU 20 determines whether the advertisement display 80 is displayed based on the presence or absence of advertisements provided from the publishing source server. However, it is also possible to determine whether the advertisement display 80 is displayed based on other factors, or alternatively. For example, website crawling can be performed, and the CPU 20 can determine whether the advertisement display 80 is displayed based on the results.

[0223] In the tenth embodiment, the advertisement display 80, which serves as advertising information, displays the content "It has been decided to make it into a movie." (see reference) Figure 24 However, the content displayed on the advertisement display 80 is not particularly limited. For example, for an advertisement related to environmental information about e-books, if the author of the e-book has released a new book, the advertisement display 80 could display something like "New book released!" Or, if it's selling character goods featuring characters from the e-book, the advertisement display 80 could display something like "Character goods released!" Furthermore, it's possible to access the corresponding advertisement page from the advertisement display 80. Once the user has accessed the advertisement page from the advertisement display 80, the advertisement display 80 is removed. This is because the purpose of the advertisement is achieved by the user accessing the advertisement page, so continuing to display the advertisement display 80 becomes less meaningful. Moreover, continuing to display the advertisement display 80 after the purpose of the advertisement has been achieved might cause displeasure to the user.

[0224] In the tenth embodiment, the advertisement display 80 is described as advertising information, but warning or notification information may also be added. For example, it is envisioned that when the display period of an e-book is approaching, a notification requesting additional payment could be displayed. Furthermore, the advertising information can also be used to notify users of additional information due to an upgrade of the specific software used to display the e-book, or to notify users that a bug fix is ​​possible.

[0225] (Eleventh Implementation Method)

[0226] Next, for the eleventh embodiment, the parts that are repeated with other embodiments will be omitted or simplified and will be described.

[0227] The eleventh embodiment differs from the aforementioned embodiments in that the display screen of the display unit 30 when the e-book reader is running does not display the text of the e-book, but rather a view of the e-book.

[0228] Figure 25 This is an example of the first display screen showing an overview of e-books. For example... Figure 25 As shown, the display unit 30 displays four e-books: book display B1, book display B2, book display B3, and book display B4, indicating that four e-books are available for viewing. Furthermore, each of the book displays, from B1 to B4, displays a cover page corresponding to its respective cover.

[0229] Figure 26 This is a second display example of a view showing an overview of e-books. For example... Figure 26 As shown, the display unit 30 displays [something related to...]. Figure 25 Books with the same content are displayed as B1, B2, B3, and B4, along with raindrop display 82. Raindrop display 82, containing multiple ripples, is displayed in the lower left corner of each cover page. Furthermore, Figure 26 In the example, book display B1, book display B2, book display B3, and book display B4 are information published from the content publishing server, while raindrop display 82 is information added by the e-book reader to obtain information.

[0230] Here, in the aforementioned embodiment, the structure is such that when the CPU 20 displays electronic information in addition to acquiring information, the acquired information is displayed on all pages of the electronic information. In contrast, the eleventh embodiment differs from the aforementioned embodiment in that only the cover page is displayed as the raindrop display 82 for acquiring information, and it is not displayed on the pages displaying the main text of the electronic book after the cover page.

[0231] Furthermore, in the eleventh embodiment, the page displaying the raindrop display 82 as the information acquisition is only the cover page, but it is not limited to this. Under certain conditions, the raindrop display 82 can also be displayed on the pages displaying the main text of the e-book after the cover page. For example, if the weather information acquired as a communication result of the communication unit 36 ​​is rain, and the rainfall per unit time (e.g., one hour) exceeds a predetermined amount (e.g., fifty millimeters), the raindrop display 82 can also be displayed on the pages displaying the main text of the e-book after the cover page. As a method of displaying the raindrop display 82 in this case, it is envisioned that it is first displayed on the cover page, and then displayed at the end of the page following the cover page. That is, the changes that may occur in a bound book can also be reflected in the e-book, thereby expressing the appearance of water seepage gradually eroding the cover page after the next page.

[0232] (Twelfth Implementation)

[0233] Next, for the twelfth embodiment, the parts that are repeated with other embodiments will be omitted or simplified and will be described.

[0234] Figure 27 This is a flowchart representing the sixth process of electronic information display processing performed by the information processing device 10.

[0235] Figure 27 In step S60, as shown, CPU 20 uses reader software to execute a file containing electronic data published from the data publishing server. Then, it proceeds to step S61. In the twelfth embodiment, as an example, electronic information is defined as "electronic data," and specific software is defined as "reader software."

[0236] In step S61, CPU 20 displays the electronic data published from the data publishing server. Then, proceed to step S62.

[0237] Figure 28 This is an example of displaying electronic materials published from a data publishing server. For example... Figure 28 As shown, on the display unit 30, a chart 84 showing the population trend of City A is displayed as electronic data. Figure 28 Chart 84 shows the population shift in City A over the three years of 2017, 2018, and 2019.

[0238] return Figure 27 In step S62, CPU 20 determines whether there is no connection to... Figure 28 If the update related to the electronic data is determined to be non-existent (step S62: Yes), the process proceeds to step S63. Conversely, if the CPU 20 determines that an update exists (step S62: No), the process proceeds to step S64. In the twelfth embodiment, the CPU 20 obtains the presence or absence of updates related to the electronic data from the data publishing server (e.g., a server managed by City Government A) via the communication unit 36, and uses this as the communication result of the communication unit 36. At this time, the CPU 20 determines "no update" when no update data is provided from the data publishing server, and determines "update exists" when update data is provided.

[0239] In step S63, the CPU 20 maintains the form of the electronic data displayed in step S61. Then, the process ends.

[0240] In step S64, the CPU 20 displays the electronic data containing the acquired information. Then, the process ends.

[0241] Figure 29 This is a sixth display example that includes access to electronic information. For example... Figure 29 As shown, on the display unit 30, as electronic data, and Figure 28 Similarly, Chart 84 is shown, with the population trend of City A in 2020 added as an update to Chart 86. Figure 29 In the example, in order to improve the recognizability of the bar charts relative to other years, the bar charts corresponding to the updated display 86 are marked with diagonal lines. However, the chart 84 displayed on the display unit 30 can also be marked with diagonal lines, or it can be displayed in the same form as the bar charts of other years without diagonal lines.

[0242] and, Figure 29 In the example shown, the bar chart in Chart 84 representing the population shift of City A over the three years of 2017, 2018, and 2019 is information published from the data publishing server, and Update Display 86 is information added using reader software as the acquired information. Specifically, in the twelfth embodiment, as updated data from the data publishing server, CPU 20 acquires the population shift value of City A in 2020. Furthermore, based on the acquired value, CPU 20 uses reader software to generate a bar chart representing the population shift of City A in 2020 and displays it as Update Display 86.

[0243] In this twelfth embodiment, it is ideal that the update display 86 cannot be shown until updated data is provided from the data publishing server. In other words, in the twelfth embodiment, it is ideal that the bar chart cannot be added at any time on the user's side before the official information is released.

[0244] Additionally, if the CPU 20 displays electronic data containing the acquired information in step S64, it can also do so as follows: Figure 30 As shown, the size of the displayed chart 84 is reduced from the size displayed in step S61. Furthermore, if the CPU 20 displays electronic data containing acquired information in step S64, it can also do so... Figure 31 As shown, the bar chart representing the population shift of City A for a portion of the year (e.g., 2017), which was displayed in step S61, is removed from Chart 84 and displayed instead.

[0245] Furthermore, even though the illustration is omitted, if the CPU 20 displays electronic data containing acquired information in step S64, the size of the displayed chart 84 can be enlarged from the size displayed in step S61. Moreover, if the display area of ​​the chart 84 on the page of the electronic data displayed in step S61 becomes insufficient due to the enlargement, the CPU 20 can display the enlarged chart 84 on the next page.

[0246] (Thirteenth Implementation Method)

[0247] Next, for the thirteenth embodiment, the parts that are repeated with other embodiments will be omitted or simplified and will be described.

[0248] In this thirteenth embodiment, unlike the aforementioned embodiments that utilize specific software to execute pre-made or photographed documents, the description focuses on the changes in the form of electronic information that occur when specific software is used to create data or capture images. As an example, in this thirteenth embodiment, the electronic information is defined as "image information," and the specific software is defined as "image capturing software."

[0249] Figure 32 This is a second display example showing the image captured by the camera unit 34. For example... Figure 32 As shown, on the display unit 30, the image being captured (image 88) and the shutter button 78 used for capturing the image are directly displayed in this form as image information. Furthermore, Figure 32 The image shows a finger display F, which schematically represents the user's finger.

[0250] Figure 33 This is a third display example showing the image being captured by the camera unit 34. For example... Figure 33 As shown, on the display unit 30, images are displayed as image information. Figure 32 The image 88, shutter button 78, and crack display 90 are used to capture the same content. The triangular crack display 90 is displayed in the lower right corner of the display unit 30. Furthermore, Figure 33 In the example, the crack display 90 is information added using image capturing software to obtain information.

[0251] The breakage indicator 90 is displayed when the detection unit 32 detects contact with the display unit 30 from the outside. For example, Figure 33 In the explicit examples, when in Figure 32 In the state shown in the display example, when the user's finger touches the lower right part of the display unit 30, the detection unit 32 detects the contact, and the CPU 20 adds a crack display 90 that is consistent with the detection result of the detection unit 32 to display image information.

[0252] Furthermore, in the thirteenth embodiment, similar to the aforementioned embodiments, by displaying the broken display 90 as acquisition information on the image information, a portion of the image information becomes unrecognizable in the displayed portion. However, it is not limited to this; as acquisition information, a portion of the image information may also be eliminated, making that portion of the image information unrecognizable in the eliminated portion.

[0253] The thirteenth embodiment describes an example of setting the specific software as "image capturing software", but it is not limited thereto. As the specific software in the thirteenth embodiment, "reader software" that executes pre-made or captured documents as in the aforementioned embodiments, as well as "document creation software", "spreadsheet software" or "presentation software" other than "e-book reader" may also be used.

[0254] (Fourteenth Implementation)

[0255] Next, for the fourteenth embodiment, the parts that are repeated with other embodiments will be omitted or simplified and will be described.

[0256] Similar to the sixth embodiment, in the fourteenth embodiment, when displaying electronic information by executing specific software, the CPU 20 adds acquired information consistent with the detection result of the detection unit 32 and displays the electronic information. The environmental information in the fourteenth embodiment is also the same as in the sixth embodiment, defined as the presence or absence of external contact with the display unit 30, as described later.

[0257] Figure 34 This is an example of a display showing the end position of the detection, indicating that the detection unit 32 has stopped contacting the display unit 30. For example... Figure 34 As shown, on the display unit 30, as an electronic book, and Figure 12 The same content is displayed directly in this format for the main text 60. Furthermore, in the fourteenth embodiment, Figure 34 The diagram illustrates the position of the finger display F as the aforementioned end position. Furthermore, in the fourteenth embodiment, the initial position where the detection unit 32 initially detects contact with the display unit 30 is set as... Figure 12 The diagram shows the position of the finger indicating F.

[0258] Figure 35 This is a display example of the trajectory L1 of the contact position with the display unit 30 detected by the detection unit 32. Figure 35 The diagram shows the trajectory L1 from the initial position P1 to the ending position P2. The trajectory L1 is a straight line extending from the initial position P1 toward the right of the display unit 30.

[0259] Figure 36 This is a fourth display example that includes e-books for accessing information. For example... Figure 36 As shown, on the display unit 30, as an electronic book, there is a display with... Figure 34 as well as Figure 35 The same content is displayed in both the main text (60) and the breakout display (92). The rectangular breakout display (92) is displayed at the bottom of the display section (30). Figure 36 In the explicit example, the body text 60 shows information published from the content publishing server, while the broken text 92 shows information added by an e-book reader when retrieving information.

[0260] The breakage indicator 92 is displayed when the detection unit 32 detects contact with the display unit 30 from the outside. For example, Figure 36 In the obvious example, the detector 32 detected the formation Figure 35 When a user's finger touches the trajectory L1 shown, the CPU 20 displays an electronic book by adding a crack display 92 that matches the detection result of the detection unit 32. At this time, the CPU 20 displays the crack display in a shape that matches the direction of the force applied to the display unit 30, as a result of the detection unit 32. For example, Figure 36 In the example, the e-book is shown to break into a shape consistent with the user's swipe action by displaying a rectangular crack display 92.

[0261] Figure 37 This is a display example of the trajectory L2 of the contact position with the display unit 30 detected by the detection unit 32. Figure 37 The diagram shows the trajectory L2 from the initial position P1, through the intermediate position P3, to the final position P2. The trajectory L2 is a broken line that extends in a straight line from the initial position P1 toward the upper right of the display unit 30, reaches the intermediate position P3, and then extends in a straight line toward the lower right of the display unit 30 to the final position P2.

[0262] Figure 38 This is a fifth display example that includes e-books for accessing information. For example... Figure 38 As shown, on the display unit 30, as an electronic book, there is a display with... Figure 36 The same content is displayed as body text 60 and a breakout display 94. The triangular breakout display 94 is displayed at the bottom of the display section 30. Furthermore, Figure 38 In the example, the body text 60 shows information published from the content publishing server, while the broken text 94 shows information added by an e-book reader when retrieving information.

[0263] The breakage indicator 94 is displayed when the detection unit 32 detects contact with the display unit 30 from the outside. For example, Figure 38 In the obvious example, the detector 32 detected the formation Figure 37When a user's finger touches the trajectory L2 shown, the CPU 20 displays an e-book by adding a crack display 94 that matches the detection result of the detection unit 32. At this time, the CPU 20, as described above, displays the crack display in a shape consistent with the direction of the force applied to the display unit 30, as a result of the detection unit 32. For example, Figure 38 In the example, the display shows a triangular crack, 94, to represent the situation where the e-book breaks into a shape consistent with the user's heavy-hit operation.

[0264] As described above, in the fourteenth embodiment, as the generation of environmental information for the display unit 30, when the detection unit 32 detects contact with the display unit 30, the CPU 20 changes the degree of change that alters the form of the displayed e-book from its form before information acquisition, based on the trajectory from the initial position detected by the detection unit 32 to the end position of the contact with the display unit 30. For example, as described above, in the fourteenth embodiment, even if the initial and end positions of the contact with the display unit 30 are the same, but the trajectory differs via intermediate positions, the displayed broken display form is changed. Therefore, according to the fourteenth embodiment, the degree of change that alters the form of the displayed e-book from its form before information acquisition is based on the trajectory from the initial position detected by the detection unit 32 to the end position of the contact with the display unit 30.

[0265] In addition, in the fourteenth embodiment, the shape of the displayed crack is different depending on the direction of the force applied to the display unit 30, but other elements such as the area of ​​the displayed crack may be different instead of this.

[0266] (other)

[0267] In each of the embodiments described, there is an embodiment in which the electronic information includes either a document or an image. However, the electronic information may be constituted by including at least one of a document and an image, or it may include both a document and an image.

[0268] In each of the embodiments, there is an implementation in which the electronic information is displayed in a form consistent with either the usage status of the electronic information or the environmental information. However, as long as the form is consistent with at least one of the usage status of the electronic information or the environmental information, the electronic information can be displayed in a form consistent with both the usage status of the electronic information and the environmental information.

[0269] In each of the embodiments described, when weather information is acquired as the communication result of the communication unit 36 ​​and the form of the displayed electronic information is changed according to the temperature information contained in the weather information, the form of the displayed electronic information can also be restored to its previous state after a predetermined time has elapsed.

[0270] In each of the embodiments described, when the electronic information is displayed in a form consistent with at least one of the usage status or environmental information of the electronic information, multiple data, such as data before the change in the form of the electronic information and data after the change in the form of the electronic information, can be stored in the storage unit 26, or only the data after the change in the form of the electronic information can be stored in the storage unit 26. In this case, when the electronic information is designated as an "electronic book," it is ideal to give the content publishing source of the electronic book the right to decide whether to store one type of data or multiple types of data. This is because, for example, by storing only the data after the change in the form of the electronic book, it is expected that users who want to view the state before the change will repurchase the electronic book. Moreover, if the form of the electronic information changes when it is stored in the storage unit 26, depending on the time of re-viewing the electronic information, the form of the electronic information can be maintained or restored to the state before the change. For example, the electronic information stored in the storage unit 26 is accompanied by a raindrop display 52 for information retrieval (see reference). Figure 7 In the event that the electronic information is viewed again after a predetermined period (e.g., one week), the electronic information without the raindrop display 52 may also be displayed.

[0271] In each of the embodiments described, the degree of variation in displaying the electronic information can be changed according to the page displaying the electronic information, in a form consistent with at least one of the usage status or environmental information of the electronic information. For example, the degree of variation in the displayed electronic information can be changed on the cover page and on the pages displaying the main text of the electronic information that follow the cover page.

[0272] In each of the embodiments described, when the electronic information is designated as an "electronic book" and the content of the electronic book exists as a bound book, the degree of variation when displaying the electronic book in a form consistent with at least one of the usage status or environmental information of the electronic book can be adjusted according to the paper material of the book. For example, consider the case where the book cover is a hard cover, compared to the case where the cover is a soft cover, increasing the size of the raindrop display 82 on the cover page of the electronic book (see reference). Figure 26 The area of ​​the book. Moreover, the paper information of the book can be input by the user on the information processing device 10, or by the CPU 20 through the communication unit 36 ​​to obtain information publicly available on the network.

[0273] In each of the embodiments described, as an example, the information processing device 10 is a mobile terminal such as a smartphone, tablet computer, or portable notebook PC. However, the information processing device 10 may also be a mobile terminal including a flexible display or a so-called "dual-screen smartphone" including multiple displays. Furthermore, when the information processing device 10 is a mobile terminal including a flexible display or a so-called "dual-screen smartphone," the detection unit 32 can also detect bending, twisting, opening, and closing of the information processing device 10.

[0274] In each of the embodiments described, the CPU 20 displays electronic information on the display unit 30 of the information processing device 10, but the object displaying the electronic information is not limited to the display unit 30. For example, the CPU 20 may also display the electronic information on the display screen of another device different from the information processing device 10, or it may display the electronic information in the air to form an aerial display.

[0275] In the embodiments described above, examples of electronic information being recorded in the storage unit 26 of the information processing device 10 have been given, but the invention is not limited to this; electronic information may also be recorded in the storage unit of an external device. In this case, the electronic information recorded in the storage unit of the external device can be accessed via communication technologies such as the Internet, or an external storage device can be temporarily physically connected to the information processing device 10, thereby allowing the electronic information to be read from and displayed on the information processing device 10. Furthermore, when multiple users share the display of electronic information located in the storage unit of an external device, the display format can be changed according to the individual circumstances of each user, or a uniform display format can be provided for the same electronic information. For example, user authentication is envisioned as a way to identify each user from among multiple users. Furthermore, as a result of user authentication, the user account of the specific software displaying the corresponding electronic information is identified, thereby allowing the display format to be changed according to each user. Of course, it is also possible for users to coexist without specifically changing the display format. In addition, when editing the same electronic information simultaneously or viewing and verifying it at the same time, a dominant user account can be set from multiple user accounts, and the display format can be changed according to the status of the user of the dominant user account.

[0276] Furthermore, the contents described in the various embodiments and (others) can be appropriately combined.

[0277] In the various embodiments described, the term "processor" refers to a processor in a broad sense, including general-purpose processors (such as central processing units (CPUs)) or dedicated processors (such as graphics processing units (GPUs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), programmable logic devices, etc.).

[0278] Furthermore, the operation of the processor in each of the embodiments can be performed not only by a single processor, but also collaboratively by multiple processors located in physically separate locations. Moreover, the order in which the processors operate is not limited to the order described in each of the embodiments and can be appropriately changed.

Claims

1. An information processing device, comprising a processor, When the processor displays electronic information by executing software capable of displaying electronic information comprising at least one of documents and images, it displays the electronic information in a form consistent with environmental information indicating the surrounding environment of the location where the electronic information is displayed. Based on the acquisition results obtained by the acquisition unit that acquires the environmental information, the form of a portion of the displayed electronic information is changed. When the acquisition unit acquires environmental information indicating that the display unit displaying the electronic information has been contacted, it changes the degree of change that causes the form of the displayed electronic information to change from the form before the acquisition information consistent with the acquisition result of the acquisition unit, based on the pressure caused by the contact.

2. The information processing apparatus according to claim 1, wherein... The processor displays the electronic information by adding the acquired information.

3. The information processing apparatus according to claim 2, wherein... The processor, by adding the acquired information, causes a portion of the displayed electronic information to change its form from its form before the acquisition information was added.

4. The information processing apparatus according to claim 3, wherein When the processor generates the environmental information for the display unit, it changes the degree of change according to the position of the display unit that generated the environmental information.

5. The information processing apparatus according to claim 4, wherein As the position of the display unit that generated the environmental information, the processor changes the degree of change based on the trajectory of the environmental information from the initial position to the final position of the display unit that generated the environmental information.

6. The information processing apparatus according to any one of claims 2 to 5, wherein The processor adjusts the degree of change based on the acquisition time of the environmental information by the acquisition unit.

7. The information processing apparatus according to any one of claims 2 to 5, wherein When the processor acquires multiple acquisition results, it prioritizes displaying the electronic information using a format corresponding to the acquisition result with the highest predefined priority.

8. The information processing apparatus according to any one of claims 1 to 5, wherein The electronic information refers to electronic books. The processor obtains information about the presence or absence of advertisements related to the environmental information associated with the e-book. If the aforementioned advertisement exists, then the e-book is displayed with advertising information consistent with the aforementioned advertisement.

9. The information processing apparatus according to any one of claims 1 to 5, wherein When the processor changes the form of the displayed electronic information in accordance with the environmental information, it restores the form of the displayed electronic information to its original state before the change by fulfilling pre-defined conditions.

10. The information processing apparatus according to claim 9, wherein The changes in the form of the electronic information include: reversible changes that restore the form to its original form upon the fulfillment of the pre-defined conditions; and irreversible changes that do not restore the form to its original form even if the pre-defined conditions are fulfilled.

11. A computer-readable medium storing a program that causes a computer to perform a process, wherein the process is: When displaying electronic information by executing software capable of displaying electronic information comprising at least one of documents and images, the electronic information is displayed in a form consistent with environmental information representing the surrounding environment of the place where the electronic information is displayed; Based on the acquisition result of the acquisition unit that acquires the environmental information, the form of a portion of the displayed electronic information is changed; as well as When the acquisition unit acquires environmental information indicating that the display unit displaying the electronic information has been contacted, it changes the degree of change that causes the form of the displayed electronic information to change from the form before the acquisition information consistent with the acquisition result of the acquisition unit, based on the pressure caused by the contact.

12. An information processing method, comprising: When displaying electronic information by executing software capable of displaying electronic information comprising at least one of documents and images, the electronic information is displayed in a form consistent with environmental information representing the surrounding environment of the place where the electronic information is displayed; Based on the acquisition result of the acquisition unit that acquires the environmental information, the form of a portion of the displayed electronic information is changed; as well as When the acquisition unit acquires environmental information indicating that the display unit displaying the electronic information has been contacted, it changes the degree of change that causes the form of the displayed electronic information to change from the form before the acquisition information consistent with the acquisition result of the acquisition unit, based on the pressure caused by the contact.

13. A computer program product comprising a program that causes a computer to perform processing, wherein, The process is as follows: When displaying electronic information by executing software capable of displaying electronic information comprising at least one of documents and images, the electronic information is displayed in a form consistent with environmental information representing the surrounding environment of the place where the electronic information is displayed; Based on the acquisition result of the acquisition unit that acquires the environmental information, the form of a portion of the displayed electronic information is changed; as well as When the acquisition unit acquires environmental information indicating that the display unit displaying the electronic information has been contacted, it changes the degree of change that causes the form of the displayed electronic information to change from the form before the acquisition information consistent with the acquisition result of the acquisition unit, based on the pressure caused by the contact.

Images