Control method of display device and display system

Abstract

A control method of a display device and a display system. In a case where it is intended to share the calculation of a projector with an external arithmetic device, a user can easily determine the timing and the situation in which the external arithmetic device should be used. A control method of a display device (10) includes a process of displaying, as an image, a recommendation image that recommends execution of at least a part of a first arithmetic process using an external arithmetic device (20) different from the display device (10), before one or more processors of the display device (10) that displays the image start the first arithmetic process.

Description

Technical Field

[0001] This invention relates to a control method for a display device and a display system. Background Technology

[0002] The projector disclosed in Patent Document 1 includes a light source driver unit that drives the light source lamp, a main CPU that uniformly controls the projector, and a sub-CPU that assists the main CPU in controlling and controlling the light source driver unit. The calculations performed by the projector are shared by the main CPU and the sub-CPU.

[0003] Patent Document 1: Japanese Patent Application Publication No. 2011-154069

[0004] In cases where users do not want the main CPU and secondary CPU to share the projector's computational load, but instead want to utilize an external computing device to share the projector's computational load, it is difficult for users to determine the timing and status of when to utilize the external computing device. Summary of the Invention

[0005] The control method for a display device according to the present invention includes the following process: before one or more processors of the display device displaying an image begin a first computational process, a recommended image is displayed as the image, the recommended image recommending that at least a portion of the first computational process be performed using an external computing device different from the display device.

[0006] The display system according to the present invention includes a display device and an external computing device. The display device includes one or more processors. Before starting a first computing process, a recommended image is displayed. The recommended image recommends that at least a portion of the first computing process be performed using the external computing device, which is different from the display device. Attached Figure Description

[0007] Figure 1 This is a block diagram showing an example of the structure of display system 1.

[0008] Figure 2 This is a block diagram showing an example of the structure of the projection device 10.

[0009] Figure 3 This is a flowchart illustrating an example of the operation of display system 1.

[0010] Figure 4 This is a block diagram showing an example of the structure of display system 1A.

[0011] Label Explanation

[0012] 1: Display system; 1A: Display system; 10: Projection device; 20: Calculation device; 110: Projector; 120: Imaging device; 130: Processing device; 131: Communication control unit; 132: Acquisition unit; 133: First judgment unit; 134: Display control unit; 135: Second judgment unit; 136: Receiving unit; 137: Third judgment unit; 138: Execution instruction unit; 139: Calculation unit; 140: Storage device; 150: Display; 160: Input device; 170: Communication device; DT: Load meter; NET: Communication network; PF: Projection surface; PI: Projected image; PR1: Control program. Detailed Implementation

[0013] Hereinafter, embodiments for carrying out the present invention will be described with reference to the accompanying drawings. Note that the dimensions and scales of the various parts in the drawings differ appropriately from actual dimensions. Furthermore, the embodiments described below are preferred examples of the present invention, and therefore various technically preferred limitations have been added. However, unless otherwise specified in the following description, the scope of the present invention is not limited to these embodiments.

[0014] 1: First Implementation Method

[0015] 1-1: Structure of the first embodiment

[0016] The following is for reference Figures 1-3 The display system 1 according to the first embodiment will be described.

[0017] 1-1-1: Overall Structure

[0018] Figure 1 This is a block diagram showing an example of the structure of display system 1. Display system 1 includes a projection device 10 and a processing device 20.

[0019] The projection device 10 projects a projected image PI onto the projection surface PF. The projection device 10 can also perform multiple projection together with other projection devices 10 that project other projected images PI onto the projection surface PF. Furthermore, the projection device 10 is an example of a "display device".

[0020] The arithmetic unit 20 is an arithmetic unit that serves as an external device to the projection device 10. When the projection device 10 intends to perform geometric orthogonal calculations, but the calculation speed is slow or the accuracy can be improved due to the insufficient performance of the projection device 10, the arithmetic unit 20 performs at least a portion of the calculations that the projection device 10 initially intended to perform.

[0021] Furthermore, at the point in time before the projection device 10 begins the aforementioned calculation, the connection between the projection device 10 and the computing device 20 may or may not be established. Additionally, this connection can be either wired or wireless.

[0022] As an example, the computing device 20 is a mini PC (Personal Computer) like the Raspberry Pi (registered trademark) or a general-purpose PC.

[0023] 1-1-2: Structure of the projection device 10

[0024] Figure 2 This is a block diagram showing an example of the structure of the projection device 10.

[0025] The projection device 10 includes a projector 110, a shooting device 120, a processing device 130, a storage device 140, a display 150, an input device 160, and a communication device 170. The various elements of the projection device 10 are interconnected via one or more buses for information communication. Alternatively, the elements of the projection device 10 may be composed of one or more devices, or some elements of the projection device 10 may be omitted.

[0026] Projector 110 is a device that projects an image acquired by acquisition unit 132 (described later) onto projection surface PF. Projector 110 projects various images under the control of processing device 130. Projector 110 includes, for example, a light source, a liquid crystal panel, and a projection lens. The liquid crystal panel modulates light from the light source, and the modulated light is projected onto a screen or wall via the projection lens. The liquid crystal panel is an example of a light modulation element.

[0027] The imaging device 120 is a device for photographing the external environment of the projection device 10. In this embodiment, the imaging device 120 photographs the projection surface PF. The imaging device 120 has an imaging lens and imaging elements such as a CMOS (Complementary Metal-Oxide-Semiconductor) sensor or a CCD (Charge-Coupled Device) sensor that converts image light incident through the imaging lens into imaging data. As an example, the imaging device 120 is a camera built into the projection device 10. However, as another example, the imaging device 120 can also be an external camera such as a webcam.

[0028] The processing device 130 is one or more processors that control the projection device 10 as a whole, and may be composed of one or more chips. The processing device 130 may be, for example, a central processing unit (CPU) that includes interfaces with peripheral devices, arithmetic units, and registers. Furthermore, some or all of the functions of the processing device 130 may be implemented using hardware such as a DSP (Digital Signal Processor), ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), or FPGA (Field Programmable Gate Array). The processing device 130 executes various processes in parallel or sequentially.

[0029] Storage device 140 is a recording medium that can be read by processing device 130, storing multiple programs including control program PR1 executed by processing device 130. Additionally, storage device 140 stores a compiled language program describing the computational processing procedures performed by processing device 130. Furthermore, storage device 140 can also store projected image PI projected by projection device 10.

[0030] The storage device 140 may be composed of at least one of ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), RAM (Random Access Memory), etc. The storage device 140 may also be referred to as a register, cache, main memory, or main storage device, etc.

[0031] Additionally, storage device 140 stores a load table DT. The load table DT is a table that associates the type of calculation performed by processing device 130 with the load of that calculation. In the load table DT, for example, the type of calculation such as "geometric correction" or "color calibration" is stored in association with the load of each calculation.

[0032] Display 150 is a device for displaying images and character information. Display 150 displays various images under the control of processing device 130. For example, various display panels such as liquid crystal display panels and organic EL (Electroluminescence) display panels are suitable for use as display 150.

[0033] Input device 160 is a device that accepts operations from the user. For example, input device 160 may be configured to include a keyboard, touchpad, touch panel, or mouse. Here, if input device 160 is configured to include a touch panel, it may also function as display 150.

[0034] The communication device 170 is hardware used as a transceiver for communicating with other devices. The communication device 170 is also referred to as a network device, network controller, network interface card (NIC), or communication module, for example. The communication device 170 may also have a connector for wired connection and an interface circuit corresponding to that connector. Additionally, the communication device 170 may also have a wireless communication interface. Examples of connectors and interface circuits for wired connection include those conforming to wired LAN, IEEE 1394, and USB. Examples of wireless communication interfaces include those conforming to wireless LAN, Bluetooth (registered trademark), etc.

[0035] The processing unit 130 reads and executes the control program PR1 from the storage device 140, thereby functioning as a communication control unit 131, an acquisition unit 132, a first judgment unit 133, a display control unit 134, a second judgment unit 135, a receiving unit 136, a third judgment unit 137, an execution instruction unit 138, and an arithmetic unit 139. Furthermore, the control program PR1 can also be sent from other devices, such as a server managing the projection device 10, via the communication network NET.

[0036] The communication control unit 131 controls the communication device 170 to send and receive various information between the communication device 170 and an external device. This external device includes a computing unit 20. The communication control unit 131 causes the information received by the communication device 170 from the computing unit 20 to include information acquired by the acquisition unit 132 (described later). Furthermore, the communication control unit 131 causes the information sent by the communication device 170 to the computing unit 20 to include instruction information generated by the execution instruction unit 138 (described later).

[0037] Based on the type of arithmetic process to be performed subsequently, the acquisition unit 132 refers to the load table DT stored in the storage device 140 and obtains a value representing the load corresponding to the arithmetic process. This arithmetic process is an example of "first arithmetic process".

[0038] The first determination unit 133 compares the value representing the load obtained by the acquisition unit 132 with a threshold, and based on the result of the comparison, determines whether to display a recommended image for using the computing device 20 on the projection surface PF in order to enable the computing device 20 to perform at least a part of the above-described computing process.

[0039] The recommended image is preferably one that suggests improving the performance of the computing process as a whole of the display system 1 by utilizing the computing device 20. For example, "computing process performance" here refers to the length of processing time or the accuracy of the processing result.

[0040] Furthermore, the recommended image is preferably one that suggests reducing the load on the display system 1 as a whole by utilizing the computing device 20.

[0041] Specifically, when the value representing the load is above a threshold, the first determination unit 133 determines that the recommended image should be displayed on the projection surface PF. When the first determination unit 133 determines that the recommended image should be displayed on the projection surface PF, the display control unit 134 projects the recommended image onto the projection surface PF, thereby displaying the recommended image on the projection surface PF. More specifically, the display control unit 134 causes the projector 110 to project a projected image PI representing the recommended image onto the projection surface PF.

[0042] On the other hand, if the value representing the load is less than the threshold, the first determination unit 133 determines that the recommended image will not be displayed on the projection surface PF. When the first determination unit 133 determines that the recommended image will not be displayed on the projection surface PF, the calculation unit 139 (described later) performs the aforementioned calculation process. In this case, the calculation process is not shared between the projection device 10 and the calculation device 20, but is performed solely by the projection device 10.

[0043] After the user who saw the above-mentioned recommended image established a connection between the projection device 10 and the computing device 20 in order to utilize the computing device 20, the second determination unit 135 determines whether the computing device 20 meets at least a portion of the conditions for performing the above-mentioned computing process.

[0044] As an example, after the arithmetic unit 20 is connected to the projection device 10 and before the second determination unit 135 determines whether the arithmetic unit 20 meets at least some of the conditions for performing the above-mentioned arithmetic processing, the acquisition unit 132 acquires performance information representing the arithmetic performance of the arithmetic unit 20 from the arithmetic unit 20. Furthermore, the arithmetic performance of the arithmetic unit 20 is an example of "first arithmetic performance".

[0045] In this case, as described above, the second determination unit 135 determines whether the computing performance represented by the aforementioned performance information is greater than or equal to the computing performance of the processing device 130. Furthermore, the computing performance of the processing device 130 is an example of "second computing performance".

[0046] If the second determination unit 135 determines that the computing performance indicated by the aforementioned performance information is greater than or equal to the computing performance of the processing device 130, then the computing device 20 is deemed to meet the aforementioned conditions. Conversely, if the second determination unit 135 determines that the computing performance indicated by the aforementioned performance information is less than the computing performance of the processing device 130, then the computing device 20 is deemed not to meet the aforementioned conditions.

[0047] Furthermore, as another example, after the computing device 20 is connected to the projection device 10 and before the second determination unit 135 determines whether the computing device 20 meets the conditions for performing at least a portion of the aforementioned computational processing, the acquisition unit 132 acquires license information from the computing device 20. This license information indicates whether the computing device 20 has a license for application software used to perform at least a portion of the aforementioned computational processing.

[0048] In this case, as described above, the second determination unit 135 determines whether the computing device 20 possesses the aforementioned license based on the license information. More specifically, as an example, the second determination unit 135 determines whether the computing device 20 has a license for application software with better performance in order to perform at least a part of the aforementioned computational processing.

[0049] If the second determination unit 135 determines that the computing device 20 has the aforementioned license based on the aforementioned license information, then the computing device 20 is deemed to meet the aforementioned conditions. On the other hand, if the second determination unit 135 determines that the computing device 20 does not have the aforementioned license based on the aforementioned license information, then the computing device 20 is deemed not to meet the aforementioned conditions.

[0050] Furthermore, as another example, after the computing device 20 is connected to the projection device 10 and before the second determination unit 135 determines whether the computing device 20 meets the conditions for performing at least a portion of the aforementioned computational processing, the acquisition unit 132 acquires installation information from the computing device 20. This installation information indicates whether application software for performing at least a portion of the aforementioned computational processing is installed in the computing device 20.

[0051] In this case, as described above, the second determination unit 135 determines, based on the installation information, whether the aforementioned application software is installed in the computing device 20. More specifically, as an example, the second determination unit 135 determines whether the computing device 20 has application software with better performance installed for performing at least a part of the aforementioned computational processing.

[0052] If the second determination unit 135 determines, based on the installation information, that the application software is installed in the computing device 20, then the computing device 20 satisfies the above conditions. Conversely, if the second determination unit 135 determines, based on the installation information, that the application software is not installed in the computing device 20, then the computing device 20 does not satisfy the above conditions.

[0053] Furthermore, as another example, after the computing device 20 is connected to the projection device 10 and before the second determination unit 135 determines whether the computing device 20 meets at least some of the conditions for performing the aforementioned computational processing, the acquisition unit 132 acquires GPU (Graphics Processing Unit) information from the computing device 20. This GPU information indicates the GPU's mounting status on the computing device 20.

[0054] In this case, as described above, the second determination unit 135 determines whether a GPU is installed in the computing device 20 based on the GPU information described above.

[0055] If the second determination unit 135 determines that the computing device 20 is equipped with a GPU based on the GPU information, then the computing device 20 satisfies the above conditions. On the other hand, if the second determination unit 135 determines that the computing device 20 is not equipped with a GPU based on the GPU information, then the computing device 20 does not satisfy the above conditions.

[0056] As described above, the acquisition unit 132 acquires at least one of performance information, licensing information, installation information, and GPU information from the computing device 20. For example, to enable the acquisition unit 132 to acquire this information, it is preferable to install application software in the computing device 20 for sending this information to the projection device 10.

[0057] Furthermore, as described above, the second determination unit 135 determines whether the computing device 20 meets the above conditions based on various information including performance information, license information, installation information, and GPU information. When the acquisition unit 132 acquires multiple pieces of information among performance information, license information, installation information, and GPU information, the second determination unit 135 can also determine whether the computing device 20 meets the above conditions based on these multiple pieces of information.

[0058] As an example, consider the scenario where the acquisition unit 132 obtains both performance information and licensing information.

[0059] The second determination unit 135 may determine that the computing device 20 meets the above conditions if it determines that the computing performance indicated by the performance information is higher than or equal to the computing performance of the processing device 130, or if it determines based on the license information that the computing device 20 has the aforementioned license. That is, the second determination unit 135 may also determine that the computing device 20 meets the above conditions if either of the determinations is affirmative. Otherwise, the second determination unit 135 may determine that the computing device 20 does not meet the above conditions.

[0060] Alternatively, the second determination unit 135 may determine that the computing device 20 meets the above conditions if it determines that the computing performance indicated by the performance information is higher than or equal to the computing performance of the processing device 130, and if it determines that the computing device 20 has the aforementioned license based on the license information. That is, the second determination unit 135 may determine that the computing device 20 meets the above conditions only if both determinations are affirmative. Otherwise, the second determination unit 135 may determine that the computing device 20 does not meet the above conditions.

[0061] If the second determination unit 135 determines that the arithmetic device 20 meets the above conditions, the display control unit 134 displays a selection image on the projection surface PF, representing either a user's response that causes the arithmetic device 20 to perform at least a portion of the arithmetic processing or a response that does not perform at least a portion of the arithmetic processing. More specifically, the display control unit 134 causes the projector 110 to project a projection image PI representing the selection image onto the projection surface PF.

[0062] Furthermore, an answer that causes the arithmetic device 20 to perform at least a portion of the arithmetic processing is an example of "first answer". On the other hand, an answer that causes the arithmetic device 20 not to perform at least a portion of the aforementioned arithmetic processing is an example of "second answer".

[0063] If the second determination unit 135 determines that the arithmetic device 20 does not meet the above conditions, the display control unit 134 displays a notification image on the projection surface PF that stops the arithmetic processing of at least a portion of the arithmetic image to the arithmetic device 20. More specifically, the display control unit 134 causes the projector 110 to project a projection image PI representing the notification image onto the projection surface PF.

[0064] The receiving unit 136 receives either the first or second response from the user via the aforementioned selection image. Specifically, as an example, the receiving unit 136 receives either the first or second response based on the user's operation on the input device 160.

[0065] The third judgment unit 137 determines whether the acceptance unit 136 accepted the first answer or the second answer based on the above-mentioned selected image.

[0066] If the third determination unit 137 determines that the first response has been accepted, the execution instruction unit 138 instructs the arithmetic unit 20 to perform at least a portion of the aforementioned arithmetic processing. Specifically, the execution instruction unit 138 causes the communication device 170 to send instruction information to the arithmetic unit 20, indicating an instruction to perform at least a portion of the aforementioned arithmetic processing. Upon receiving the instruction information, the arithmetic unit 20 performs the aforementioned at least a portion of the arithmetic processing. Furthermore, the execution instruction unit 138 instructs the arithmetic unit 139 (described later) to perform the remaining portion of the aforementioned arithmetic processing.

[0067] On the other hand, if the third judgment unit 137 determines that the second response has been accepted, the execution instruction unit 138 instructs the calculation unit 139 (described later) to perform all the calculation processes in the above-mentioned calculation process.

[0068] Furthermore, when the arithmetic device 20 performs at least a portion of the above-described arithmetic processing, before such execution, the communication control unit 131 causes the communication device 170 to send a script language program to the arithmetic device 20, which corresponds to a compiled language program stored in the storage device 140 that describes the above-described arithmetic processing procedure.

[0069] The arithmetic unit 139 performs at least a portion of the arithmetic processing described above.

[0070] Specifically, when the execution instruction unit 138 instructs the arithmetic unit 20 to perform at least a portion of the above-mentioned arithmetic processing, the arithmetic unit 139 performs the remaining arithmetic processing obtained by subtracting a portion of the arithmetic processing performed by the arithmetic unit 20 from the above-mentioned arithmetic processing.

[0071] On the other hand, when the execution instruction unit 138 instructs the calculation unit 139 to perform all the calculation processes described above, the calculation unit 139 performs all the calculation processes described above.

[0072] 1-2: Operation of the first embodiment

[0073] Figure 3 This is a flowchart illustrating an example of the operation of display system 1.

[0074] In step S1, the processing unit 130 of the projection device 10 functions as the acquisition unit 132. Based on the type of arithmetic processing to be performed thereafter, the processing unit 130 refers to the load table DT stored in the storage device 140 and acquires a value representing the load corresponding to the arithmetic processing.

[0075] In step S2, the processing device 130 functions as the first determination unit 133. The processing device 130 compares the load value obtained in step S1 with a threshold. If the load value is above the threshold (yes in step S2), the processing device 130 executes the processing in step S3. Conversely, if the load value is below the threshold (no in step S2), the processing device 130 executes the processing in step S9.

[0076] In step S3, the processing device 130 functions as a display control unit 134. The processing device 130 displays the recommended image on the projection surface PF.

[0077] In step S4, the processing device 130 functions as the second determination unit 135. The processing device 130 determines whether the arithmetic device 20 meets at least a portion of the conditions for performing the aforementioned arithmetic processing. If the processing device 130 determines that the arithmetic device 20 meets the aforementioned conditions (yes in step S4), the processing device 130 executes the processing in step S5. If the processing device 130 determines that the arithmetic device 20 does not meet the aforementioned conditions (no in step S4), the processing device 130 executes the processing in step S8.

[0078] In step S5, the processing device 130 functions as a display control unit 134. The processing device 130 displays a selection image on the projection surface PF, which is either a response (first response) or a response (second response) that the user receives that causes the arithmetic device 20 to perform at least a portion of the arithmetic processing.

[0079] In step S6, the processing device 130 functions as a receiving unit 136. The processing device 130 receives either the first or second response. Additionally, the processing device 130 functions as a third determination unit 137. The processing device 130 determines whether the first or second response was received via the selection image. If the first response was received (yes in step S6), the display system 1 executes the action of step S7. If the second response was received (no in step S6), the display system 1 executes the processing of step S9.

[0080] In step S7, the projection device 10 and the arithmetic device 20 share the computational processing. Specifically, the arithmetic device 20 performs at least a portion of the computational processing. The projection device 10 performs the remaining portion of the computational processing.

[0081] An example of the processing in step S7 is shown. For example, suppose the computational processing is related to geometric correction. Specifically, an example is performed where geometric correction is performed based on the result obtained by the imaging device 120 capturing a structured light pattern projected from the projection device 10 onto the projection surface PF. In this case, for example, the projection device 10 performs the following processing: projects the structured light pattern onto the projection surface PF using the projector 110; captures the structured light pattern projected onto the projection surface PF using the imaging device 120; and sends the result captured by the imaging device 120 (capture data) to the computational device 20. On the other hand, the computational device 20 performs the following processing: calculates a correspondence (projective transformation matrix) that associates the coordinate system of the liquid crystal panel with the coordinate system of the imaging element based on the received capture data; calculates the deformation amount used to deform the structured light pattern that has undergone trapezoidal distortion in the capture data into a rectangle; converts the deformation amount into the coordinate system of the liquid crystal panel based on the correspondence; and sends information representing the transformed deformation amount to the projection device 10. The projection device 10 performs geometric correction based on the received information.

[0082] In step S8, the processing device 130 functions as a display control unit 134. The processing device 130 displays a notification image on the projection surface PF that triggers a notification stop, and the processing device 20 performs at least a portion of the aforementioned processing.

[0083] In step S9, the projection device 10 performs the calculation process independently.

[0084] 2: Variation Example

[0085] The above methods can be modified in various ways. Specific modifications are illustrated below. The methods illustrated below and those shown in the above embodiments can be appropriately combined without contradiction. Furthermore, in the following illustrated modifications, elements with the same function and implementation method are represented by the same reference numerals as those used in the above description, and their detailed descriptions are appropriately omitted.

[0086] 2-1: Variation Example 1

[0087] Figure 4 This is a block diagram illustrating a structural example of the display system 1A involved in this modified example. For example... Figure 4 As shown, the display system 1A may also include two projection devices 10, projection device 10[1] and projection device 10[2], for the purpose of performing multiple projections. In addition, projection device 10[1], projection device 10[2] and computing device 20 may be communicatively connected via a communication network NET. That is, projection device 10[1] and computing device 20 may not be directly connected, but connected via a communication network NET. Similarly, projection device 10[2] and computing device 20 may not be directly connected, but connected via a communication network NET.

[0088] 2-2: Variation Example 2

[0089] In the above embodiment, the second determination unit 135 determines whether the computing device 20 meets at least a portion of the conditions for performing the above-described computational processing based on various information obtained by the acquisition unit 132 from the computing device 20. However, it is also possible that the second determination unit 135 determines whether the computing device 20 meets at least a portion of the conditions for performing the above-described computational processing based on the performance test of the projection device 10 and the computing device 20. Furthermore, in the performance of the computational processing here, it is preferable to also consider the connection environment (line speed, etc.) such as the line or communication network NET connecting the projection device 10 and the computing device 20.

[0090] 2-3: Variation Example 3

[0091] Figure 1 The display system 1 shown may, for example, include a monitor such as a television to replace the projection device 10. In this case, the monitor is an example of a "display device". Alternatively, the display system 1 may include a PC, tablet computer, or smartphone to replace the projection device 10. In this case, the PC, tablet computer, or smartphone is an example of a "display device".

[0092] 2-4: Variation Example 4

[0093] exist Figure 1 In the display system 1 shown, the computing unit 20 can also be an image supply device that supplies images to the projection device 10. As an example, the image supply device is a PC, tablet computer, or smartphone.

[0094] 2-5: Variation Example 5

[0095] Figure 1 The display system 1 shown may also include an information processing device for controlling the projection device 10. For example, this information processing device is a PC, tablet computer, or smartphone. In this case, at least one of the recommended image, selected image, and notification image can be displayed on a monitor provided with the information processing device or a monitor connected to the information processing device. This information processing device is an example of a "display device".

[0096] 2-6: Variation Example 6

[0097] exist Figure 1 In the display system 1 shown, the projection device 10 displays the recommended image, the selected image, and the notification image on the projection surface PF. However, the projection device 10 may also display at least one of the recommended image, the selected image, and the notification image on the display 150.

[0098] 3: Summary of this disclosure

[0099] The following is a summary published in this note.

[0100] Postscript 1

[0101] A method for controlling a display device includes the following process: before one or more processors of the display device displaying an image begin a first computational process, displaying a recommended image as the image, the recommended image recommending that at least a portion of the first computational process be performed using an external computing device different from the display device.

[0102] Based on the above structure, when users want to use an external computing device to share the computation of the display device, they can easily determine the timing and conditions under which the external computing device should be used.

[0103] More specifically, according to the above structure, since a recommended image is displayed before the first calculation process begins, the user can easily understand whether the first calculation process should utilize an external computing device.

[0104] Appendix 2

[0105] According to the control method of the display device described in Appendix 1, the control method of the display device includes the following processing: after the external computing device is connected to the display device, the one or more processors determine whether the external computing device meets the conditions for performing at least a portion of the first computing process; if the one or more processors determine that the external computing device meets the conditions, the external computing device performs at least a portion of the first computing process; and if the one or more processors determine that the external computing device does not meet the conditions, the one or more processors perform the first computing process only.

[0106] According to the above structure, the display device can perform appropriate control corresponding to whether the external computing device satisfies at least a portion of the conditions for performing the first arithmetic process.

[0107] Appendix 3

[0108] According to the control method of the display device described in Appendix 2, the control method of the display device includes the following processing: after the external computing device is connected to the display device and before the one or more processors determine whether the external computing device meets the condition, performance information representing the computing performance of the external computing device, i.e., the first computing performance, is obtained, wherein the condition is: the first computing performance represented by the performance information is greater than or equal to the computing performance of the one or more processors, i.e., the second computing performance.

[0109] Based on the above structure, the display device is able to perform appropriate control corresponding to the difference between the performance of one or more processors and the performance of external computing devices.

[0110] Appendix 4

[0111] According to the control method of the display device described in Appendix 2 or Appendix 3, the control method of the display device includes the following process: after the external computing device is connected to the display device and before the one or more processors determine whether the external computing device meets the condition, obtaining license information indicating whether the external computing device has a license for at least a portion of the application software for performing the first computing process, wherein the condition is: according to the license information, it is shown that the external computing device has the license.

[0112] Based on the above structure, the display device can perform appropriate control corresponding to whether or not there is a license for application software on the external computing device.

[0113] Appendix 5

[0114] The control method for the display device according to any one of Appendix 2 to Appendix 4, wherein the control method for the display device includes the following processing: after the external computing device is connected to the display device and before the one or more processors determine whether the external computing device meets the condition, obtaining installation information indicating the installation status of application software for performing at least a portion of the first computing process on the external computing device, wherein the condition is: according to the installation information, it is shown that the application software is installed on the external computing device.

[0115] Based on the above structure, the display device can perform appropriate control corresponding to the installation status of the application software in the external computing device.

[0116] Appendix 6

[0117] The control method for a display device according to any one of Appendix 2 to Appendix 5, wherein the control method for the display device includes the following processing: after the external computing device is connected to the display device and before the one or more processors determine whether the external computing device meets the condition, obtaining GPU information indicating the status of GPU, i.e., graphics processing unit, on the external computing device, wherein the condition is: according to the GPU information, it is shown that the GPU is mounted on the external computing device.

[0118] Based on the above structure, the display device can perform appropriate control corresponding to the GPU configuration in the external computing device.

[0119] Appendix 7

[0120] The control method for a display device according to any one of Appendices 2 to 6, wherein the control method for the display device includes the following processing: when the one or more processors determine that the external computing device meets the condition, after the determination and before the external computing device performs at least a portion of the first computing process, the display device displays a selection image for accepting a first response that causes the external computing device to perform at least a portion of the first computing process or for not performing at least a portion of the first computing process; the processing for causing the external computing device to perform at least a portion of the first computing process includes: when the one or more processors determine that the first response has been accepted via the selection image, causing the external computing device to perform at least a portion of the first computing process; the processing for only the one or more processors to perform the first computing process includes: when the one or more processors determine that the second response has been accepted via the selection image, only the one or more processors perform the first computing process.

[0121] Based on the above structure, and based on the selection image for whether to actually perform the first operation processing, the user can make the following judgment: to make the external computing device actually perform at least a portion of the first operation processing.

[0122] Postscript 8

[0123] The control method for the display device according to any one of Appendix 2 to Appendix 7, wherein the control method for the display device includes the following process: after the one or more processors determine that the external computing device meets the condition and before the external computing device executes at least a portion of the first computing process, a script language program corresponding to a compiled language program storing the process of the first computing process in a storage device is sent to the external computing device.

[0124] According to the above structure, the external computing device is able to perform at least a portion of the first arithmetic process.

[0125] Postscript 9

[0126] A display system includes a display device and an external computing device, the display device having one or more processors, which, before starting a first computing process, displays a recommended image that recommends performing at least a portion of the first computing process using the external computing device, which is different from the display device.

[0127] Based on the above structure, when users want to use an external computing device to share the computation of the display device, they can easily determine the timing and conditions under which the external computing device should be used.

[0128] More specifically, according to the above structure, since a recommended image is displayed before the first calculation process begins, the user can easily understand whether the first calculation process should utilize an external computing device.

Claims

1. A method for controlling a display device, comprising the following processing: Before one or more processors of the display device displaying the image begin the first computational processing, a recommended image is displayed as the image, the recommended image recommending that at least a portion of the first computational processing be performed using an external computing device different from the display device.

2. The control method for the display device according to claim 1, wherein, The control method for the display device includes the following processing: After the external computing device is connected to the display device, the one or more processors determine whether the external computing device meets at least a portion of the conditions for performing the first computing process; If the one or more processors determine that the external computing device meets the conditions, the external computing device executes at least a portion of the first arithmetic process; and If the one or more processors determine that the external computing device does not meet the conditions, the first computing process shall be performed only by the one or more processors.

3. The control method for the display device according to claim 2, wherein, The control method for the display device includes the following processing: after the external computing device is connected to the display device and before the one or more processors determine whether the external computing device meets the condition, performance information representing the computing performance of the external computing device, i.e., the first computing performance, is obtained. The condition is that the first computing performance, as represented by the performance information, is at least equal to or greater than the second computing performance of the one or more processors.

4. The control method for the display device according to claim 2, wherein, The control method for the display device includes the following processing: after the external computing device is connected to the display device and before the one or more processors determine whether the external computing device meets the condition, obtaining license information indicating whether the external computing device has a license for at least a portion of the application software used to perform the first computing process. The condition is that, according to the license information, the external computing device is shown to have the license.

5. The control method for the display device according to claim 2, wherein, The control method for the display device includes the following processing: after the external computing device is connected to the display device and before the one or more processors determine whether the external computing device meets the condition, obtaining installation information indicating the installation status of application software for performing at least a portion of the first computing process on the external computing device. The condition is that, according to the installation information, the application software is installed on the external computing device.

6. The control method for the display device according to claim 2, wherein, The control method for the display device includes the following processing: after the external computing device is connected to the display device and before the one or more processors determine whether the external computing device meets the conditions, obtaining GPU information indicating the GPU, i.e., the graphics processing unit's, connection status to the external computing device. The condition is that, according to the GPU information, the external computing device is equipped with the GPU.

7. The control method for the display device according to claim 2, wherein, The control method for the display device includes the following processing: when the one or more processors determine that the external computing device meets the condition, after the determination and before the external computing device executes at least a portion of the first computing process, the display device displays a selection image indicating whether to accept a first response to allow the external computing device to execute at least a portion of the first computing process or not to execute at least a portion of the first computing process. The process of causing the external computing device to perform at least a portion of the first computational process includes: if the one or more processors determine that the first response has been accepted via the selection image, causing the external computing device to perform at least a portion of the first computational process. The process of performing the first arithmetic process only by the one or more processors includes: if the one or more processors determine that the second response has been accepted via the selected image, the one or more processors perform the first arithmetic process only by the one or more processors.

8. The control method for the display device according to claim 2, wherein, The control method for the display device includes the following processing: After the one or more processors determine that the external computing device meets the conditions and before the external computing device executes at least a portion of the first computing process, a script language program corresponding to the compiled language program storing the process of the first computing process in the storage device is sent to the external computing device.

9. A display system comprising a display device and an external computing device, The display device includes one or more processors that, before starting the first computational process, display a recommended image that recommends performing at least a portion of the first computational process using an external computing device different from the display device.

Images