Program and terminal

Abstract

The purpose of the present invention is to reduce the feeling of discomfort of a user due to a communication delay in a remote terminal having a mirroring display function and a remote input function. A remote terminal (10) is provided with a display unit (102), a control unit (110), and a communication unit (101). A communication unit (101) communicates with an information processing terminal that displays an image on the basis of position information indicating a position within a screen received from a remote terminal (10), and that transmits image data indicating the image being displayed to the remote terminal (10). The control unit (110) executes the steps of: receiving image data from the information processing terminal (20); displaying, on a display unit (102), a first image based on the received image data; receiving designation of the position of the display unit (102); transmitting information indicating the designated position to the information processing terminal; and temporarily displaying the second image at the specified position.

Description

Technical Field

[0001] The present invention relates to rendering processing. Background Art

[0002] There are various techniques for remotely operating an information processing terminal such as a personal computer while confirming the processing content of the information processing terminal from physically separated locations. As an example of a technique for remotely operating an information processing terminal, techniques disclosed in Patent Documents 1 to 5, for example, can be cited in which a mirror display function and a remote input function are provided in a remote terminal that communicates with the information processing terminal. The mirror display function is a function of displaying a screen identical to the display screen of the information processing terminal. The remote input function is a function of accepting an operation by a user and transmitting the content of the operation to the information processing terminal.

[0003] Prior Art Documents

[0004] Patent Documents

[0005] Patent Document 1: Japanese Patent No. 6335738

[0006] Patent Document 2: International Publication No. 2017 / 187706

[0007] Patent Document 3: Japanese Patent No. 5831412

[0008] Patent Document 4: Japanese Patent No. 5770782

[0009] Patent Document 5: Japanese Patent No. 6464692 Summary of the Invention

[0010] Problems to be Solved by the Invention

[0011] From the time when a user operates a remote terminal having a mirror display function and a remote input function until the content of the operation is reflected on the display screen of the remote terminal, there is a lag corresponding to the delay in communication between the remote terminal and the information processing terminal. In particular, when the operation on the remote terminal is an operation that requires real-time performance (for example, an operation of causing a drawing software being executed on the information processing terminal to draw a line), the sense of discomfort of the user due to the above lag increases.

[0012] Usage Figure 11 and Figure 12 This will be described. In such a remote terminal, a user executes a drawing application such as a line or a graphic, and as Figure 11 shown, an operation of drawing a curve Lx from a point PS to a point PE is performed using an input device such as a touch operation pen for the screen.

[0013] Figure 12Shows the content displayed on the screen of the remote terminal at this time. Assume that the drawing operation starts at time T0 and ends at time T5. In this series of operations, the display contents of the screens at times T1, T2, T3, and T4 are G01, G02, G03, and G04 respectively. In addition, the object PN is shown for the sake of conveniently showing the position operated by the user at each time, and it is not necessary to be displayed on the actual display screen.

[0014] If there is no communication delay between the remote terminal and the information processing terminal at all, the drawing position PP should be consistent with the position PT of the terminal of the displayed line. However, as Figure 12 shown, due to the existence of communication delay, there is a deviation between the position PP and the position PT. Thus, there is a time lag until the operation result is reflected in the position PP specified by the user, and therefore the user may feel discomfort.

[0015] One of the objects of the present invention is to reduce the discomfort of the user caused by the communication delay with the information processing terminal in a remote terminal having a mirror display function and a remote input function.

[0016] Means for solving the problem

[0017] In one aspect, the present invention provides a program for causing a computer to execute the following steps: receiving image data from an information processing terminal, the information processing terminal displaying an image according to the position information representing a position within the screen received from the computer and sending the image data representing the displayed image to the computer; displaying a first image based on the received image data on a display unit; accepting the designation of the position of the display unit; sending the information representing the designated position to the information processing terminal; and temporarily displaying a second image at the designated position.

[0018] According to this program, it is possible to reduce the discomfort of the user caused by the communication delay between the computer having a mirror display function and a remote input function and the information processing terminal.

[0019] In a preferred aspect, the program has a step of causing the computer to further execute the following step: deleting the second image when a predetermined period has elapsed since the display of the second image.

[0020] According to this aspect, it is possible to reduce the discomfort of the user caused by the communication delay between the computer having a mirror display function and a remote input function and the information processing terminal, and it is possible to delete the second image at the moment when a predetermined period has elapsed since the display of the second image.

[0021] In a preferred aspect, the first image and the second image are points or lines, and the first image and the second image are displayed in a visually distinguishable manner.

[0022] According to this method, it is possible to reduce the sense of discomfort of the user caused by the delay in communication between a computer having a mirror display function and a remote input function and an information processing terminal, and it is also possible to delete the second image at the moment when a predetermined period has elapsed since the display of the second image, and it is further possible to display the first image and the second image, which are a point or a line respectively, in a visually distinguishable manner.

[0023] In a preferred embodiment, at least one of the type of line, the thickness of the line, and the color of the line is different between the first image and the second image.

[0024] According to this program, it is possible to reduce the sense of discomfort of the user caused by the delay in communication between a computer having a mirror display function and a remote input function and an information processing terminal, and it is also possible to delete the second image at the moment when a predetermined period has elapsed since the display of the second image, and it is further possible to display the first image and the second image, which are a point or a line respectively, in a visually distinguishable manner by making at least one of the type of line, the thickness of the line, and the color of the line different.

[0025] In a preferred embodiment, the predetermined period is determined according to the amount of delay in communication between the computer and the information processing terminal.

[0026] According to this method, it is possible to reduce the sense of discomfort of the user caused by the delay in communication between a computer having a mirror display function and a remote input function and an information processing terminal, and it is also possible to delete the second image at the moment when a predetermined period determined according to the amount of delay in this communication has elapsed since the display of the second image.

[0027] In a preferred embodiment, the second image continuously or stepwise changes in a manner approaching the first image over time.

[0028] According to the program of this method, the second image can continuously approach the first image over time.

[0029] In another aspect, the present invention provides a terminal having: a display unit; a control unit; an input unit that receives an input of position information indicating a position within the screen of the display unit; and a communication unit that communicates with an information processing terminal. When the control unit receives image data from the information processing terminal, it displays a first image based on the received image data on the display unit. When a designation of a position on the display unit is received, it sends information indicating the designated position to the information processing terminal and temporarily displays a second image at the designated position on the display unit.

[0030] According to this terminal, it has a mirror display function and a remote input function, and can reduce the sense of discomfort of the user caused by the delay in communication with the information processing terminal. Description of the Drawings

[0031] Figure 1 It is a diagram showing a structural example of an information processing system 1 including a remote terminal 10 according to an embodiment of the present invention.

[0032] Figure 2 It is a diagram showing a structural example of the remote terminal 10.

[0033] Figure 3 It is a flowchart showing the flow of a display method executed by a control unit 110 of the remote terminal 10 according to a program PR.

[0034] Figure 4 It is a diagram for explaining an operation example of the remote terminal 10.

[0035] Figure 5 It is a diagram for explaining an operation example of the remote terminal 10.

[0036] Figure 6 It is a diagram for explaining an operation example of the remote terminal 10.

[0037] Figure 7 It is a diagram for explaining an operation example of the remote terminal 10.

[0038] Figure 8 It is a diagram for explaining an operation example of the remote terminal 10.

[0039] Figure 9 It is a diagram showing an example of the time change of an image displayed on the screen of the remote terminal 10.

[0040] Figure 10 It is a diagram showing another example of the time change of an image displayed on the screen of the remote terminal 10.

[0041] Figure 11 It is a diagram for explaining the problems of the existing example (part 1).

[0042] Figure 12 It is a diagram for explaining the problems of the existing example (part 2). Detailed Description of the Invention

[0043] <A. Embodiment>

[0044] Figure 1 It is a diagram showing an example of the overall structure of the information processing system 1. As Figure 1As shown, the information processing system 1 includes a remote terminal 10 and an information processing terminal 20, and the information processing terminal 20 communicates with the remote terminal 10 via a communication network. In Figure 1 the figure, the communication network that relays the communication between the remote terminal 10 and the information processing terminal 20 is omitted. The remote terminal 10 is a terminal for remotely operating the information processing terminal 20 via a communication network. The information processing terminal 20 is a source terminal that displays an image as an information resource (source), and the image as the information resource (source) is an object to be remotely operated by the remote terminal 10. The information processing terminal 20 displays an image according to the position information indicating the position within the screen received from the remote terminal 10, and sends the image data representing the displayed image to the remote terminal 10. In the present embodiment, as an example of the image that is an object to be remotely operated by the remote terminal 10, an image of a screen displayed by executing drawing software in the information processing terminal 20 can be cited, that is, an image of a user interface screen for accepting the operation of a user such as drawing a line or a point and allowing the user to confirm the drawing result corresponding to the operation.

[0045] The information processing terminal 20 is, for example, a personal computer having a personal computer monitor with a size of 27 inches, the image resolution of the monitor is 1920×1080, and the aspect ratio of the image displayed on the monitor is 16:9. The information processing terminal 20 can also be a smart phone or a television, etc. Also, the information processing terminal 20 can be composed of a combination of multiple devices. For example, the information processing terminal 20 can be a terminal in which a dongle equipped with an image processing processor is installed in the multimedia interface of a liquid crystal television. In Figure 1 the figure, one information processing terminal 20 is illustrated, but the information processing system 1 can also include two or more information processing terminals 20.

[0046] The remote terminal 10 is connected to the information processing terminal 20 via wireless communication through a communication network, and remotely operates the information processing terminal 20 at the connection destination. The remote terminal 10 has: a mirror display function for displaying the image shown by the image data received from the information processing terminal 20; and a remote input function for accepting the operation of a user and providing the position information indicating the position specified by the user's operation to the information processing terminal 20. Regarding the remote terminal 10, for example, a tablet PC with a monitor size of 12 inches can be cited. The image resolution of the remote terminal 10 in the present embodiment is 1920×1200, and the aspect ratio of the image displayed on the remote terminal 10 is 16:10.

[0047] The remote terminal 10 of the present embodiment is configured to reduce the sense of discomfort of the user even when there is a lag corresponding to the communication delay between the remote terminal 10 and the information processing terminal 20 from the time when the user performs an operation until the content of the operation is reflected on the display screen of the present device, and this is the feature of the present embodiment. Hereinafter, the remote terminal 10 that significantly exhibits the features of the present embodiment will be described as the center.

[0048] Figure 2 FIG. is an example showing the structure of the remote terminal 10. Figure 2 The remote terminal 10 shown has a communication unit 101, a display unit 102, a sound playback unit 103, a storage unit 104, a sound control unit 105, a display control unit 106, an input unit 107, and a control unit 110.

[0049] The control unit 110 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory), and functions as a control center of the remote terminal 10 by reading and executing the program PR stored in the ROM and the storage unit 104 by the CPU. Further, the control unit 110 controls the sound playback unit 103 via the sound control unit 105, and controls the display unit 102 via the display control unit 106. The sound playback unit 103 is a device that plays sound under the control of the sound control unit 105, such as a speaker or headphones. The sound control unit 105 is a device that controls the sound playback unit 103, such as a sound controller.

[0050] The display unit 102 has a display surface such as a liquid crystal display, and displays an image under the control of the display control unit 106. The display control unit 106 is a device that controls the display unit 102 according to an instruction from the control unit 110. The display control unit 106 is, for example, a display controller or a graphics controller. The display control unit 106 may also include a graphics processing unit (GPU: Graphics Processing Unit), or may be installed as one or more CPUs having a drawing processing function.

[0051] The storage unit 104 is a storage unit such as a semiconductor memory (solid state drive) or a hard disk drive, and stores various programs, data, etc. read by the CPU of the control unit 110. As an example of various programs stored in the storage unit 104, in addition to the program PR, a kernel program that enables the control unit 110 to implement an OS (Operating System) can be cited. In addition, programs other than the program PR among the various programs stored in the storage unit 104 are not shown.

[0052] The input unit 107 has operating members (not shown) such as operation buttons, a keyboard, and a touch panel for performing various instructions, accepts the operations of the user, and sends a signal corresponding to the operation content to the control unit 110. Further, the input unit 107 has an operation content determination unit 108 and a position information detection unit 109.

[0053] The position information detection unit 109 detects position information indicating a position on the screen or image indicated by the operation of the user. The position information detection unit 109 is, for example, the above-described touch panel. The touch panel is formed of a transparent material and is disposed overlapping on the display surface of the display unit 102. The position information detection unit 109 sends the detected position information to the operation content determination unit 108. The operation content determination unit 108 determines the operation of the user accepted by the above-described operating member. The operation content determination unit 108 receives a signal sent by the operating member according to the operation of the user, refers to, for example, a correspondence table stored in the storage unit 104, and determines the content of the operation performed by the user according to the mode of the received signal. In addition, the operation content determination unit 108 uses the position information received from the above-described position information detection unit 109 as a signal indicating the operation of the user. Further, a part or all of the functions of the input unit 107 may also be implemented by the control unit 110.

[0054] The communication unit 101 is a communication circuit that is wirelessly connected to a communication network. The remote terminal 10 exchanges information with other devices (i.e., external devices including the information processing terminal 20) connected to the communication network through the communication unit 101. The communication unit 101 provides a function of connecting the remote terminal 10 to the communication network in accordance with a standard based on so-called wireless LAN, such as IEEE802.11. In addition, the remote terminal 10 may also be directly connected to the information processing terminal 20 without passing through the communication network. For example, the remote terminal 10 and the information processing terminal 20 may also have a function of connecting to each other in accordance with a standard based on near field communication (NFC), such as ISO / IEC18092 (NFCIP-1), ISO / IEC14443, ISO / IEC15693, or IEEE802.15. For example, the remote terminal 10 and the information processing terminal 20 may also be connected using a display transmission technology based on one-to-one wireless communication such as Miracast (registered trademark) and AirPlay (registered trademark).

[0055] Further, the remote terminal 10 and the information processing terminal 20 may also be directly communicably connected in a wired manner such as in accordance with the manner of IEEE802.3. In this case, the communication unit 101 is an interface for wired communication.

[0056] When an operation to instruct the execution of the program PR is performed on the input unit 107, the control unit 110 starts executing the program PR. The control unit 110 that operates according to the program PR starts communicating with the information processing terminal 20 and executes Figure 3 the display method shown. As Figure 3 shown, the display method includes a first determination process SA100, a first display process SA110, a second determination process SA120, a transmission process SA130, a second display process SA140, and a third determination process SA150. The processing contents of each of the first determination process SA100, the first display process SA110, the second determination process SA120, the transmission process SA130, the second display process SA140, and the third determination process SA150 are as follows.

[0057] In the first determination process SA100, the control unit 110 determines whether image data is received from the information processing terminal 20, and during the period when the determination result of the first determination process SA100 is "no", the first determination process SA100 is repeatedly executed. When image data is received from the information processing terminal 20 and the determination result of the first determination process SA100 becomes "yes", the control unit 110 executes the first display process SA110. That is, the first determination process SA100 of the present embodiment is an example of the step of receiving image data from the information processing terminal 20.

[0058] In the first display process SA110, the control unit 110 displays an image based on the image data received from the information processing terminal 20 on the display unit 102. As described above, in the present embodiment, drawing software is executed on the information processing terminal 20, and the image data sent from the information processing terminal 20 to the remote terminal 10 represents an image of the user interface screen of the drawing software. Therefore, in a state where the control unit 110 operates according to the program PR and the remote terminal 10 communicates with the information processing terminal 20, an image of the user interface screen of the drawing software being executed in the information processing terminal 20 is displayed on the display unit 102.

[0059] Figure 4The shown image G1 is an example of an image of a user interface screen of drawing software being executed in the information processing terminal 20. The image G1 has two regions, a region A1 and a region A2. The region A2 corresponds to a virtual canvas, which is the destination for drawing lines and the like. Icons B1 for a virtual pen for drawing lines and the like on the virtual canvas, an icon B2 for a virtual eraser for erasing lines drawn by the virtual pen, an icon B3 for virtual paint for applying colors to the virtual canvas, and other icons for allowing the user to select various drawing tools are arranged in the region A1. The user can select a desired drawing tool by selecting the icon arranged in the region A1 and perform a drawing operation on the region A2 using the selected drawing tool. Hereinafter, in this operation example, the case of selecting the icon B1 of the virtual pen and using the virtual pen to draw a line in the region A2 will be described.

[0060] In the second determination process SA120 after the first display process SA110, the control unit 110 determines whether an input operation for designating the position of the acceptance display unit 102 has been performed based on the output signal of the operation content determination unit 108. In other words, the second determination process SA120 is a step of designating the position of the acceptance display unit 102. When an input operation for designating the position of the acceptance display unit 102 has been performed, the determination result of the second determination process SA120 is "Yes". In contrast, when an input operation different from the input operation for designating the position of the acceptance display unit 102 has been performed, the determination result of the second determination process SA120 is "No". As an example of an input operation for designating the position of the acceptance display unit 102, the following operation can be cited: using the virtual pen, as Figure 5 shown, draw a line L1 from the point PS to the point PE in the region A2. In this case, the control unit 110 accepts the positions of the respective points of the line L1 as the positions designated by the user. As an example of an input operation different from the input operation for designating the position of the acceptance display unit 102, an end operation for ending the execution of the program PR can be cited.

[0061] In the transmission process SA130 executed when the determination result of the second determination process SA120 is "Yes", the control unit 110 transmits the position information indicating the position designated by the input operation to the information processing terminal 20. In this operation example, when an input operation of drawing the line L1 in the region A2 is performed as Figure 5 shown, in the transmission process SA130, the position information indicating the positions of the respective points on the line L1, that is, the information indicating the line L1, is transmitted to the information processing terminal 20. The information processing terminal 20 generates an image of a user interface screen representing an image (i.e., Figure 5 the image of the line L2 in) drawn in the region A2 corresponding to this information (as Figure 6As shown, the image data of the image G2 of the user interface screen of the line L2 corresponding to the line L1 is depicted by a solid line in the area A2 and sent to the remote terminal 10. The image of the line L2 depicted by a solid line is an example of the first image of the present invention.

[0062] In the second display process SA140 after the transmission process SA130, the control unit 110 overlays and displays a second image, which depicts an image corresponding to the depiction content of the input operation in a manner different from the first image, at a position specified by an input operation on the image displayed in the first display process SA110. In this operation example, the second image is also an image of a line like the first image, but the second image depicts the image of the line L1 in a manner visually distinguishable from the first image. Specifically, as Figure 7 shown, the image G3 of this operation example is an image (line L3) of the line L1 depicted by a dotted line. The image of the line L1 depicted by a dotted line is an example of the second image of the present invention.

[0063] In addition, in this operation example, in the first image and the second image, the types of lines (solid line and dotted line) are made different, but instead of or in addition to the types of lines, the thickness and / or color of the line may be made different. In short, as long as at least one of the type of line, the thickness of the line, and the color of the line is different so as to be able to visually distinguish the first image and the second image.

[0064] As a result of executing the second display process SA140, an image obtained by overlaying the image G3 on the image G1, that is, Figure 8 the image G4 shown, is displayed on the display unit 102 of the remote terminal 10. After executing the second display process SA140, the control unit 110 executes the first determination process SA100 and subsequent processes again, and the image displayed on the display unit 102 in the second display process SA140 is updated by executing the first display process SA110 again. That is, the second display process SA140 is a step of temporarily displaying the second image. In addition, in the present embodiment, when the determination result in the second determination process SA120 is "yes", first, the transmission process SA130 is executed, and then the second display process SA140 is executed, but the execution order of the transmission process SA130 and the second display process SA140 may be swapped.

[0065] In the third determination process SA150 that is executed when the determination result of the second determination process SA120 is "no", the control unit 110 determines whether the input operation performed on the input unit 107 is an end operation. When the determination result of the third determination process SA150 is "no", the control unit 110 executes the first determination process SA100 and subsequent processes again. When the determination result of the third determination process SA150 is "yes", the control unit 110 ends the execution of the program PR and ends this display method.

[0066] The feature of this embodiment is that the second display process SA140 is provided. If the image G2 can be immediately displayed on the display unit 102 after the input operation of drawing the line L1 is accepted by the remote terminal 10, no particular problem will occur even if the second display process SA140 is not executed. However, from the time when the input operation of drawing the line L1 is accepted by the remote terminal 10 until the remote terminal 10 receives the image data representing the image G2, a waiting time, that is, a delay, corresponding to the data communication between the remote terminal 10 and the information processing terminal 20 will occur. Therefore, if the second display process SA140 is not executed, during the above waiting time, the image G1 is continuously displayed on the remote terminal 10, and the input operation of drawing the line L1 will not be visually reflected. The fact that this input operation is not visually reflected will cause a sense of discomfort for the user. In this embodiment, by executing the second display process SA140 corresponding to the input operation of drawing the line L1 and displaying the image G3 on the remote terminal 10, the sense of discomfort of the user can be reduced.

[0067] Use Figure 9 For further specific description.

[0068] Figure 9 It is a diagram showing the images displayed on the display unit 102 of the remote terminal 10 in time series when the user performs the above-described action of drawing the line L1. Specifically, when the drawing action starts at time T = T0 and ends at T = T5, the display contents (G11, G12, G13, G14, G15) at each of the times T = T1, T2, T3, T4, T5 are shown. In addition, the object PN depicted in this diagram is drawn for the sake of explaining the position specified by the user at each time (in the case of using a pen device to input operation information, it is the position where the pen device contacts the touch panel, and in the case of using a finger to input operation information, it is the position on the touch panel where the finger contacts), and it does not need to be necessarily displayed in the actual screen.

[0069] As shown in the figure, in a series of operations for drawing line L1, line L3 is displayed in a manner that is independent of communication delay (i.e., the display content instantaneously follows the input operation), and line L2 is displayed in an overlapping manner with a delay of the time affected by the communication delay. The user will recognize that the drawing process is performed immediately in response to the input operation, so it is not easy to feel incongruity from the perspective of operation response. In the drawing operation, line L2, which was originally to be displayed, is displayed overlapping with line L3, and when the drawing operation is completed, line L2 cannot be visually recognized or becomes inconspicuous. In other words, even if it can be said that unintentional drawing is temporarily performed in the middle of the drawing operation, the result of the operation and the image finally displayed are the same as the image intended by the user. That is, the image intended by the user is finally drawn, so line L3 will not bring a new sense of incongruity to the user.

[0070] As described above, according to the present embodiment, it is possible to reduce the user's sense of discomfort caused by a delay in communication between the remote terminal 10 having the mirror display function and the remote input function and the information processing terminal 20 .

[0071] <B.变形>

[0072] An embodiment of the present invention has been described above, but this embodiment may be modified as follows.

[0073] Alternatively, the type, thickness, and color of the line may be the same in the first image and the second image. In other words, the first image and the second image may be the same image and may be completely overlapped and displayed on the display unit 102. In this case, in the above example, line L3 cannot be visually recognized at all after line L2 is displayed. In this case, the user can feel as if there is no communication delay at all.

[0074] In the above embodiment, the following step may be included: when a predetermined condition is satisfied, the second image is deleted. Specifically, the following step may be included: when a predetermined period has passed since the second display process SA140 was executed, the second image is deleted. The predetermined time may be a fixed value such as 0.1 seconds, or a variable value determined according to the delay amount of the communication between the remote terminal 10 and the information processing terminal 20. Specifically, the greater the delay amount of the communication between the remote terminal 10 and the information processing terminal 20, the longer the predetermined time may be set.

[0075] use Figure 10 Provide specific instructions. Figure 10 Is the user Figure 9The figure shows the display content of the screen at each moment (i.e., the image that is the result of the overlapping display of the image G2 (line L2) and the image G3 (line L3); G21A to G25A) corresponding to the display content in the case where only the image G3 (line L3) is displayed (G21B to G25B; so it is not actually the display screen visually recognized by the user) in the case of performing the same operation as the shown operation.

[0076] As shown in this figure, different from Figure 9 the shown case, the line L3 is deleted when a predetermined time has elapsed based on the depicted moment. Thus, even in the case where the line L3 and the line L2 are depicted in a manner that can clearly distinguish between the line L3 and the line L2, it is possible to prevent the visual recognition of the line L2 intended to be depicted by the user from being reduced due to the presence of the line L3 that is not originally required in terms of the meaning not intended to be depicted by the user.

[0077] Alternatively, the display method of the present invention may also include the following steps: changing the second image corresponding to the elapsed time since the execution of the second display process SA140. Specifically, as time elapses since the execution of the second display process SA140, the second image is continuously changed in such a way that the second image approaches the first image. As an example, in the case where the second image is represented by a lighter color than the first image, the color of the second image is gradually deepened as time passes. That is, the concentration of the pixels constituting the points, lines, or other images is continuously or stepwise changed to approach the second image. In addition, instead of the concentration, other color-related parameters such as brightness, chroma, and lightness may be changed. In this way, by giving the user a feeling that the presence of the line L3 gradually and naturally thins out, it is possible to further reduce the sense of discomfort of the user caused by the presence of the line L3.

[0078] In the above-described embodiment, the program PR is stored in the storage unit 104 of the remote terminal 10, but the program PR may also be manufactured as a single unit, and the program PR may also be transferred such as sold in the form of a single unit. As a specific providing method when providing the program PR to the transfer target, the following methods can be cited: downloading via an electrical communication line such as the Internet, or distributing by writing the program PR into a computer-readable recording medium such as a flash ROM.

[0079] In summary, in the present invention, an information processing system is composed of a remote terminal and an information processing terminal. The information processing terminal displays an image according to position information indicating a position within a screen received from the remote terminal, and transmits image data representing the displayed image to the remote terminal. The information processing system only needs to perform the following steps: the aforementioned remote terminal receives the image data from the aforementioned information processing terminal; displays a first image based on the image data received by the remote terminal on a display unit of the remote terminal; accepts designation of a position of the display unit in the remote terminal; transmits information indicating the designated position from the remote terminal to the information processing terminal; and temporarily displays a second image at the designated position in the remote terminal.

[0080] Reference Signs Explanation

[0081] 1: Information processing system; 10: Remote terminal; 20: Information processing terminal; 101: Communication unit; 102: Display unit; 103: Sound playback unit; 104: Storage unit; 105: Audio control unit; 106: Display control unit; 107: Input unit; 108: Operation content determination unit; 109: Position information detection unit; 110: Control unit; PR: Program.

Claims

1. A program for causing a computer to perform the following steps: Receiving image data from an information processing terminal that displays an image based on position information indicating a position within a screen received from the computer and sends the image data representing the displayed image to the computer; Display the first image based on the received image data on the display unit; Accept the designation of the position of the display unit; Send the information indicating the designated position to the information processing terminal; and Temporarily display the second image at the designated position.

2. The program according to claim 1, wherein, This program causes the computer to further execute the following step: When a predetermined period has elapsed since the second image was displayed, delete the second image.

3. The program according to claim 2, wherein, The first image and the second image are points or lines, The first image and the second image are displayed in a visually distinguishable manner.

4. The program according to claim 3, wherein, In the first image and the second image, at least one of the type of line, the thickness of the line, and the color of the line is different.

5. The program according to claim 2, wherein, The predetermined period is determined according to the delay amount of the communication between the computer and the information processing terminal.

6. The program according to any one of claims 1 to 5, wherein, The second image continuously or periodically changes over time in a manner approaching the first image.

7. A terminal having: A display unit; A control unit; An input unit that accepts input of position information indicating a position within the screen of the display unit; and A communication unit that communicates with an information processing terminal, When the control unit receives image data from the information processing terminal, it displays a first image based on the received image data on the display unit. When a position within the display unit is specified, it sends information indicating the specified position to the information processing terminal and temporarily displays a second image at the specified position on the display unit.

Images