Display Control Program

JP7632193B2Active Publication Date: 2025-02-19BROTHER KOGYO KK
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2021145308
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-09-07
Publication Date
2025-02-19
Estimated Expiration
2041-09-07

Smart Images

  • Figure 0007632193000001
    Figure 0007632193000001
  • Figure 0007632193000002
    Figure 0007632193000002
  • Figure 0007632193000003
    Figure 0007632193000003
Patent Text Reader

Abstract

To provide a display control program that enables a user to grasp an operation by another apparatus outside a display area, even when different display areas are displayed for each terminal apparatus.SOLUTION: A terminal apparatus includes: a display unit; a communication unit; and a control unit. According to a display control program, the control unit acquires arrangement information indicating an arrangement of a display area displayed on the display unit with respect to an edition area shared with other apparatuses (S21), receives, from another apparatus via the communication unit, pointer information indicating a position of a pointer with respect to the edition area (S20), determines whether the pointer is within the display area based on the received pointer information and the acquired arrangement information (S22), displays the pointer at the position indicated by the arrangement information in the display area when it is determined that the pointer is within the display area (S27), and display on the display unit a mark indicating that the pointer is not within the display area when it is not determined that the pointer is within the display area (S24).SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a display control program. [Background technology]

[0002] A conventional display control program controls pointer movement when multiple terminal devices connected via a communication line share and display the same window among multiple windows for collaborative editing. Specifically, in accordance with the display control program, when a pointer displayed on the display unit of the terminal device is outside the frame of a shared window, the terminal device determines a destination window from a change in distance between the pointer and each of the multiple windows. The terminal device transmits pointer data including information about the destination window to other terminal devices. The terminal device that receives the pointer data moves the other terminal device's pointer toward the destination window based on the pointer data. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2010-224872 A Summary of the Invention [Problem to be solved by the invention]

[0004] When a plurality of terminal devices are performing collaborative editing, the terminal devices can display a display area different from that of the other devices. In a terminal device that controls a pointer according to a conventional display control program, if the position of the pointer notified from the other device is outside the display area of ​​the terminal device, the user cannot know that the pointer is being operated on the other device.

[0005] An object of the present invention is to provide a display control program that enables a user to grasp operations performed by other devices outside the display area, even when different display areas are displayed on each terminal device. [Means for solving the problem]

[0006] A display control program of a first aspect is a display control program executed by a control unit of a terminal device having a display unit that displays an image, a communication unit that communicates with another device, and a control unit that controls the display unit and the communication unit, and includes instructions to cause the control unit to execute an arrangement acquisition process of acquiring arrangement information indicating an arrangement of a display area displayed on the display unit with respect to an editing area shared with the other device, a reception process of receiving pointer information indicating a position of a pointer with respect to the editing area from the other device via the communication unit, a determination process of determining whether the pointer is within the display area based on the received pointer information and the acquired arrangement information, a first display process of displaying the pointer at the position indicated by the arrangement information in the display area when it is determined that the pointer is within the display area, and a second display process of displaying on the display unit a mark indicating that the pointer is not within the display area when it is not determined that the pointer is within the display area. The terminal device that executes the display control program of the first aspect can execute the first display process and the second display process according to a determination result of the determination process. Therefore, even if different display areas are displayed on each terminal device, the user of the terminal device can know whether or not a pointer operation has been performed on another device from the mark displayed in the second display process.

[0007] A display control program of a second aspect is a display control program executed by a control unit of a terminal device having a display unit that displays an image, a communication unit that communicates with other devices, and a control unit that controls the display unit and the communication unit, and includes instructions to the control unit to execute an arrangement acquisition process that acquires arrangement information indicating the arrangement of a display area displayed on the display unit relative to an editing area shared with the other device, a reception process that receives operation information indicating an operation position and operation content relative to the editing area from the other device via the communication unit, a judgment process that determines whether the operation position is within the display area based on the received operation information and the acquired arrangement information, if it is determined that the operation position is within the display area, a display process that displays according to the operation content at the operation position indicated by the arrangement information in the display area, and a modification process that changes the arrangement of the display area relative to the editing area so that the operation position indicated by the operation information is within the display area, and displays according to the operation content at the operation position indicated by the arrangement information, if it is not determined that the operation position is within the display area. A terminal device that executes the display control program of the second aspect can execute a display process and a change process according to the result of the determination process. Therefore, even if a different display area is displayed for each terminal device, the user of the terminal device can understand the operation on the other device because the display area for the editing area is changed in the change process and a display according to the operation content is displayed at the operation position. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is an explanatory diagram of a system 15 including terminal devices 1A to 1C. [Diagram 2] 13 is a flowchart of an invitation process. [Diagram 3] 2A to 2C are explanatory diagrams of a joint editing start screen 21, a joint editing screen 25, and a joint editing end screen 45. [Figure 4] 13 is a flowchart of a joint editing process. [Diagram 5] FIG. 13 is an explanatory diagram of a process performed when a pointer 54 is operated in a state in which display areas 51 to 53 are different from an editing area 50. [Figure 6] FIG. 11 is an explanatory diagram of a process performed when a pointer 54 is operated in a state in which display areas 51 to 53 are different from an editing area 50 in the first and second modified examples. [Figure 7] FIG. 13 is an explanatory diagram of a process performed when a pointer 54 is operated in a state in which display areas 51 to 53 are different from an editing area 50 in a third modified example. [Figure 8] 13 is a flowchart of a collaborative editing process according to a fourth modified example. [Figure 9] FIG. 13 is an explanatory diagram of a process performed when an object 96 is operated in a state in which display areas 51 to 53 are different from an editing area 50. [Figure 10] FIG. 13 is an explanatory diagram of a process in which the field 42 on the screen 25 displayed on the terminal device 1C is switched from an image 100 to an image 103 in the collaborative editing process of the fourth modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] An embodiment of the present disclosure will be described with reference to the drawings. As shown in FIG. 1, a system 15 includes terminal devices 1A to 1C. In the system 15, a display control program described below is executed in each of the terminal devices 1A to 1C, so that the same window can be shared and displayed between the terminal devices 1A to 1C connected via a communication line, and collaborative editing can be performed. Each of the terminal devices 1A to 1C is a portable terminal device such as a mobile phone (e.g., a smartphone), a PDA, and a tablet PC. The terminal device 1A is operated by a user A, the terminal device 1B is operated by a user B, and the terminal device 1C is operated by a user C. Hereinafter, when the terminal devices 1A to 1C are not distinguished from each other, they are also referred to as terminal devices 1.

[0010] Each terminal device 1 includes a CPU 2, a ROM 3, a RAM 4, a storage unit 5, a communication unit 6, an input / output interface (I / O) 7, a display unit 9, and an input unit 10. The CPU 2 is connected to the ROM 3, the RAM 4, the storage unit 5, the communication unit 6, and the I / O 7 via a bus 8. The CPU 2 controls the terminal device 1. The ROM 3 stores a boot program, a BIOS, and the like. The RAM 4 stores temporary data. The storage unit 5 stores various setting values. The communication unit 6 is an interface for connecting to a network 11. The CPU 2 can transmit and receive data to and from other terminal devices 1 connected to the network 11 via the communication unit 6 and an access point 12. The display unit 9 and the input unit 10 are connected to the I / O 7. The display unit 9 can display an image, and is, for example, a liquid crystal display. The input unit 10 is a touch panel provided on the surface of the display unit 9, and outputs a detection signal according to the position of a pointer such as a stylus pen 14 or a finger.

[0011] With reference to Figs. 2 and 3, the invitation process executable by each terminal device 1 will be described. In the invitation process, a process of adding a user of another terminal device 1 to the members of the joint editing, starting the joint editing, and terminating the joint editing are executed. As an example, a case will be described in which the invitation process is executed by the terminal device 1A of user A, and users B and C are added to the members of the joint editing. When the CPU 2 detects an instruction to start the invitation process, it reads a program for executing the invitation process from the storage unit 5 to the RAM 4. The CPU 2 executes the invitation process having the following steps according to the instructions included in the program read to the RAM 4. Various data obtained during the invitation process are appropriately stored in the RAM 4. Hereinafter, steps are abbreviated as S.

[0012] As shown in FIG. 2, the CPU 2 of the terminal device 1A displays a collaborative editing start screen 21 (hereinafter simply referred to as screen 21) shown in FIG. 3 on the display unit 9 (S2). As shown in FIG. 3, the screen 21 displays keys 22 to 24. Key 22 is selected when canceling the start of the collaborative editing process. Key 23 is selected when instructing the start of the collaborative editing process. Key 24 is selected when adding a user of another terminal device 1 as a member of the collaborative editing. Based on a detection signal from the input unit 10, the CPU 2 determines whether selection of key 24 has been detected (S3). If selection of key 24 has not been detected (S3: NO), the CPU 2 performs the process of S5 described below.

[0013] User A selects the key 24 to input an instruction to add each of users B and C to the members of the collaborative editing. When the selection of the key 24 is detected (S3: YES), the CPU 2 outputs an invitation notification to the collaborative editing to the terminal device 1 of the selected member via the communication unit 6 (S4). Although not shown, a screen for selecting whether to accept or reject the invitation to the collaborative editing sent from the terminal device 1A is displayed on each of the terminal devices 1B and 1C that received the invitation notification. When the acceptance is selected on each of the terminal devices 1B and 1C, an acceptance notification is sent to the terminal device 1A, and when the rejection is selected, a rejection notification is sent to the terminal device 1A. The CPU 2 of the terminal device 1A judges whether the acceptance notification has been received via the communication unit 6 (S5). When the acceptance notification has been received (S5: YES), the CPU 2 of the terminal device 1A starts a collaborative editing process described later, and displays a collaborative editing screen 25 (hereinafter simply referred to as screen 25) shown in FIG. 3 on the display unit 9 (S6).

[0014] The screen 25 displays icons 26 to 41 and a field 42. Icon 26 is selected when instructing to switch the display screen. Icon 27 is selected when returning the display area for the editing area to the initial state. In this example, the initial state is a state in which the entire editing area is included in the display area. Icon 28 is selected when returning to the previous operation. Icon 29 is selected when redoing the next operation. Icon 30 is selected when outputting the contents of the editing area. Icon 31 is selected when adding strokes with a pen to the display area. Icon 32 is selected when deleting an object in the display area. Icon 33 is selected when adding strokes with a marker to the display area. Icon 34 is selected when selecting an object in the display area. Icon 35 is selected when inserting text into the display area. Icon 36 is selected when adding a figure to the display area. Icon 37 is selected when adding a file, figure, photo, etc. to the display area. Icon 38 is selected when operating the pointer. Icons 39 to 41 indicate figures that can be inserted into the display area when icon 36 is selected. Icon 39 is selected to add a rectangle to the display area. Icon 40 is selected to add a circle to the display area. Icon 41 is selected to add a triangle to the display area. The icon displayed to the right of icon 38 changes depending on which icon is selected among icons 31 to 38. Field 42 displays the display area of ​​the editing area.

[0015] If the acceptance notification is not received (S5: NO), or following S6, the CPU 2 of the terminal device 1A judges whether an end instruction has been detected (S7). The end instruction is input from a collaborative editing end screen 45 (hereinafter, simply referred to as screen 45) that is displayed when "End collaborative editing" is selected after the icon 26 is selected. The end instruction may be received from another terminal device 1 that is performing collaborative editing. The screen 45 displays keys 46 and 47. The key 46 is selected when canceling the end of the collaborative editing process. The key 47 is selected when ending the collaborative editing process. If the selection of the key 47 is not detected (S7: NO), the CPU 2 returns the process to S3. If the selection of the key 47 is detected (S7: NO), the CPU 2 of the terminal device 1A returns the process to S3. If the selection of the key 47 is detected (S7: YES), the CPU 2 of the terminal device 1A ends the collaborative editing process (S8), and the invitation process is thus ended.

[0016] The collaborative editing process of the terminal device 1 will be described with reference to FIG. 3 to FIG. 5. As an example, the collaborative editing process is executed in each of the terminal devices 1A to 1C, and a process corresponding to the operation of the pointer is executed in each of the terminal devices 1A to 1C based on the pointer 54 operated in the terminal device 1A. When the CPU 2 of each terminal device 1 detects a start instruction to start the collaborative editing process, it reads a display control program for executing the collaborative editing process from the storage unit 5 to the RAM 4. The start instruction is output in S6, and is transmitted from the other terminal device 1 after accepting an invitation notification from the other terminal device 1. The CPU 2 executes the collaborative editing process having the following steps according to the instructions included in the display control program read to the RAM 4. Various data obtained in the process of the collaborative editing process is appropriately stored in the RAM 4. Hereinafter, the steps are abbreviated as S. The collaborative editing processes in the terminal devices 1A to 1C are executed individually in each device, but will be described in parallel to simplify the explanation.

[0017] As shown in FIG. 4, the CPU 2 of each terminal device 1 displays the screen 25 of FIG. 3 on the display unit 9 (S11). The CPU 2 of each terminal device 1 determines whether editing of an object has been detected based on a detection signal from the input unit 10 (S12). When editing an object in the display area displayed in the column 42, the user selects one of the icons 31 to 37 according to the editing content, and then operates the column 42. The CPU 2 of each terminal device 1 detects an operation on the column 42 while one of the icons 31 to 37 is selected as an edited object. In the terminal device 1A, when the column 42 is operated during the selection of the icon 35 and input of the objects 55 to 58 shown in FIG. 5 is detected (S12: YES), the CPU 2 of the terminal device 1A transmits object information to the other terminal devices 1 that are performing collaborative editing, that is, the terminal devices 1B and 1C (S13). The object information includes the type of object according to the type of icon, the editing content, and the edit position of the object relative to the editing area 50. The editing contents include adding, deleting, enlarging, reducing, rotating, and transforming objects. Object 55 is the alphabet letter "A", object 56 is the alphabet letter "B", object 57 is the alphabet letter "C", and object 58 is the alphabet letter "D". CPU 2 of terminal device 1A performs an object editing process that reflects the editing of the object in editing area 50 and updates column 42 based on the detected object information (S15).

[0018] If no editing of the object is detected (S12: NO), the CPU 2 of each terminal device 1 judges whether or not object information has been received from another terminal device 1 via the communication unit 6 (S14). If object information has been received from terminal device 1A in each of terminal devices 1B and 1C (S14: YES), the CPU 2 of terminal devices 1B and 1C each performs an object editing process based on the received object information (S15). By the process of S15, the editing results of objects 55 to 58 inputted in terminal device 1A are reflected in the editing area 50 of each terminal device 1 in each of terminal devices 1A to 1C, and the column 42 of each terminal device 1 is updated.

[0019] When the object information is not received (S14: NO) or after S15, the CPU 2 of each terminal device 1 judges whether an operation to change the display area is detected based on the detection signal of the input unit 10 (S16). The user of each terminal device 1 can move the display area relative to the editing area 50 by dragging in the field 42. The user of each terminal device 1 can reduce the display area relative to the editing area 50 by pinching in on the field 42, and can enlarge the display area relative to the editing area 50 by pinching out. When an operation to change the display area is detected (S16: YES), the CPU 2 of each terminal device 1 changes the display area relative to the editing area 50 in accordance with the detected operation to change the display area (S17). As shown in FIG. 5, in the specific example, the processing of S16 and S17 changes the display area relative to the editing area 50 to the display area 51 in the terminal device 1A, to the display area 52 in the terminal device 1B, and to the display area 53 in the terminal device 1C.

[0020] If no operation to change the display area is detected (S16: NO), or after S17, the CPU 2 of each terminal device 1 judges whether or not the use of the pointer is detected based on the detection signal of the input unit 10 (S18). The CPU 2 of each terminal device 1 judges that the use of the pointer is detected when an operation of the field 42 is detected while the icon 38 is selected based on the detection signal of the input unit 10. In a specific example, the use of the pointer 54 is detected in the terminal device 1A (S18: YES), and the CPU 2 of the terminal device 1A transmits pointer information to each of the other terminal devices 1 that are performing collaborative editing, that is, the terminal devices 1B and 1C (S19). The pointer information includes identification information of the terminal device 1A and the position where the pointer 54 is operated relative to the editing area 50. The CPU 2 of the terminal device 1A performs a pointer display process to display the pointer 54 in the display area 51 displayed in the field 42 of the terminal device 1A, as in the image 71, based on the operation of the pointer 54 detected based on the detection signal of the input unit 10 (S27).

[0021] If no use of the pointer is detected (S18: NO), the CPU 2 of each terminal device 1 judges whether or not it has received pointer information indicating the position of the pointer relative to the editing area 50 from another device via the communication unit 6 (S20). If no pointer information has been received (S20: NO), the CPU 2 of each terminal device 1 performs the process of S28 described below. The CPU 2 of each terminal device 1B and 1C judges that it has received pointer information from the terminal device 1A (S20: YES), and acquires arrangement information indicating the arrangement of the display area displayed on the display unit 9 relative to the editing area 50 shared with the other terminal device 1 (S21). The CPU 2 of each terminal device 1B and 1C judges whether or not the pointer 54 is within the display area based on the pointer information received in S20 and the arrangement information acquired in S21 (S22). The CPU 2 of the terminal device 1B determines that the pointer 54 is within the display area 52 (S22: YES), and performs a pointer display process (S27) to display the pointer 54 at the position indicated by the placement information within the display area 52 displayed in the field 42 of the terminal device 1B, as shown in image 72 in FIG. 5.

[0022] The CPU 2 of the terminal device 1C judges that the pointer 54 is not within the display area 53 (S22: NO), and acquires the display position of the mark according to the pointer information received from the terminal device 1A (S23). When the CPU 2 of each terminal device 1 in this example judges that the pointer 54 is not within the display area 53, it acquires the intersection 64 between the position of the pointer 54 and the line segment 61 connecting the center 60 of the display area 53 and the outer edge of the display area 53. When the CPU 2 of the terminal device 1C judges that the pointer 54 is not within the display area 53 (S22: NO), it displays a mark 63 indicating that the pointer 54 is not within the display area 53 on the display unit 9 (S24). The CPU 2 of the terminal device 1C displays the mark 63 at the intersection 64 acquired in S23, as in the image 73 shown in FIG. 5. The mark 63 is a figure in which the pointer 54 is surrounded by a teardrop-shaped figure. The positional relationship between the intersection 64 and the mark 63 may be set appropriately, and in this example, the center of the mark 63 is the position of the intersection 64. The direction of the tip of the teardrop-shaped figure relative to the center of the pointer 54 (slightly upward and to the left) indicates the direction of the display position of the pointer 54 relative to the display area 53.

[0023] The CPU 2 of the terminal device 1C judges whether the mark 63 has been selected based on the output result of the input unit 10 (S25). When an operation of touching the input unit 10 with a pointer for several seconds, that is, a tap, is detected based on the output result of the input unit 10, the CPU 2 of the terminal device 1C judges that the mark 63 has been selected. When the selection of the mark 63 is not detected (S25: NO), the CPU 2 of the terminal device 1C performs the process of S28 described later. When the CPU 2 of the terminal device 1C detects the selection of the mark 63 via the input unit 10 (S25: YES), the CPU 2 of the terminal device 1C changes the arrangement of the display area relative to the editing area 50 displayed on the display unit 9 of the terminal device 1C so that the position of the pointer 54 indicated by the pointer information received in S20 is within the display area (S26). The CPU 2 of the terminal device 1C in this example changes the arrangement of the display area relative to the editing area 50 to the display area 62 arranged around the position of the pointer 54 indicated by the pointer information, as shown in the image 74 shown in FIG. 5 (S26). The CPU 2 of the terminal device 1C displays the pointer 54 at the position indicated by the pointer information in the display area 62 (S27).

[0024] Following S27, the CPU 2 of each terminal device 1 determines whether an end instruction to end the collaborative editing process has been detected via the input unit 10 (S28). The end instruction is output in S8, and is also transmitted from the other terminal devices 1. If an end instruction has not been detected (S28: NO), the CPU 2 of each terminal device 1 returns the process to S12. If an end instruction has been detected (S28: YES), the CPU 2 of each terminal device 1 ends the collaborative editing (S29), thus completing the collaborative editing process.

[0025] In the above embodiment, the terminal device 1, CPU 2, communication unit 6, display unit 9, and input unit 10 are examples of the terminal device, control unit, communication unit, display unit, and input unit of the present invention, respectively. The processing of S21 is an example of the layout acquisition processing of the present invention. The processing of S20 is an example of the reception processing of the present invention. The processing of S22 is an example of the judgment processing of the present invention. The processing of S27 after S20 is an example of the first display processing of the present invention. The processing of S24 is an example of the second display processing of the present invention. The processing of S26 is an example of the change processing of the present invention. The processing of S23 is an example of the intersection acquisition processing of the present invention.

[0026] With reference to Fig. 6, a case will be described in which the process of S26 in the collaborative editing process of the first modified example is executed by the terminal device 1C of the above specific example. In the collaborative editing process of the first modified example, the CPU 2 of the terminal device 1C calculates a reduction ratio at which the position of the pointer 54 is within the display area, and by reducing the display area at the calculated reduction ratio, changes the arrangement of the display area relative to the editing area 50 so that the position of the pointer 54 indicated by the pointer information is within the display area (S26). Specifically, the CPU 2 of the terminal device 1C reduces the display area 53 at a reduction ratio at which the position of the pointer 54 is within the display area, to set it as the display area 66. The process of S26 in the collaborative editing process of the first modified example is an example of the change process of the present invention.

[0027] 6, the process of S26 in the collaborative editing process of the second modified example will be described taking as an example a case where the process is executed by terminal device 1C, which is a specific example of the above embodiment. In the collaborative editing process of the second modified example, CPU 2 of terminal device 1C changes the arrangement of the display area relative to editing area 50 by moving the display area from display area 53 to display area 65 with respect to editing area 50 so that the position of pointer 54 is within the display area (S26). The process of S26 in the collaborative editing process of the second modified example is an example of the change process of the present invention.

[0028] With reference to FIG. 7, a case where the processes of S11 and S24 of the collaborative editing process of the third modified example are executed by the terminal device 1C of the specific example of the above embodiment will be described as an example. In the collaborative editing process of the third modified example, the CPU 2 of the terminal device 1C displays a screen 81 in S11 (S11). The screen 81 includes icons 26 to 41 and columns 43 and 44. The column 43 displays the names of other users who are collaboratively editing, that is, user A and user B. The column 44 displays the display area 53. In S24, the CPU 2 of the terminal device 1C displays a mark 49 indicating that the pointer 54 is not within the display area 53 to the right of user A of the terminal device 1A who transmitted the pointer information, among the users displayed in the column 43 (S24). The process of S24 of the collaborative editing process of the third modified example is an example of the second display process of the present invention.

[0029] With reference to FIG. 8 and FIG. 9, a joint editing process executed according to a display control program of the fourth modified example will be described by taking a case where the process is executed by each of the terminal devices 1A to 1C as an example. The joint editing process of the fourth modified example receives operation information indicating an operation position and an operation content with respect to an editing area from another device, and performs a process according to whether the operation position is within the display area. The operation information is, for example, object information and pointer information. The joint editing process of the fourth modified example differs from the joint editing process of the above embodiment in that S31 to S33 are performed between S14 and S15, and S23 to S25 are omitted. The description of the same process as the above embodiment will be omitted, and the following will describe the process different from the above embodiment. The joint editing processes of the terminal devices 1A to 1C are each executed individually by each device, but will be described in parallel to simplify the description.

[0030] In the specific example of FIG. 9, when the icon 36, 40 is selected in the terminal device 1A and the field 42 is operated, and a circular object 96 is placed between the object 55 and the object 56 (S12: YES), the CPU 2 of the terminal device 1A transmits the object information to the other terminal devices 1B and 1C that are performing the joint editing (S13). The CPU 2 of the terminal device 1A displays the object 96 in the field 42 of the display unit 9 in the display area 51 of the terminal device 1A, as in the image 101, based on the object information (S15). The CPU 2 of the terminal devices 1B and 1C that have received the object information from the terminal device 1A each (S14: YES) acquires the placement information in the same manner as in S21 (S31). The CPU 2 of the terminal devices 1B and 1C each determines whether the object 96 has been edited in the display area based on the received object information (S32). The CPU 2 of the terminal device 1B determines that editing of the object 96 has been performed within the display area 52 of the terminal device 1B (S32: YES), and performs an object editing process to display the object 96 within the display area 52 of the terminal device 1B based on the received object information, as shown in image 102 (S15).

[0031] The CPU 2 of the terminal device 1C does not determine that the editing of the object 96 has been performed within the display area 53 of the terminal device 1C (S32: NO), and changes the arrangement of the display area relative to the editing area 50 so that the operation position indicated by the object information received in S14 is within the display area (S33). The CPU 2 of the terminal device 1C changes the arrangement of the display area relative to the editing area 50, for example, by at least one of a process of changing the reduction ratio of the display area relative to the editing area 50 and a process of changing the position of the display area relative to the editing area 50. For example, as in an image 103, the CPU 2 of the terminal device 1C changes the arrangement of the display area 53 relative to the editing area 50 by moving the display area from the display area 53 to the display area 67 relative to the editing area 50 so that the center of the object 96 is the center of the display area 53. The CPU 2 of the terminal device 1C performs an object editing process of displaying the object 96 within the display area 67 of the terminal device 1C based on the received object information, as shown in an image 103 (S15). As shown in FIG. 10, the field 42 on the screen 25 of the terminal device 1C is switched from the image 100 representing the display area 53 to an image 103 representing the display area 67 by the processes of S33 and S15.

[0032] When the CPU 2 of terminal device 1C, which is displaying display area 53 of the specific example of Fig. 5 in column 42, receives pointer information of pointer 54 from terminal device 1A (S20: YES), the CPU 2 of terminal device 1C determines that pointer 54 is not in display area 53 (S22: NO), and changes the arrangement of the display area relative to editing area 50 (S26) so that the position of pointer 54 indicated by the pointer information received in S20 is within the display area, as shown in image 74 of Fig. 5, without displaying mark 63. The CPU 2 of terminal device 1C displays pointer 54 at the position indicated by the pointer information within the changed display area 62 (S27).

[0033] The processes of S21 and S31 executed according to the display control program of the fourth modified example are an example of a layout acquisition process of the present invention. The processes of S20 and S14 are an example of a reception process of the present invention. The processes of S22 and S32 are an example of a judgment process of the present invention. The process of S27 after S20 and the process of S15 after S14 are an example of a display process of the present invention. The processes of S26 and S33 are an example of a change process of the present invention.

[0034] As shown in FIG. 1, the terminal device 1 of the embodiment includes a display unit 9 that displays an image, a communication unit 6 that communicates with other terminal devices 1, and a CPU 2 that controls the display unit 9 and the communication unit 6. As shown in FIG. 4, the display control program includes instructions for causing the CPU 2 of the terminal device 1 to execute an arrangement acquisition process (S21), a reception process (S20), a determination process (S22), a first display process (S27), and a second display process (S24). In the arrangement acquisition process, the CPU 2 acquires arrangement information indicating the arrangement of the display area displayed on the display unit 9 relative to the editing area 50 shared with the other terminal devices 1. In the reception process, the CPU 2 receives pointer information indicating the position of the pointer 54 relative to the editing area 50 from the other device via the communication unit 6. In the determination process, the CPU 2 determines whether the pointer 54 is within the display area based on the pointer information received in S20 and the arrangement information acquired in S21. In the first display process, if it is determined that the pointer 54 is within the display area (S22: YES), the CPU 2 displays the pointer 54 at a position in the display area indicated by the arrangement information. In the second display process, if it is determined that the pointer 54 is not within the display area (S22: NO), the CPU 2 displays a mark 63 indicating that the pointer 54 is not within the display area on the display unit 9. The terminal device 1 executing the display control program can execute the first display process (S27) and the second display process (S24) according to the determination result in S22. Therefore, even if a different display area is displayed for each terminal device 1, the user C of the terminal device 1C can know whether the pointer 54 is being operated on the terminal device 1A from the mark 63 displayed in the second display process.

[0035] When the CPU 2 of the terminal device 1C detects selection of the mark 63 via the input unit 10 included in the terminal device 1C in accordance with the display control program (S25: YES), the CPU 2 executes a change process to change the arrangement of the display area relative to the editing area 50 so that the position of the pointer 54 indicated by the pointer information is within the display area of ​​the terminal device 1C (S26), as shown in image 74 in Fig. 5. The display control program can reduce the effort required by user C to change the display area to include the pointer 54. User C can confirm the pointer 54 displayed within the display area 62 whose arrangement has been changed.

[0036] In the change process, the CPU 2 of the terminal device 1C changes the arrangement of the display area relative to the editing area 50 to display area 62, which is arranged centered on the position of the pointer 54 indicated by the pointer information, as shown in image 74 in Fig. 5 (S26). The display control program can reduce the effort required by user C to change the arrangement of the display area relative to the editing area 50 so that the pointer 54 becomes center 60 of the display area 53. The display control program can make it easier for user C to find the pointer 54 in the display area, compared to a case where the position of the pointer 54 in the display area is not specified.

[0037] When the CPU 2 of the terminal device 1C does not determine that the pointer 54 is within the display area (S22: NO), as shown in FIG. 5, it performs an intersection acquisition process to acquire an intersection 64 between a line segment 61 connecting the position of the pointer 54 and the center 60 of the display area 53 and the outer edge of the display area 53 (S23). As shown in an image 73 of FIG. 5, the CPU 2 of the terminal device 1C displays a mark 63 at the intersection 64 acquired in S23 (S24). The display control program can notify the user C of the direction of the position of the pointer 54 operated on the terminal device 1A relative to the display area 53 based on the display position of the mark 63. Even when the user C manually changes the display area 53, the user C can efficiently perform an operation to change the display area so that the pointer 54 is located within the display area, using the display position of the mark 63 as a clue.

[0038] In the first modified example, in the change process of S26, the CPU 2 of the terminal device 1C reduces the display area 53 at a reduction ratio such that the position of the pointer 54 is within the display area, as in the specific example shown in Fig. 6, to set the display area 66 (S26). The terminal device 1C executing the display control program of the first modified example can reduce the effort of the user C in reducing the display area so that the pointer 54 is within the display area.

[0039] The terminal device 1 of the fourth modified example includes a display unit 9 that displays an image, a communication unit 6 that communicates with other devices, and a CPU 2 that controls the display unit 9 and the communication unit 6, as shown in FIG. 1. The CPU 2 of the terminal device 1 executes a display control program. The CPU 2 of the terminal device 1 executes each of the layout acquisition process (S21, S31), reception process (S14, S20), determination process (S32, S22), display process (S15, S27), and change process (S32, S26) of the collaborative editing process shown in FIG. 8 in accordance with the display control program. In the layout acquisition process, the CPU 2 acquires layout information indicating the layout of the display area displayed on the display unit 9 with respect to the editing area 50 shared with the other terminal devices 1. In the reception process, the CPU 2 receives operation information indicating the operation position and operation content with respect to the editing area 50 from the other devices via the communication unit 6. In the determination process, the CPU 2 determines whether the operation position is within the display area based on the received operation information and the acquired arrangement information (S32, S22). In the display process, if the operation position is determined to be within the display area (S32: YES, S22: YES), the CPU 2 performs display according to the operation content at the operation position indicated by the arrangement information in the display area. In the change process, if the operation position is not determined to be within the display area (S32: NO, S22: NO), the CPU 2 changes the arrangement of the display area relative to the editing area 50 so that the operation position indicated by the operation information is within the display area, and performs display according to the operation content at the operation position indicated by the arrangement information. The terminal device 1 that executes the display control program of the fourth modified example can perform the display process and the change process according to the determination result in the determination process. Therefore, in the specific example shown in FIG. 9, the user C of the terminal device 1C can grasp the editing operation of the object at the terminal device 1A of the user A even if different display areas are displayed for each terminal device 1. In the specific example shown in FIG. 5, a user C of a terminal device 1C can grasp the operation of the pointer 54 on the terminal device 1A of a user A even if different display areas are displayed on each terminal device 1.

[0040] The display control program of the present invention is not limited to the above-described embodiment, and various modifications may be made without departing from the scope of the present invention. For example, the following modifications may be made as appropriate. The present invention can be implemented in various forms, and may be realized, for example, in the form of a non-transitory computer-readable medium storing a display control program, a display control method executed by the CPU 2 of the terminal device 1, or the like.

[0041] The configuration of the terminal device 1 may be changed as appropriate. The display unit 9 of the terminal device 1 may be, for example, an organic EL display, a plasma display, a plasma tube array display, an electronic paper display using electrophoresis, etc., as long as it is capable of displaying images. The input unit 10 of the terminal device 1 may be a touch panel, a keyboard, a mouse, a joystick, etc.

[0042] A program including instructions for executing the processes of Figures 2, 4, and 8 may be stored in a storage device of each terminal device 1 before the CPU 2 executes the corresponding program. Therefore, the program acquisition method, acquisition path, and device for storing the program may each be changed as appropriate. The program executed by each terminal device 1 may be received from another device via a cable or wireless communication and stored in a storage device such as a memory unit. The other device may include, for example, a PC and a server connected via a network.

[0043] Each step of the collaborative editing process in FIG. 4 and FIG. 8 is not limited to being executed by the CPU 2, and may be executed in part or in whole by another electronic device (e.g., an ASIC). Each step of the collaborative editing process may be distributed and processed by a plurality of electronic devices (e.g., a plurality of CPUs). The order of each step of the collaborative editing process may be changed, steps may be omitted, or steps may be added, as necessary. The following modifications may be made to the collaborative editing process as appropriate.

[0044] The layout of the screen displayed on the display unit 9, the display items, etc. may be changed as appropriate. The type of editable object may be changed as appropriate. The CPU 2 may omit the processes of S25 and S26 and may not be able to detect the selection of the mark 63. The display position, shape, size, etc. of the mark 63 may be changed as appropriate. The mark 63 may include information of the user of the terminal device 1 that transmitted the pointer information, or may be a mark of a type corresponding to the terminal device 1 that transmitted the pointer information. The mark 63 may not indicate the direction of the display position of the pointer 54 relative to the display area 53. The positional relationship between the intersection 64 and the mark 63 may be changed as appropriate. For example, the representative point of the mark 63 may be a position that is the intersection 64. The representative point of the mark 63 is, for example, the tip of the mark 63. The mark 63 may be arranged at a position that does not overlap with the intersection 64 and in a region near the intersection 64. The area near the intersection 64 may be appropriately determined in consideration of the size of the mark 63 and the size of the display area, and may be, for example, an area that satisfies a condition that the shortest distance between the intersection 64 and the mark 63 is smaller than the maximum diameter of the mark 63. The CPU 2 may omit the process of S25 and execute the process of S26 after a predetermined time has elapsed since the mark 63 was displayed. When the CPU 2 detects the selection of the mark 63 (S25: YES), the CPU 2 may switch the arrangement of the display area relative to the editing area 50 so that the position of the pointer indicated by the pointer information is within the display area, may move the display area relative to the editing area 50, or may reduce the display area at a reduction ratio at which the position of the pointer is within the display area. The position of the pointer relative to the display area displayed in S26 may be appropriately changed. In S26, the CPU 2 may change the arrangement of the display area relative to the editing area 50 to the same display area as that of the terminal device 1 of the user who transmitted the pointer information, or may change it to the display area in the initial state. In S26, the arrangement of the display area relative to the editing area 50 may be set in advance or may be selectable by the user. The above modifications may be combined as appropriate to the extent that no contradiction occurs. [Explanation of symbols]

[0045] 1: terminal device, 2: CPU, 3: ROM, 4: RAM, 5: storage unit, 6: communication unit, 9: display unit, 10: input unit

Claims

1. A display control program executed by a control unit of a terminal device having an input unit, a display unit that displays an image, a communication unit that communicates with another device, and a control unit that controls the display unit and the communication unit, The control unit, an arrangement acquisition process for acquiring arrangement information indicating an arrangement of a display area displayed on the display unit with respect to an editing area shared with the other device, the editing area being capable of editing an object; a receiving process of receiving pointer information indicating a position of a pointer relative to the editing area from the other device via the communication unit; a determination process for determining whether the pointer is within the display area based on the received pointer information and the acquired placement information; a first display process for displaying the pointer at the position indicated by the arrangement information within the display area when it is determined that the pointer is within the display area; a second display process for displaying, on the display unit, a mark indicating that the pointer is not within the display area when the editing area is larger than the display area and when it is not determined that the pointer is within the display area; a transmission process of transmitting pointer information indicating a position of the pointer to the other device via the communication unit when the use of the pointer is detected in the terminal device via the input unit; A display control program comprising instructions for executing the above.

2. The display control program according to claim 1, further comprising an instruction to the control unit to execute a change process for changing the arrangement of the display area relative to the editing area so that the position of the pointer indicated by the pointer information is within the display area when selection of the mark is detected via the input unit provided in the terminal device.

3. The display control program according to claim 2 , wherein the control unit, in the change process, changes the arrangement of the display area relative to the editing area to an arrangement centered on the position of the pointer indicated by the pointer information.

4. The control unit is if it is determined that the pointer is not within the display area, an instruction to execute an intersection point acquisition process to acquire an intersection point between a line segment connecting the position of the pointer and a center of the display area and an outer edge of the display area, 4. The display control program according to claim 1, wherein in the second display process, the mark is displayed at the acquired intersection.

5. 3. The display control program according to claim 2, wherein the control unit, in the change process, reduces the display area at a reduction ratio such that the position of the pointer is within the display area.

6. The display control program of claim 1, characterized in that, in the second display process, when the editing area is larger than the display area and it is not determined that the pointer is within the display area, the control unit displays the mark and the user name of the other device that transmitted the pointer information next to the mark.

7. A display control program executed by a control unit of a terminal device having an input unit, a display unit for displaying an image, a communication unit for communicating with another device, and a control unit for controlling the display unit and the communication unit, The control unit, an arrangement acquisition process for acquiring arrangement information indicating an arrangement of a display area displayed on the display unit with respect to an editing area shared with the other device, the editing area being capable of editing an object; a receiving process of receiving operation information indicating an operation position and an operation content with respect to the object in the editing area from the other device via the communication unit; a determination process of determining whether the operation position is within the display area based on the received operation information and the acquired arrangement information; a display process for displaying the object according to the operation content at the operation position within the display area indicated by the layout information when the operation position is determined to be within the display area; a change process in which, when the editing area is larger than the display area and when it is not determined that the operation position is within the display area, the layout of the display area relative to the editing area is changed so that the operation position indicated by the operation information is within the display area, and the object according to the operation content is displayed at the operation position indicated by the layout information; a transmission process of transmitting, when editing of the object is detected in the terminal device via the input unit, operation information indicating an operation position and an operation content for the object to the other device via the communication unit; A display control program comprising instructions for executing the above.

Citation Information

Patent Citations

  • Image projection system and program

    JP2009086049A

  • Projector system and projector

    JP2009186827A

  • Display terminal equipment, display control device, pointer display control method, and pointer display control program

    JP2010224872A

  • Image display device, and method and program of controlling the same

    JP2013125526A

  • Electronic device, communication system, portable communication terminal, communication method and program

    JP2014026413A