Drawing system

Abstract

To provide a drawing system for making it possible to secure a large drawing area and to receive an instruction input for an instruction input area at a proper timing to carry out drawing in response to the input.SOLUTION: According to the present invention, a first terminal device 1 and a second terminal device 2 are connected to each other so as to communicate with each other, with a display screen 115D of a display device of the first terminal device 1 being set as a drawing dedicated area and a display screen 215D of a display device of the second terminal device 2 being set as an instruction input dedicated area. The first terminal device 1 is operated in response to instruction information from the second terminal device 2, and carries out drawing in the drawing area provided on the display screen 115D of the first display device in response to a drawing operation input received through a first position detection sensor.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a drawing system configured to include a terminal device having, for example, a display device and a position detection sensor and capable of performing drawing input with an electronic pen.

Background Art

[0002] For example, a tablet PC (Personal Computer) having a display device such as an LCD (Liquid Crystal Display) and a position detection sensor and capable of performing drawing input with an electronic pen is widely used. When performing drawing input on a tablet PC, so-called drawing software is executed. In the drawing software, a drawing area and an instruction input area are provided on the display screen to receive instruction input from a user.

[0003] The drawing area is an area that receives drawing input with an electronic pen and displays a drawing image corresponding thereto. The instruction input area is an area that displays an instruction input reception screen and receives various instruction inputs related to drawing (input of parameters), such as the line type, color, color tone, vividness, brightness, and degree of gradation used for drawing. Since the instruction input area also performs color selection and the like, it may be called a palette section or the like.

[0004] And since the drawing area and the instruction input area are provided within one display screen, if the electronic pen accidentally enters the instruction input area during drawing in the drawing area, an unintended instruction input may be made. To address such a problem, Patent Document 1 described later discloses an invention related to a coordinate input control method that invalidates an instruction input to the instruction input area when the electronic pen continuously reaches the instruction input area from the drawing area.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

SUMMARY OF THE INVENTION

PROBLEMS TO BE SOLVED BY THE INVENTION

[0006] Even in a tablet PC having a display device with a relatively large display screen, if both a drawing area and an instruction input area are provided on the display screen of the device, the drawing area has to be small. In recent years, with the improvement of computer performance, drawing software is often executed on a small tablet PC equipped with a small display device having a display screen size of about 8 inches to 11 inches, and fine drawing is often performed.

[0007] In this case, the drawing area becomes very small. If the drawing area is small, in the case of drawing a fine image, etc., repeated enlargement and reduction of the drawn image may occur, and it is considered that the work efficiency will be extremely poor. For this reason, there is a demand to make the drawing area as large as possible. On the other hand, instruction input to the instruction input area must also be appropriately performed at an appropriate timing. If changes in line types and colors cannot be made at appropriate timings, drawing cannot be flexibly performed according to the user's intention.

[0008] In view of the above, it is an object of the present invention to provide a drawing system that can secure a large drawing area, receive instruction input to the instruction input area at an appropriate timing, and perform drawing according to this.

MEANS FOR SOLVING THE PROBLEMS

[0009] To solve the above problems, a drawing system configured by communicably connecting a first terminal device including a first display device and a first position detection sensor corresponding to the display screen of the first display device, and a second terminal device including a second display device and a second position detection sensor corresponding to the display screen of the second display device, wherein the first terminal device An information acquisition unit that acquires information transmitted from the second terminal device; A drawing processing unit that uses the display screen of the first display device as a drawing area and performs drawing on the drawing area in response to a drawing operation input received through the first position detection sensor by an electronic pen; comprising: The second terminal device: A plurality of instruction input reception screens for receiving different information are stored in a predetermined storage unit, and switching control means for switching an instruction input screen to be displayed on the display screen of the second display device according to an instruction from a user among the plurality of instruction input reception screens; An instruction input reception processing unit that uses the display screen of the second display device as an instruction input area and receives an instruction input through the instruction input reception screen displayed on the display screen and the second position detection sensor by an electronic pen; An information providing unit that transmits information input through the instruction input reception processing unit to the first terminal device comprising: The first position detection sensor of the first terminal device and the second position detection sensor of the second terminal device can be operated by the same electronic pen; The second terminal device: Second receiving means for receiving the identification information of the electronic pen as second identification information; Second identification information providing means for transmitting the second identification information to the first terminal device comprising: The first terminal device: First receiving means for receiving the identification information of the electronic pen as first identification information; Second identification information receiving means for receiving the second identification information from the second identification information providing means; First authentication control means for connecting a communication path with the second terminal device when the first identification information and the second identification information are the same A drawing system characterized by comprising.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

[0011] Hereinafter, embodiments of the drawing system of the present invention will be described with reference to the drawings. Three embodiments will be described below, but first, the appearance of the drawing system common to the drawing systems of the three embodiments and the basic structure of the terminal device that constitutes the drawing system will be described.

[0012] [Drawing system appearance] Fig. 1 is a diagram illustrating an example of the appearance of a drawing system according to an embodiment. As shown in Fig. 1, the drawing system is composed of a first terminal device 1 and a second terminal device 2. The first terminal device 1 is realized as a tablet PC or the like, which includes a thin display device with a display screen size of, for example, about 8 to 12 inches, and a position detection sensor that corresponds to the display screen and detects a position pointed to by a pointer such as an electronic pen.

[0013] The second terminal device 2 is equipped with a thin display device with a display screen size of, for example, about 4 to 6 inches, and a position detection sensor that corresponds to the display screen and detects a position indicated by a pointer such as an electronic pen. Specifically, the second terminal device 2 is realized as a highly functional mobile phone terminal such as a smartphone, or a tablet PC that is smaller than the first terminal device 1.

[0014] The first terminal device 1 and the second terminal device 2 can connect a communication path by a short-range wireless communication function and communicate with each other. There are various standards for short-range wireless communication functions, and the drawing system can also use short-range wireless communication functions of various standards. However, for simplicity of explanation, the following description will be given assuming that the short-range wireless communication function of the widely used Bluetooth (registered trademark) standard is used between the first terminal device 1 and the second terminal device 2.

[0015] The first terminal device 1 is equipped with drawing software (hereinafter referred to as drawing software), and by executing this, as shown in FIG. 1, a drawing area R1 and an instruction input area R2 are provided on the display screen 115D to receive inputs from the user. The drawing area R1 is an area that receives drawing inputs by an electronic pen and displays a drawing image corresponding thereto. Further, the instruction input area is an area that displays an instruction input reception screen and receives various instruction inputs related to drawing (input of parameters) such as selection of line types and colors.

[0016] The first terminal device 1 receives operation inputs from the user for the drawing area R1 and the instruction input area R2, and can draw an image corresponding to the user's instruction in the drawing area R1. That is, in this specification, the drawing software is an application of two-dimensional computer graphics that draws an image on a computer using a pointing device (mainly an electronic pen).

[0017] However, the size of the display screen 115D of the first terminal device 1 is as small as 8 inches to 12 inches. For this reason, as shown in FIG. 1, by providing the instruction input area R2, the drawing area R1 becomes small, and the working efficiency at the time of creating a drawing deteriorates. In recent years, smartphones and small tablet PCs have become widely popular. Even users of the first terminal device as a drawing device often possess a smartphone or a small tablet PC.

[0018] Therefore, in addition to the first terminal device 1, a second terminal device 2 is used to configure a single drawing system. In the drawing system, the entire surface of the display screen 115D of the first terminal device 1 is used as the drawing area, and the entire surface of the display screen 215D of the second terminal device 2 is used as the instruction input area. That is, conventionally, each of the drawing area R1 and the instruction input area R2 provided within the display screen of a single terminal device is separately provided for each of the first terminal device 1 and the second terminal device 2.

[0019] This makes it possible to prevent the instruction input area from squeezing the drawing area and narrowing the drawing area. Then, the instruction information received through the instruction input area provided on the display screen 215D of the second terminal device 2 is provided to the first terminal device 1 through wireless communication. In the first terminal device 1, drawing can be performed according to the instruction information from the second terminal device and the instruction input from the user for the drawing area provided on the entire surface of the display screen 115D of its own device.

[0020] [Basic Structures of the First and Second Terminal Devices] FIG. 2 is an exploded configuration diagram for explaining the basic structures of the first and second terminal devices. As shown in FIG. 1, although the sizes of the first terminal device 1 and the second terminal device 2 are different, both are equipped with a thin display device and a position detection sensor and have a flat plate-like outer shape, and their basic structures are similar. Therefore, here, taking the case of the first terminal device 1 as an example, the basic structures of the first terminal device 1 and the second terminal device 2 will be described. In FIG. 2, the reference numerals in parentheses are for the second terminal device 2.

[0021] As shown in FIG. 2, in the first terminal device 1, a circuit board 100, a first sensor 111, a display device 115, and a second sensor 113 are housed in the housing 10 in order from the bottom, and these are enclosed in the housing 10 by the front panel 20. For example, transparent tempered glass is fitted inside the front panel 20 indicated by the dotted line so that the entire display screen of the display device 115 can be viewed. Also, the upper surface of the tempered glass of the front panel 20 becomes the operation surface, and an instruction operation can be performed on the first sensor 111 and the second sensor 113 with an indicator without damaging the second sensor 113 or the like.

[0022] The circuit board 100 is equipped with various electronic circuits and components such as a control circuit, a display control circuit, a position detection circuit for the first sensor, a position detection circuit for the second sensor, a short-range wireless communication circuit, and a semiconductor memory. The first sensor 111 uses the electromagnetic induction method. The display device 115 includes, for example, a thin display element such as an LCD (Liquid Crystal Display), various filters, and a backlight. The second sensor 113 uses the capacitance method. That is, in the first terminal device 1, position detection sensors of different methods are provided with the display device 115 in between.

[0023] The first sensor 111 using the electromagnetic induction method is configured by arranging a plurality of loop coils in each of the X-axis direction and the Y-axis direction. Then, a transmission period for sequentially supplying power to the plurality of loop coils of the first sensor 111 to generate a magnetic field and a reception period for stopping the power supply and receiving an external magnetic field are alternately provided. The corresponding electromagnetic induction method electronic pen is equipped with a resonance circuit composed of a coil and a capacitor. In response to the magnetic field from the first sensor 111, a current flows through the coil to generate a signal, and this signal is transmitted to the first sensor 111 including pen pressure information. The first sensor 111 receives this during the reception period and supplies it to the position detection circuit for the first sensor, and the indicated position and pen pressure by the electronic pen are detected.

[0024] The second sensor 113 using the capacitance method is configured by arranging a plurality of linear conductors (line electrodes) in each of the X-axis direction and the Y-axis direction. In the second sensor 113, when a finger or an electrostatic pen (a pen-shaped position indicator having conductivity) approaches, a change in capacitance (charge) occurs in the linear conductor, and this is supplied to the position detection circuit for the second sensor, and the indicated position is detected. Note that among electrostatic pens, there is also what is called an active electrostatic pen that is driven by a battery and sends out a signal. However, the second sensor 113 is mainly operated by a finger or an electrostatic pen having only conductivity.

[0025] Each of the first sensor 111 and the second sensor 113 corresponds to the entire display screen of the display device 115, and can detect the indicated position no matter which position on the display screen is indicated. In this way, the first terminal device 1 can receive an instruction input using an electromagnetic induction type electronic pen through the first sensor 111, and can also receive an instruction input by a finger or an electrostatic pen through the second sensor 113. In particular, by using an electromagnetic induction type electronic pen, the position can be indicated more finely, and the pen pressure applied to the electronic pen can be detected and transmitted to the first sensor 111, so that fine drawing can be performed.

[0026] [First Embodiment] <Configuration Example of the First Terminal Device 1> FIG. 3 is a block diagram for explaining a configuration example of the first terminal device 1 according to the first embodiment. As shown by the dotted line, the first terminal device 1 includes a user interface unit 110, a drawing processing unit 120, a control unit 130, a connection unit 140, and a panel cooperation unit 150.

[0027] The user interface unit 110 is a part that receives an instruction input from the user and provides information to the user. As shown in FIG. 3, the user interface unit 110 includes a first sensor 111, a first position detection circuit 112, a second sensor 113, a second position detection circuit 114, a display device 115, and a display control circuit 116.

[0028] The first sensor 111 is an electromagnetic induction type position detection sensor including an X-axis direction loop coil group and a Y-axis direction loop coil group, and the first position detection circuit 112 is a position detection circuit for the first sensor. The first position detection circuit 112 can provide a transmission period in which power is supplied sequentially to the loop coils in the X-axis direction and the Y-axis direction of the first sensor 111 to generate a signal (magnetic field), and a reception period in which power supply is stopped to receive a signal (magnetic field) from the electronic pen.

[0029] During the reception period, the first position detection circuit 112 can detect the indicated position by the electronic pen according to the position of the loop coil that has received the signal from the electronic pen, and notify the detection result to the control unit 130 or the like. Further, the signal from the electronic pen also includes information regarding the pen pressure. Therefore, the first position detection circuit 112 can also detect the pen pressure information from the received signal from the electronic pen and notify the detection result to the control unit 130 or the like.

[0030] The second sensor 113 is a capacitance-type position detection sensor including a linear conductor group in the X-axis direction and a linear conductor group in the Y-axis direction, and the second position detection circuit 114 is a position detection circuit for the second sensor. The second position detection circuit 114 detects the indicated position by a finger or an electrostatic pen based on the capacitance generated in the linear conductors in the X-axis direction and the Y-axis direction of the second sensor 113, and notifies the detection result to the control unit 130 or the like.

[0031] The display device 115 includes an LCD, various filters, a backlight, etc. The display control circuit 116 performs processes such as displaying various information on the display screen of the display device 115 or erasing the displayed information under the control of the control unit 130.

[0032] The drawing processing unit 120 realizes the function of drawing on the first terminal device 1 according to an instruction from the user. The drawing processing unit 120 includes a drawing image memory 121, a drawing parameter memory 122, and a drawing processing circuit 123. The drawing image memory 121 is a memory (VRAM) corresponding to the display screen of the display device 115, and stores and holds the image data forming the image drawn according to the user's instruction. The drawing parameter memory 122 stores and holds various setting information (parameter information) regarding drawing, such as line type and color, received through the instruction input reception screen displayed in the instruction input area.

[0033] The drawing processing circuit 123 performs a process of forming an image corresponding to an instruction input received through the first sensor 111 in the drawing image memory 121 based on the parameters stored and held in the drawing parameter memory 122. Further, the drawing processing circuit 123 can also perform a process of erasing the image formed in the drawing image memory 121 in response to an instruction input received through the first sensor 111. In this case, the erasure of the image is enabled such that a part of the drawn image can be erased.

[0034] The control unit 130 is a part that realizes the function of controlling each part of the first terminal device 1, and includes a control circuit 131 and a storage device 132. Although not shown, the control circuit 131 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a non-volatile memory, and the like. The control circuit 131 executes various software, controls each part, and realizes various functions provided in the first terminal device 1. The storage device 132 is composed of, for example, a relatively large-capacity semiconductor memory and its driver, and performs writing, deletion, modification of information to the semiconductor memory, and reading of information from the semiconductor memory. The storage device 132 stores and holds various application software, information necessary for processing, information created by the user, etc., and is also used as a work area for holding the progress of processing.

[0035] The connection unit 140 is a part that realizes a short-range wireless communication function, and includes a short-range wireless communication circuit 141 and a short-range wireless communication antenna 141A, and a proximity determination circuit 142. The short-range wireless communication circuit 141 and the short-range wireless communication antenna 141A realize the short-range wireless function of the Bluetooth (registered trademark) standard. The proximity determination circuit 142 determines whether or not the second terminal device 2 is in proximity and a communication path can be connected through the short-range wireless communication circuit 141 and the short-range wireless communication antenna 141A for communication based on the state of the short-range wireless communication circuit 141 and the received information.

[0036] The panel cooperation unit 150 cooperates with the second terminal device 2, provides an instruction input area on the second terminal device 2, and realizes the function of receiving the provision of the instruction information received by the second terminal device. The panel cooperation unit 150 includes a panel data providing circuit 151 and an instruction information acquisition circuit 152. The panel data providing circuit 151 functions when it is determined by the proximity determination circuit 142 that the second terminal device 2 is close to the first terminal device, the communication path is connected, and communication is possible.

[0037] The panel data providing circuit 151 uses the display screen 215D of the second terminal device 2 as an instruction input area, receives an instruction input from the user, and provides panel data (screen and other information) for sending the received instruction information to the first terminal device to the second terminal device 2. The panel data consists of image data forming an instruction input reception screen to be displayed on the display screen 215D of the second terminal device 2, software for performing processing of receiving an instruction input from the user through the instruction input reception screen and transmitting it to the first terminal device, and the like. The panel data is provided to the second terminal device 2 through the short-range wireless communication circuit 141 and the short-range wireless communication antenna 141A.

[0038] The instruction information acquisition circuit 152 acquires instruction information (parameters) related to drawing from the second terminal device 2 received through the short-range wireless communication antenna 141A and the short-range wireless communication circuit 141, and performs a process of recording it in the drawing parameter memory 122. The instruction information from the second terminal device 2 is instruction information corresponding to the instruction input received through the instruction information input screen provided on the display screen 215D by the function of the panel data providing circuit 151 of the first terminal device 1 as described above.

[0039] When the first terminal device 1 is powered on, the control circuit 131 displays, on the display screen 115D of the display device 115 through the display control circuit 116, icons corresponding to the executable software based on the information stored and held in the storage device 132. The control circuit 131 receives a selection input of an icon through the second sensor 113 and the second position detection circuit 114, and executes the software corresponding to the selected icon so that the user can perform the intended processing.

[0040] Also, in the first terminal device 1 of the first embodiment, under the control of the control circuit 131, the connection unit 140 and the panel cooperation unit 150 function to cooperate with the second terminal device 2 and execute drawing software to realize a drawing function. Details of the drawing function realized by the cooperation of the first terminal device 1 and the second terminal device 2 will be described later.

[0041] <Configuration example of the second terminal device 2> FIG. 4 is a block diagram for explaining a configuration example of the second terminal device 2 of the first embodiment. As shown surrounded by a dotted line, the second terminal device 2 includes a user interface unit 210, a drawing processing unit 220, a control unit 230, a connection unit 240, and a panel cooperation unit 250.

[0042] The user interface unit 210, the drawing processing unit 220, the control unit 230, and the connection unit 240 of the second terminal device 2 are configured in the same manner as the corresponding components with the same names in the first terminal device 1. Therefore, the description of these parts of the second terminal device 2 is omitted because it is repetitive. However, the first sensor 211, the second sensor 213, and the display device 215 of the second terminal device are different in size from the first sensor 111, the second sensor 113, and the display device 115 of the first terminal device.

[0043] Also, the panel cooperation unit 250 of the second terminal device 2 has a configuration different from that of the panel cooperation unit 150 of the first terminal device 1. The panel cooperation unit 250 of the second terminal device 2 includes a panel data acquisition circuit 251 and an instruction information providing circuit 252. The panel data acquisition circuit 251 acquires panel data transmitted from the first terminal device 1 and received through the short-range wireless communication antenna 241A and the short-range wireless communication circuit 241. The panel data acquisition circuit 251 stores the acquired panel data in, for example, the storage device 232.

[0044] By the panel data acquisition circuit 251, for example, software for receiving an instruction input among the panel data stored in the storage device 232 is executed in the control circuit 231. As a result, information for displaying an instruction input reception screen is supplied to the display control circuit 216 under the control of the control circuit 231, and an instruction input reception screen is displayed on the display screen 215D of the display device 215. Then, through the instruction input reception screen displayed on the display screen 215D and the first sensor 211 and the first position detection circuit 212 or the second sensor 213 and the second position detection circuit 214, an instruction input from the user can be received.

[0045] The instruction information providing circuit 252 performs a process of transmitting instruction information corresponding to the instruction input received through the instruction input reception screen displayed on the display screen 215D of the display device 215 and the first sensor 211 and the first position detection circuit 212 to the first terminal device 1. In this case, the instruction information is transmitted to the first terminal device 1 through the short-range wireless communication circuit 241 and the short-range wireless communication antenna 241A.

[0046] Note that usually, it is considered that the user often operates on the instruction input reception screen using an electronic pen for drawing. In this case, the instruction input is received through the instruction input reception screen, the first sensor 211 of the electromagnetic induction method, and the first position detection circuit 212. However, when the user touches the display screen 215D with a finger or the like, it is of course possible to receive the instruction input through the instruction input reception screen, the second sensor 213 of the electrostatic induction method, and the second position detection circuit 214.

[0047] Therefore, in the second terminal device 2 of the first embodiment, under the control of the control circuit 231, the connection unit 240 and the panel cooperation unit 250 function to cooperate with the first terminal device 1 and realize a drawing function corresponding to the drawing software executed on the first terminal device 1.

[0048] Also, in the second terminal device 2, when the power is turned on, the control circuit 231 displays an icon corresponding to the executable software on the display screen 215D of the display device 215 through the display control circuit 216 based on the information stored and held in the storage device 232. The control circuit 231 receives the selection input of the icon through the second sensor 213 and the second position detection circuit 214, executes the software corresponding to the selected icon, and enables the user to perform the target process.

[0049] <Outline of the operation of the drawing system according to the first embodiment> FIG. 5 is a diagram for explaining the outline of the operations of the first terminal device 1 and the second terminal device 2 constituting the drawing system according to the first embodiment. As shown in FIG. 5(A), the first terminal device 1 is equipped with drawing software. This drawing software also includes panel data for providing to the second terminal device 2. As shown in FIG. 5(A), assuming that the power is turned on for both the first terminal device 1 and the second terminal device 2, and they are in a state where wireless communication cannot be performed by the short-range wireless communication function because they are distantly separated. In this case, the first terminal device 1 and the second terminal device 2 function independently.

[0050] Suppose that the first terminal device 1 and the second terminal device 2 in the powered-on state are made to approach each other as indicated by the dotted arrows in FIG. 5(A). Then, as shown in FIG. 5(B), suppose that the first terminal device 1 and the second terminal device 2 are in proximity and can communicate wirelessly with each other by short-range wireless communication. In this case, as shown in FIG. 5(B), in the first terminal device 1, the drawing software is activated (executed), and the panel data is transmitted to the second terminal device 2. The second terminal device 2 receives the panel data from the first terminal device 1 and uses it.

[0051] As a result, as shown in FIG. 5(C), in the first terminal device 1, the entire display screen 115D of the display device 115 is set as a drawing area by the function of the drawing software, and drawing input can be performed through the drawing area. In the second terminal device 2, the entire display screen 215D of the display device 215 is set as an instruction input area by the function of the panel data from the first terminal device 1, and an instruction input reception screen is displayed here so that an instruction input from the user can be received.

[0052] The instruction information received through the instruction input reception screen displayed on the display screen 215D of the second terminal device 2 and the first sensor 211 and the first position detection circuit 212 is transmitted to the first terminal device 1 by the function of the instruction information providing circuit 252. The instruction information from the second terminal device 2 is various parameters related to drawing such as line types and colors. In the first terminal device 1, the instruction information from the second terminal device 2 is acquired, and drawing can be performed in the drawing area according to this.

[0053] <Processing of the First Terminal Device 1 and the Second Terminal Device 2 of the First Embodiment> FIG. 6 is a flowchart for explaining the processes performed by the first terminal device 1 and the second terminal device 2 according to the first embodiment. When the first terminal device 1 is powered on and no software is being executed, it executes the process shown in FIG. 6(A). Similarly, when the second terminal device 2 is powered on and no software is being executed, it executes the process shown in FIG. 6(B).

[0054] In the first terminal device 1, the short-range wireless communication circuit 141 transmits and receives connection request signals, and the proximity determination circuit 142 determines whether the second terminal device 2 is in the vicinity based on the reception status of connection request signals from external devices (step S101). The determination process in step S101 continues until it is determined that the second terminal device 2 is in the vicinity, or a predetermined termination event occurs, such as some software being executed or an operation to turn off the power being performed.

[0055] When the determination process in step S101 ends, the control circuit 131 determines whether the second terminal device 2 has come close based on the detection output from the proximity determination circuit 142 (step S102). In the determination process of step S102, if it is determined that the second terminal device 2 is not in the vicinity, since a predetermined termination event has occurred, the control circuit 131 ends the process shown in FIG. 6(A) and waits for the next execution timing. Also, in the determination process of step S102, if it is determined that the second terminal device 2 is in the vicinity, the control circuit 131 controls the short-range wireless communication circuit 141 to perform short-range wireless communication with the second terminal device 2 and connect the communication path (step S103).

[0056] Similarly, in the second terminal device 2, the short-range wireless communication circuit 241 transmits and receives connection request signals, and the proximity determination circuit 242 performs a process of determining whether the first terminal device 1 is in proximity based on the reception status of the connection request signal from the external device (step S201). The determination process in step S201 continues until it is determined that the first terminal device 1 is in proximity, or until a predetermined end event such as the execution of some software or the operation of turning off the power occurs, in the same manner as the process in step S101.

[0057] When the determination process in step S201 ends, the control circuit 231 determines whether the first terminal device 1 has come into proximity based on the detection output from the proximity determination circuit 242 (step S202). In the determination process of step S202, if it is determined that the first terminal device 1 is not in proximity, since a predetermined end event has occurred, the control circuit 231 ends the process shown in FIG. 6(B) and waits for the next execution timing. Also, in the determination process of step S202, if it is determined that the first terminal device 1 is in proximity, the control circuit 231 controls the short-range wireless communication circuit 241 to perform a process of establishing a communication path by performing short-range wireless communication with the first terminal device 1 (step S203).

[0058] As a result, the first terminal device 1 can perform wireless communication by short-range wireless communication with the second terminal device 2 through the short-range wireless communication circuit 141 and the short-range wireless communication antenna 141A, and the second terminal device 2 can perform wireless communication by short-range wireless communication with the first terminal device 1 through the short-range wireless communication circuit 241 and the short-range wireless communication antenna 241A.

[0059] After the process of step S103, in the first terminal device 1, the control circuit 131 activates the drawing software, and sets the entire display screen 115D of the display device 115 as a drawing area to enable reception of drawing input from the user (step S104). That is, after the process of step S104, the first terminal device 1 transitions to a state where drawing according to the user's instruction input is possible. Thereby, in the first terminal device 1, through the first sensor 111 and the first position detection circuit 112, it can receive a drawing input (position instruction input) using an electronic pen by the user, and display a corresponding drawn image on the display screen 115D of the display device 115. Further, in the first terminal device 1, under the control of the control circuit 131, the panel data providing circuit 151 functions to transmit panel data to the second terminal device 2 by short-range wireless communication (step S105).

[0060] In the second terminal device 2, it receives the panel data from the first terminal device 1, and the panel data acquisition circuit 251 acquires this data and uses it to display an instruction input reception screen on the display screen 215D of the display device 215 to enable reception of an instruction input (step S204). That is, after the process of step S204, the second terminal device 2 transitions to a state where reception of instruction information according to the user's instruction input is possible. In this case, the entire display screen 215D of the display device 215 of the second terminal device 2 becomes an instruction input area, and an instruction input reception screen is displayed here. Then, through the instruction input reception screen displayed on the display screen 215D and the first sensor 211 and the first position detection circuit 212 or the second sensor 213 and the second position detection circuit 214, it can receive an instruction input from the user.

[0061] After that, the control circuit 231 of the second terminal device 2 controls the instruction information providing circuit 252 to execute an instruction information providing process (step S205). When an instruction input related to drawing is received in the process of step S205, the instruction information providing circuit 252 functions to form instruction information to be provided to the first terminal device 1, wirelessly transmit this information, and then proceed to the next step. Also, when no instruction input related to drawing is received in the process of step S205, the process proceeds to the next step without performing any operation.

[0062] On the other hand, in the first terminal device 1, the control circuit 131 controls the instruction information acquisition circuit 152 to perform an instruction information acquisition setting process (step S106). When instruction information related to drawing is acquired in the process of step S106, the instruction information acquisition circuit 152 functions to perform a process of storing (setting) the acquired instruction information in the drawing parameter memory 122. Also, when no instruction information from the second terminal device is acquired in the process of step S106, the process proceeds to the next step without performing any operation.

[0063] The instruction information from the second terminal device 2 is, as described above, parameters related to drawing such as line type and color. Therefore, by setting the instruction information in the drawing parameter memory 122, drawing can be performed according to the instruction information. Thus, when the instruction information is related to, for example, line type and color, drawing can be performed with the instructed line type and the instructed color.

[0064] After that, in the first terminal device 1, the control circuit 131 determines whether an end event has occurred, such as a predetermined operation to end the execution of the drawing software being performed (step S107). In the determination process of step S107, when it is determined that the end event has not occurred, the process from step S106 is repeated so as to continuously receive drawing input from the user. Also, in the determination process of step S107, when it is determined that the end event has occurred, end processing is performed, such as releasing the communication path connected in step S103 or returning the display image on the display screen to the state before the execution of the drawing software (step S108). After that, the process shown in FIG. 6(A) is ended.

[0065] On the other hand, also in the second terminal device 2, after the process of step S205, the control circuit 231 determines whether an end event has occurred, such as a predetermined operation to end the reception of instruction input through the instruction input reception screen being performed (step S206). In the determination process of step S206, when it is determined that the end event has not occurred, the process from step S205 is repeated so as to continuously receive instruction input from the user. Also, in the determination process of step S206, when it is determined that the end event has occurred, end processing is performed, such as releasing the communication path connected in step S203 or returning the display image on the display screen to the state before the display of the instruction input reception screen (step S207). After that, the process shown in FIG. 6(B) is ended.

[0066] In this way, the entire display screen 115D of the first terminal device 1 can be used as a drawing area. Also, by using the entire display screen 215D of the second terminal device 2 as an instruction input area, an instruction input reception screen can be displayed, instruction inputs related to drawing can be received, and instruction information corresponding to the received instruction inputs can be transmitted to and provided to the first terminal device. As a result, a large drawing area can be secured, and appropriate drawing inputs can be made without repeatedly enlarging and reducing the drawing. Moreover, on the second terminal device 2 side, instruction inputs related to drawing such as line types and colors can be received, and instruction information (parameter information) corresponding thereto can be provided to the first terminal device. Thereby, even when using a drawing system composed of the first terminal device 1 and the second terminal device 2, the drawing intended by the user can be appropriately performed.

[0067] [Second Embodiment] <Configuration Example of First Terminal Device 1A and Second Terminal Device 2A> The drawing system of the second embodiment is also composed of two terminal devices, a first terminal device and a second terminal device, in the same manner as the drawing system of the first embodiment described with reference to FIG. 1. Specifically, it is composed of a first terminal device 1A realized as a tablet PC or the like, and a second terminal device 2A realized as a smartphone or a small tablet PC or the like. And the first terminal device 1A and the second terminal device 2A of this second embodiment are both flat (thin-type) having the basic structure described with reference to FIG. 2.

[0068] However, the first terminal device 1 and the second terminal device 2 of the first embodiment are different from the first terminal device 1A and the second terminal device 2A of the second embodiment described below in terms of the software to be executed and the configuration of the panel cooperation unit. FIG. 7 is a block diagram for explaining a configuration example of the first terminal device 1A and a configuration example of the second terminal device 2A of the second embodiment. In the first terminal device 1A shown in the upper part of FIG. 7, the same reference numerals are given to the parts having the same configuration as those of the first terminal device 1 of the first embodiment described with reference to FIG. 3, and the detailed description of these parts will be omitted. Similarly, in the second terminal device 2A shown in the lower part of FIG. 7, the same reference numerals are given to the parts having the same configuration as those of the second terminal device 2 of the first embodiment described with reference to FIG. 4, and the detailed description of these parts will be omitted.

[0069] The control unit 130 of the first terminal device 1A shown in the upper part of FIG. 7 also functions as a drawing software execution unit in the same manner as the first terminal device 1 of the first embodiment. However, the drawing software executed in the control unit 130 of the first terminal device 1A is different from the drawing software used in the first terminal device 1 of the first embodiment and does not have the function of providing panel data to the second terminal device 2A. For this reason, the panel cooperation unit 150A of the first terminal device 1A of the second embodiment includes only the instruction information acquisition circuit 152A and does not include the panel data providing circuit.

[0070] The control unit 230 of the second terminal device 2A shown in the lower part of FIG. 7 functions as an execution unit of panel software that displays an instruction input reception screen on the display screen 215D and receives an instruction input from the user. For this reason, the second terminal device 2A of this second embodiment does not need to receive the provision of panel data from the first terminal device 1A. Therefore, the panel cooperation unit 250A of the second terminal device 2A of the second embodiment includes only the instruction information providing circuit 252A and does not include the panel data acquisition circuit. That is, in the case of the drawing system of this second embodiment, the panel data is configured to be provided by the second terminal device 2A.

[0071] <Overview of the Operation of the Drawing System According to the Second Embodiment> FIG. 8 is a diagram for explaining an overview of the operations of the first terminal device 1A and the second terminal device 2A that constitute the drawing system according to the second embodiment. As shown in FIG. 8(A), the first terminal device 1A is equipped with drawing software. The drawing software is slightly different from the drawing software installed in the first terminal device 1 according to the first embodiment. The drawing software enables drawing with the entire display screen 115D of the first terminal device 1A as the drawing area, but does not have the function of providing panel data to the second terminal device 2A.

[0072] On the other hand, the second terminal device 2A is equipped with panel software. The panel software includes image data for forming an instruction input reception screen. Further, the panel software uses the entire display screen 215D of the second terminal device 2A as the instruction input area, displays the instruction input reception screen here, and includes software that functions to receive an instruction input from the user through the first sensor 211 and the second sensor 213. Similar to the case of the drawing system according to the first embodiment, it is of course possible to receive instruction information from the user through the instruction input reception screen, the second sensor 213, and the second position detection circuit 214.

[0073] As shown in FIG. 8(A), assume that with the first terminal device 1A and the second terminal device 2A each powered on, they are too far apart to communicate via the short-range wireless communication function. In this case, the first terminal device 1A and the second terminal device 2A each function independently. The first terminal device 1A and the second terminal device 2A in the powered-on state are brought closer as indicated by the dotted arrows in FIG. 8(A), and as shown in FIG. 8(B), assume that the first terminal device 1A and the second terminal device 2A are in close proximity and can communicate wirelessly with each other.

[0074] In this case, as shown in FIG. 8(B), in the first terminal device 1A, the drawing software is activated (executed) in the control unit 130. On the other hand, in the second terminal device 2A, the panel software is activated (executed) in the control unit 230. As a result, as shown in FIG. 8(C), in the first terminal device 1A, the entire display screen 115D of the display device 115 is set as the drawing area by the function of the drawing software, and drawing input can be performed through the drawing area. In the second terminal device 2A, the entire display screen 215D of the display device 215 is set as the instruction input area by the function of the panel software, and an instruction input reception screen is displayed here so that an instruction input from the user can be received.

[0075] The instruction information corresponding to the instruction input reception screen displayed on the display screen 215D of the second terminal device 2A and received, for example, through the first sensor 211 and the first position detection circuit 212 is transmitted to the first terminal device 1A by the function of the instruction information providing circuit 252A. The instruction information from the second terminal device 2A is various parameters related to drawing such as line type and color. In the first terminal device 1A, the instruction information from the second terminal device 2A is acquired, and drawing can be performed in the drawing area accordingly.

[0076] <Processing of the First Terminal Device 1A and the Second Terminal Device 2A of the Second Embodiment> FIG. 9 is a flowchart for explaining the processing performed by the first terminal device 1A and the processing performed by the second terminal device 2A in the second embodiment. FIG. 9(A) shows the processing of the first terminal device 1A, and FIG. 9(B) shows the processing of the second terminal device 2A. In the flowcharts of FIGS. 9(A) and 9(B), the same reference numerals are assigned to the processing performed in the same manner as the flowcharts of FIGS. 6(A) and 6(B) in the first embodiment, and the detailed description of that part is omitted because of duplication.

[0077] When the first terminal device 1A of the second embodiment is powered on and no software is being executed, it executes the process shown in FIG. 9(A). The first terminal device 1A connects a communication path by short-range wireless communication when it is close to the second terminal device 2A through the processes of steps S101 to S103. After the communication path is connected, the first terminal device 1A executes drawing software with the control unit 130 and enables drawing input by the user with the entire display screen 115D of the display device 115 as a drawing area (step S301). That is, after the process of step S301, the first terminal device 1A transitions to a state where drawing can be performed in response to an instruction input by the user.

[0078] After that, the first terminal device 1A receives instruction information from the second terminal device 2A through the short-range wireless communication antenna 141A and the short-range wireless communication circuit 141, and the instruction information acquisition circuit 152A acquires this and stores it in the drawing parameter memory 122 (step S106). Thereby, drawing can be performed in response to an instruction input from the user. The control unit 130 repeats the process from step S106 until a predetermined end event occurs (step S107), and when the end event occurs, it performs a predetermined end process (step S108) and ends the process shown in FIG. 9(A).

[0079] On the other hand, in the second terminal device 2A of the second embodiment, when no software is being executed, the process shown in FIG. 9(B) is executed. The second terminal device 2A connects a communication path by short-range wireless communication when it is close to the first terminal device 1A through the processes of steps S201 to S203. After the communication path is connected, the second terminal device 2A executes panel software by the control unit 230, and displays an instruction input reception image with the entire display screen 215D of the display device 215 as an instruction input area, enabling instruction input by the user (step S401). That is, after the process of step S401, the second terminal device 2A transitions to a state where it can receive instruction information corresponding to the user's instruction input. As a result, the second terminal device 2A can receive an instruction input from the user.

[0080] Suppose the second terminal device 2A receives an instruction input from the user. In this case, the instruction information providing circuit 252A forms instruction information corresponding to the received instruction input, and transmits this through the short-range wireless communication circuit 241 and the short-range wireless communication antenna 241A to the first terminal device 1A (step S205). As a result, as described above, in the first terminal device 1A, drawing can be performed according to the instruction input from the user. The control unit 230 repeats the process from step S205 until a predetermined end event occurs (step S206), and when the end event occurs, performs a predetermined end process (step S207) and ends the process shown in FIG. 9(B).

[0081] As described above, in the case of the drawing system of this second embodiment, the first terminal device 1A is provided with drawing software, and the second terminal device 2A is provided with panel software. By executing the drawing software, the first terminal device 1A can accept drawing input with the entire display screen 115D of the display device 115 as the drawing area. On the other hand, by executing the panel software, the second terminal device 2A uses the entire display screen 215D of the display device 215 as the instruction input area, displays an instruction input reception screen to accept instruction input, and can provide instruction information corresponding thereto to the first terminal device 1A. Therefore, the first terminal device 1A can perform drawing according to the instruction information from the user using the entire surface of the display screen 115D.

[0082] [Third Embodiment] <Configuration Example of First Terminal Device 1B and Second Terminal Device 2B> The drawing system of the third embodiment is also composed of two terminal devices, namely a first terminal device and a second terminal device, in the same manner as the drawing system of the first embodiment described with reference to FIG. 1. Specifically, it is composed of a first terminal device 1B realized as a tablet PC or the like, and a second terminal device 2B realized as a smartphone or a small tablet PC or the like. The first terminal device 1B and the second terminal device 2B of this third embodiment are both flat (thin-type) having the basic structure described with reference to FIG. 2, similar to the drawing systems of the first and second embodiments described above.

[0083] FIG. 10 is a block diagram for explaining a configuration example of the first terminal device 1B and a configuration example of the second terminal device 2B of the third embodiment. As can be seen by comparing FIG. 10 with FIG. 7, the first terminal device 1B of the third embodiment is configured substantially the same as the first terminal device 1A of the second embodiment, and the second terminal device 2B of the third embodiment is configured substantially the same as the second terminal device 2A of the second embodiment. However, the software executed by the first terminal device 1B and the second terminal device 2B and its execution mode are different from those of the first terminal device 1A and the second terminal device 2A of the second embodiment.

[0084] The first terminal device 1B shown above FIG. 10 is also configured in the same manner as the first terminal device 1 of the first embodiment described with reference to FIG. 3, and thus the same reference numerals are given to the parts having the same configuration, and the detailed description thereof will be omitted. Similarly, the second terminal device 2B shown below FIG. 10 is also configured in the same manner as the second terminal device 2 of the first embodiment described with reference to FIG. 4, and thus the same reference numerals are given to the parts having the same configuration, and the detailed description thereof will be omitted.

[0085] The control unit 130 of the first terminal device 1B of the third embodiment functions as a drawing software execution unit. The drawing software executed by the control unit 130 has both a drawing function and an instruction input reception function. The drawing function is a function of providing a drawing area on the display screen 115D of the display device 115 and performing drawing. The instruction input reception function is a function of providing an instruction input area on the display screen 115D of the display device 115, displaying an instruction input reception screen, and receiving input of instruction information.

[0086] In addition, for the drawing software of this embodiment, it is possible to set the priority order when the first terminal device 1B and the second terminal device 2B cooperate. It is assumed that the priority order is determined such that the case of activating the drawing function is ranked first and the case of activating the instruction input reception function is ranked second. Information indicating the first rank as the priority order regarding the drawing software is set (stored) in the storage device 132 of the control unit 130 of the first terminal device 1B. When cooperating with the second terminal device 2B, the first terminal device 1B is set to execute the drawing function.

[0087] Thus, when the second terminal device 2B is not in the vicinity and the first terminal device 1B functions alone, and the drawing software is activated. In this case, since it functions alone, regardless of the priority order of the drawing software, as shown in FIG. 1, both a drawing area R1 and an instruction input area R2 are provided on the display screen 115D of the display device 115, and both drawing input and instruction input can be received.

[0088] However, when the second terminal device 2B is in the vicinity and a communication path by short-range wireless communication is connected, and the first terminal device 1B and the second terminal device 2B cooperate to function, the priority of the drawing software is considered. In this case, as described above, since the priority regarding the drawing software of the first terminal device 1B is the highest, the drawing software is executed so that only the drawing function functions. In this case, in the first terminal device 1B, the instruction input reception function does not work.

[0089] On the other hand, the control unit 230 of the second terminal device 2B in the third embodiment functions as a drawing software execution unit. The drawing software executed by the control unit 230 is the same as the drawing software executed by the control unit 130 of the first terminal device 1B, and includes both a drawing function and an instruction input reception function, and the priority of the drawing software can be set. Then, information indicating the second highest priority as the priority regarding the drawing software is set (stored) in the storage device 232 of the control unit 230 of the second terminal device 2B, and when cooperating with the first terminal device 1B, the second terminal device 2B is set to execute the instruction input reception function.

[0090] Thus, assume that the first terminal device 1B is not in the vicinity and the second terminal device 2B functions alone, and the drawing software is started. In this case, since it functions alone, regardless of the priority of the drawing software, both a drawing area R1 and an instruction input area R2 are provided on the display screen 215D of the display device 215 so that both drawing input and instruction input can be received. In this case, although the display screen 215D itself is small, drawing processing can be performed in the same manner as when the first terminal device 1B functions alone.

[0091] However, when the first terminal device 1B is in the vicinity and a communication path by short-range wireless communication is connected, and the second terminal device 2B and the first terminal device 1B cooperate to function, the priority of the drawing software is considered. In this case, as described above, since the priority regarding the drawing software of the second terminal device 2B is the second highest, the drawing software is executed by enabling the instruction input reception function.

[0092] As described above, in the drawing system according to the third embodiment, in each of the first terminal device 1B and the second terminal device 2B, drawing software having both a drawing function and an instruction input reception function is installed and made executable. And the drawing software installed in the first terminal device 1B and the second terminal device 2B may be exactly the same drawing software when it is executable. However, generally, drawing software having the same function and corresponding to the operating system functioning in each terminal device is installed.

[0093] For example, assume that the operating system functioning in the first terminal device 1B is Windows (registered trademark), and the operating system functioning in the second terminal device 2B is Android (registered trademark). In this case, drawing software having the same function, namely, drawing software for Windows (registered trademark) is installed in the first terminal device 1B, and drawing software for Android (registered trademark) is installed in the second terminal device 2B. Also, even when the first terminal device 1B and the second terminal device 2B function with the same operating system, as long as it is drawing software having both a drawing function and an instruction input reception function, drawing software created according to the characteristics of each terminal device may of course be installed in each terminal device.

[0094] <Outline of the operation of the drawing system according to the third embodiment> FIG. 11 is a diagram for explaining an outline of operations of a first terminal device 1B and a second terminal device 2B constituting a drawing system according to a third embodiment. As shown in FIG. 11(A), the first terminal device 1B is equipped with drawing software. As described above, the drawing software has a drawing function and an instruction input reception function. Also, similarly to the case of the first terminal device 1B, the second terminal device 2B is equipped with drawing software having a drawing function and an instruction input reception function.

[0095] In the first terminal device 1B and the second terminal device 2B, a priority order for the installed drawing software is set. The priority order for the drawing software is such that when the first terminal device 1B and the second terminal device 2B cooperate to perform drawing, the terminal that executes the drawing function is ranked first, and the terminal that executes the instruction input reception function is ranked second. In this third embodiment, the priority order for the drawing software of the first terminal device 1B is first, and the priority order for the drawing software of the second terminal device 2B is second.

[0096] As shown in FIG. 11(A), assuming that the first terminal device 1B and the second terminal device 2B are each powered on and are in a state where they are too far apart to communicate via a short-range wireless communication function. In this case, the first terminal device 1 and the second terminal device 2 each function independently. Therefore, if the drawing software is executed in this state, as in the prior art, a drawing area and an instruction input area can be provided in each of the first terminal device 1B and the second terminal device 2B to perform drawing processing.

[0097] Assume that the first terminal device 1B and the second terminal device 2B in the powered-on state are made to approach as indicated by the dotted arrow in FIG. 11(A). Then, as shown in FIG. 11(B), assume that the first terminal device 1B and the second terminal device 2B are in proximity and are in a state where they can communicate with each other via short-range wireless communication.

[0098] In this case, as shown in FIG. 11(B), in the first terminal device 1B, since the priority regarding the drawing software is set to the first place, the drawing software is started (executed) so as to execute only the drawing function. On the other hand, in the second terminal device 2B, since the priority regarding the drawing software is set to the second place, the drawing software is started (executed) so as to execute only the instruction input reception function.

[0099] As a result, as shown in FIG. 11(C), in the first terminal device 1B, the entire display screen 115D of the display device 115 is set as the drawing area by the drawing function of the drawing software, and through this drawing area, drawing input can be performed. In the second terminal device 2B, the entire display screen 215D of the display device 215 is set as the instruction input area by the instruction input reception function of the drawing software, and an instruction input reception screen is displayed here so that an instruction input from the user can be received.

[0100] The instruction information corresponding to the instruction input received through the instruction input reception screen displayed on the display screen 215D of the second terminal device 2B and, for example, the first sensor 211 and the first position detection circuit 212 functions in the instruction information providing circuit 252A and is transmitted to the first terminal device 1B. The instruction information from the second terminal device 2B is various parameters related to drawing such as line types and colors. In the first terminal device 1B, the instruction information from the second terminal device 2A can be acquired and drawing can be performed in the drawing area according to this instruction information.

[0101] <Processing of the First Terminal Device 1B and the Second Terminal Device 2B in the Third Embodiment> FIG. 12 is a flowchart for explaining the processing performed in the first terminal device 1B and the processing performed in the second terminal device 2B in the third embodiment. FIG. 12(A) shows the processing of the first terminal device 1B, and FIG. 12(B) shows the processing of the second terminal device 2B. In the flowcharts of FIGS. 12(A) and 12(B), the same reference numerals are given to the processing performed in the same manner as the flowcharts of FIGS. 6(A) and 6(B) in the first embodiment, and the detailed description of that part is omitted because of duplication.

[0102] When the first terminal device 1B is powered on and no software is being executed, it executes the process shown in FIG. 12(A). The first terminal device 1B connects a communication path by short-range wireless communication when it is close to the second terminal device 2B through the processes of steps S101 to S103. After the communication path is connected, since the priority regarding drawing software is the first, the first terminal device 1B starts (executes) the drawing software so that only the drawing function is executed by the control unit 130 (step S501). As a result, after the process of step S501, the first terminal device 1B transitions to a state where drawing according to a user's instruction input is possible, and the entire display screen 115D of the display device 115 is set as a drawing area, enabling the user to perform a drawing input.

[0103] After this, the first terminal device 1B receives instruction information from the second terminal device 2B through the short-range wireless communication antenna 141A and the short-range wireless communication circuit 141, and the instruction information acquisition circuit 152A acquires this and stores it in the drawing parameter memory 122 (step S106). Thereby, it becomes possible to perform drawing according to a user's instruction input. The control unit 130 repeats the process from step S106 until a predetermined end event occurs (step S107), and when the end event occurs, it performs a predetermined end process (step S108) and ends the process shown in FIG. 11(A).

[0104] On the other hand, in the second terminal device 2B, when the power is turned on and no software is being executed, the process shown in FIG. 12(B) is executed. The second terminal device 2B connects a communication path by short-range wireless communication when it is close to the first terminal device 1B through the processes of steps S201 to S203. After the communication path is connected, since the second terminal device 2B has the second priority regarding the drawing software, the control unit 230 starts (executes) the drawing software so as to execute only the instruction input reception function (step S601). That is, after the process of step S601, the second terminal device 2B transitions to a state where it can receive instruction information according to the user's instruction input. As a result, in the second terminal device 2B, an instruction input reception image is displayed with the entire display screen 215D of the display device 215 as the instruction input area, enabling the user to perform an instruction input.

[0105] Assume that the second terminal device 2B has received an instruction input from the user. In this case, the instruction information providing circuit 252A forms instruction information corresponding to the received instruction input and transmits it to the first terminal device 1B through the short-range wireless communication circuit 241 and the short-range wireless communication antenna 241A (step S205). As a result, as described above, in the first terminal device 1B, drawing can be performed according to the instruction input from the user. The control unit 230 repeats the process from step S205 until a predetermined end event occurs (step S206). When the end event occurs, a predetermined end process is performed (step S207), and the process shown in FIG. 12(B) is terminated.

[0106] As described above, in the drawing system of this third embodiment, when the first terminal device 1B and the second terminal device 2B are not close to each other and each starts the drawing software independently, a drawing area and an instruction input reception area are provided on the display screen of its own device, and the conventional drawing process can be performed. However, when the first terminal device 1B and the second terminal device 2B are close to each other, although the drawing software is executed on each of them, the drawing function is executed on the first terminal device 1B, and the instruction input reception function is executed on the second terminal device 2B. In this case, for drawing, it is possible to perform drawing through the entire display screen 115D of the display device 115 of the first terminal device 1B. Also, for instruction input, drawing can be performed through the entire display screen 215D of the display device 215 of the second terminal device 2B, and instruction information corresponding to the received instruction input can be provided to the first terminal device 1B.

[0107] [Wearing on the User of the Second Terminal Devices 2, 2A, 2B] The drawing systems of the first to third embodiments described above are all composed of two terminal devices, namely the first terminal device (1, 1A, 1B) and the second terminal device (2, 2A, 2B). Therefore, when using the drawing system on an airplane, both terminal devices can be operated on the airplane, so there are no operational problems. However, for example, when sketching outdoors, both the first terminal device and the second terminal device have to be held in the hands, and it may not be possible to perform free drawing using the drawing system.

[0108] Therefore, the first terminal device (1, 1A, 1B) provided with the drawing area is designed to be held by hand, and the second terminal device (2, 2A, 2B) is worn on the arm that holds the first terminal device (1, 1A, 1B), leaving the other hand free. As a result, the other hand can hold an electronic pen and can operate both the first terminal device and the second terminal device, enabling free drawing. FIG. 13 is a diagram for explaining an example of wearing the second terminal device (2, 2A, 2B) on the user's body. Here, the case of using the first terminal device 1 and the second terminal device 2 of the first embodiment will be described as an example.

[0109] As shown in FIGS. 13(A) and 13(B), a list band 21 and a finger band 22 are attached to the surface (back surface) opposite to the display screen 215D of the second terminal device 2. Although various methods can be used for the attachment method, for example, locking members provided at both ends of the list band 21 are fitted into grooves for the list band provided on the back surface of the second terminal device 2 so that they do not come off easily. Further, locking members provided on the finger band 22 are fitted into grooves for the finger band provided on the back surface of the second terminal device 2 so that they do not come off easily.

[0110] The user can attach the second terminal device 2 to the user's arm as shown in FIGS. 13(A) and 13(B) by fitting the list band 21 on the user's arm and fitting the finger band 22 on, for example, the user's thumb. The user can slightly shift the position of the second terminal device 2 attached to the user's arm or adjust the orientation (tilt) of the display screen 215D by moving the arm with the second terminal device 2 attached to the left and right or by moving the wrist of the arm with the second terminal device 2 attached.

[0111] Furthermore, as shown in FIG. 13(C), by gripping the first terminal device 1 with the hand on the side where the second terminal device 2 is attached, both the first terminal device 1 and the second terminal device 2 can be held (retained) by the user's hand (including the arm portion). As a result, since the other hand only needs to hold the electronic pen, the user can freely perform drawing input on the first terminal device 1 according to the user's intention by operating both the first terminal device 1 and the second terminal device 2 with the electronic pen even outdoors.

[0112] In the case of the example shown in Fig. 13(C), it shows a situation where the second terminal device 2 is worn on the user's left arm and the first terminal device 1 is held in the left hand. Therefore, the user can hold an electronic pen in the right hand and perform free drawing input. Of course, it is also possible to wear the second terminal device 2 on the right arm, hold the first terminal device 1 with the right hand, hold the electronic pen in the left hand, and operate both the first terminal device 1 and the second terminal device 2. Also, the drawing systems of the second and third embodiments can be used in the manner described with reference to Fig. 13.

[0113] [Authentication by Electronic Pen] In the first, second, and third embodiments described above, the first terminal device (1, 1A, 1B) and the second terminal device (2, 2A, 2B) operate as a drawing system when they are close to each other and a communication path can be connected by short-range wireless communication. However, it is considered that there may be cases where the user possesses a plurality of terminal devices or where other people's terminal devices are present in the vicinity. In such cases, although slightly, there is a possibility that the first and second terminal devices that should originally be paired do not pair, and the original drawing system cannot operate.

[0114] Therefore, authentication of the terminals connecting the communication path by short-range wireless communication is performed using an electronic pen commonly used by the user for the first terminal device (1, 1A, 1B) and the second terminal device (2, 2A, 2B). Briefly, the terminal device that has received the instruction input from the electronic pen issues a connection request by short-range wireless. Then, when a connection request from another terminal is received and the own device has also issued a connection request, a communication path is connected between the source of the connection request and the own device, enabling pairing of the first terminal device and the second terminal device that constitute the drawing system.

[0115] However, when there are three or more terminal devices capable of inputting instructions using an electronic pen, appropriate pairing may not be possible with the method described above. Therefore, electronic pen identification information (electronic pen ID) unique to the electronic pen is included in the position instruction signal transmitted from the electronic pen used by the user of the drawing system. In the first terminal device 1 and the second terminal device 2 that receive the position instruction signal including the electronic pen ID from the electronic pen, the electronic pen ID included in the position instruction signal from the electronic pen is extracted and held. Further, the first terminal device 1 and the second terminal device 2 form a connection request including the held electronic pen ID and transmit this by short-range wireless communication.

[0116] Then, the first terminal device 1 and the second terminal device 2 connect a communication path to the terminal device that has transmitted a connection request including the same electronic pen ID as the electronic pen ID held by the own device. Thereby, a communication path can be connected between the first terminal device 1 and the second terminal device 2 that form a pair and constitute a drawing system, and the drawing system can be appropriately configured and made to function.

[0117] FIG. 14 is a block diagram for explaining a configuration example of a drawing system that performs authentication processing using an electronic pen ID. In FIG. 14, an electronic pen authentication unit 170 provided in the first terminal device 1C and an electronic pen authentication unit 270 provided in the second terminal device 2C are main parts that realize the electronic pen authentication function. The part other than the electronic pen authentication unit 170 of the first terminal device 1C is configured in the same manner as the first terminal device 1 of the first embodiment. Similarly, the part other than the electronic pen authentication unit 270 of the second terminal device 2C is configured in the same manner as the second terminal device 2 of the first embodiment.

[0118] That is, in the first terminal device 1C, the user interface unit 110 functions to receive a position indication signal from the electronic pen, extract the electronic pen ID from the position indication signal, and supply it to the electronic pen authentication unit 170. The electronic pen authentication unit 170 holds the electronic pen ID from the user interface unit 110, and under the control of the control unit 130, cooperates with the connection unit 140 to form a connection request including the electronic pen ID and transmit it by short-range wireless communication. Further, the electronic pen ID is included in the connection request received through the connection unit 140 by the electronic pen authentication unit 170. Therefore, when the electronic pen ID is the same as the electronic pen ID held by the electronic pen authentication unit 170, the connection unit 140 is controlled to connect a communication path with the transmission source of the connection request.

[0119] Similarly, in the second terminal device 2C, the user interface unit 210 functions to receive a position indication signal from the electronic pen, extract the electronic pen ID from the position indication signal, and supply it to the electronic pen authentication unit 270. The electronic pen authentication unit 270 holds the electronic pen ID from the user interface unit 210, and under the control of the control unit 230, cooperates with the connection unit 240 to form a connection request including the electronic pen ID and transmit it by short-range wireless communication. Further, the electronic pen ID is included in the connection request received through the connection unit 240 by the electronic pen authentication unit 270. Therefore, when the electronic pen ID is the same as the electronic pen ID held by the electronic pen authentication unit 270, the connection unit 240 is controlled to connect a communication path with the transmission source of the connection request.

[0120] As a result, a communication path is connected between the first terminal device 1C and the second terminal device 2C, and a drawing system composed of the first terminal device 1 and the second terminal device 2 is appropriately configured. In this case, even if there are any other terminal devices between the first terminal device 1C and the second terminal device 2C, the first terminal device 1C and the second terminal device 2C do not connect the communication path with other terminal devices. Thereby, the drawing system can always be appropriately configured. The above can perform the same authentication process in any case of the drawing system of the second embodiment and the drawing system of the third embodiment.

[0121] [Effects of Embodiment] As can be understood from the description of the above-described embodiments, in the first terminal device (1, 1A, 1B, 1C), drawing input can be received using the entire display screen of the display device 115 as a drawing area. Further, in the second terminal device (2, 2A, 2B, 2C), the entire display screen of the display device 215 is used as an instruction input area, and an instruction input reception screen is displayed here to receive an instruction input from the user. Then, in the second terminal device (2, 2A, 2B, 2C), instruction information can be provided to the first terminal device (1, 1A, 1B, 1C) according to the received instruction input. Thereby, in the first terminal device (1, 1A, 1B, 1C), drawing can be performed according to the instruction input of the user.

[0122] Thus, in the case of the drawing system of the above-described embodiments, a large drawing area can be secured on the display screen of the first terminal device (1, 1A, 1B, 1C). Further, an instruction input area is provided on the display screen of the second terminal device (2, 2A, 2B, 2C), and an instruction input to this instruction input area is also received at an appropriate timing and provided to the first terminal device (1, 1A, 1B, 1C) so that drawing can be performed according to the instruction of the user.

[0123] [Modification Example] Note that since the first sensor 111 of the first terminal devices (1, 1A, 1B, 1C) and the first sensor 211 of the second terminal devices (2, 2A, 2B, 2C) in the above-described embodiments are both of the electromagnetic induction type, drawing input and instruction input can be performed using the same electronic pen. Also, since the second sensor 113 of the first terminal devices (1, 1A, 1B, 1C) and the second sensor 213 of the second terminal devices (2, 2A, 2B, 2C) in the above-described embodiments are both of the capacitance type, input by the user's finger or an electrostatic pen is also possible. For this reason, it is possible to perform drawing input to the first terminal devices (1, 1A, 1B, 1C) using an electronic pen and perform instruction input to the second terminal devices (2, 2A, 2B, 2C) using the user's finger.

[0124] Also, the first terminal device and the second terminal device constituting the drawing system do not necessarily need to include both an electromagnetic induction type sensor and a capacitance type sensor. The first terminal device and the second terminal device only need to include either an electromagnetic induction type sensor or a capacitance type sensor. And for the first terminal device, since it realizes a drawing function, it only needs to be provided with a sensor capable of performing drawing input using an electronic pen or an electrostatic pen.

[0125] There are the following four combinations of sensors. (1) There may be a case where both the first terminal device and the second terminal device are provided with electromagnetic induction type sensors. (2) There may be a case where both the first terminal device and the second terminal device are provided with capacitance type sensors. (3) There may be a case where the first terminal device is provided with an electromagnetic induction type sensor and the second terminal device is provided with a capacitance type sensor. (4) There may be a case where the first terminal device is provided with a capacitance type sensor and the second terminal device is provided with an electromagnetic induction type sensor.

[0126] In the above-described embodiments, the first terminal devices (1, 1A, 1B, 1C) and the second terminal devices (2, 2A, 2B, 2C) are connected by short-range wireless communication, but the present invention is not limited to this. The two terminal devices can also be connected by wire. In this case, when it is confirmed that a connection to another terminal device by wire is established, a communication path may be connected through the wire between the two terminal devices.

[0127] In the above-described embodiments, when the first terminal devices (1, 1A, 1B, 1C) and the second terminal devices (2, 2A, 2B, 2C) are in proximity, a communication path is connected and drawing software or panel software is automatically started (executed). However, the present invention is not limited to this. Assume that the first terminal devices (1, 1A, 1B, 1C) and the second terminal devices (2, 2A, 2B, 2C) are in proximity and a communication path is connected. In this case, for example, when an operation input for performing drawing is received on one or both of the first terminal devices (1, 1A, 1B, 1C) and the second terminal devices (2, 2A, 2B, 2C), the drawing software or panel software may be started (executed).

[0128] The second terminal devices (2, 2A, 2B, 2C) have been described as having the configuration of a smartphone or a tablet PC, but the present invention is not limited to this. For example, a wristwatch-type terminal device called a smartwatch or various wearable terminals (terminals worn on the user's body) capable of receiving instruction inputs may be used.

[0129] Also, the instruction input reception screens used in the second terminal devices (2, 2A, 2B, 2C) are not limited to one, and of course, a plurality of instruction input reception screens for receiving different information may be prepared and switched and used according to the user's instructions. Such control can be performed by the control circuit 231.

[0130] In addition, the operation buttons provided on the second terminal devices (2, 2A, 2B, 2C) can be used in the same way as the left click button or the right click button of a so-called mouse which is a pointing device of a personal computer. That is, when a predetermined operation button provided on the second terminal device (2, 2A, 2B, 2C) is pressed, it is possible to select, move, or execute an item on the display screen 115D of the display device 115 of the first terminal device (1, 1A, 1B, 1C). Also, when another predetermined operation button provided on the second terminal device (2, 2A, 2B, 2C) is pressed, in the first terminal device (1, 1A, 1B, 1C), it is possible to display a menu of functions executable at that time for selection.

[0131] Also, assume that a side switch is mounted on the electronic pen and operation information of this side switch can be transmitted by short-range wireless communication. In this case, the side switch of the electronic pen can be used in the same way as the left click button or the right click button of a so-called mouse which is a pointing device of a personal computer, for example, for operations on the first terminal device (1, 1A, 1B, 1C). Of course, information corresponding to an operation on the side switch of the electronic pen can also be used for operations on the second terminal device (2, 2A, 2B, 2C). Therefore, whether the first terminal device (1, 1A, 1B, 1C) or the second terminal device (2, 2A, 2B, 2C) can be operated in response to an operation on the side switch of the electronic pen can be set for each terminal device by the user, for example.

[0132] Also, the sizes of the display screens of the display devices of the first terminal devices (1, 1A, 1B, 1C) and the second terminal devices (2, 2A, 2B, 2C) are not limited to the mode shown in FIG. 1. The first terminal devices (1, 1A, 1B, 1C) and the second terminal devices (2, 2A, 2B, 2C) may be provided with display devices of the same size. Also, the display screen of the display device of the second terminal devices (2, 2A, 2B, 2C) may be larger than the display screen of the display device of the first terminal devices (1, 1A, 1B, 1C).

Description of Reference Numerals

[0133] 1, 1A, 1B, 1C... First terminal devices, 110... User interface unit, 111... First sensor, 112... First position detection circuit, 113... Second sensor, 114... Second position detection circuit, 115... Display device, 115D... Display screen, 116... Display control circuit, 120... Drawing processing unit, 121... Drawing image memory, 122... Drawing parameter memory, 123... Drawing processing circuit, 130... Control unit, 131... Control circuit, 132... Storage device, 140... Connection unit, 141... Short-range wireless communication circuit, 141A... Short-range wireless communication antenna, 142... Proximity determination circuit, 150... Panel cooperation unit, 151... Panel data providing circuit, 152, 152A... Instruction information acquisition circuit, 170... Electronic pen authentication unit, 2, 2A, 2B, 2C... Second terminal devices, 210... User interface unit, 211... First sensor, 212... First position detection circuit, 213... Second sensor, 214... Second position detection circuit, 215... Display device, 215D... Display screen, 216... Display control circuit, 220... Drawing processing unit, 221... Drawing image memory, 222... Drawing parameter memory, 223... Drawing processing circuit, 230... Control unit, 231... Control circuit, 232... Storage device, 240... Connection unit, 241... Short-range wireless communication circuit, 241A... Short-range wireless communication antenna, 242... Proximity determination circuit, 250... Panel cooperation unit, 251... Panel data acquisition circuit, 252, 252A... Instruction information providing circuit, 270... Electronic pen authentication unit, 21... List band, 22... Holder

Claims

1. A first terminal device including a first display device and a first position detection sensor corresponding to a display screen of the first display device, and a second terminal device including a second display device and a second position detection sensor corresponding to a display screen of the second display device are communicably connected to form a drawing system, wherein the first terminal device includes an information acquisition unit that acquires information transmitted from the second terminal device, and a drawing processing unit that uses the display screen of the first display device as a drawing area and performs drawing in the drawing area in response to a drawing operation input received through the first position detection sensor by an electronic pen, and the second terminal device includes a plurality of instruction input reception screens for receiving different information stored in a predetermined storage unit, and switching control means for switching an instruction input screen to be displayed on the display screen of the second display device according to an instruction from a user among the plurality of instruction input reception screens, an instruction input reception processing unit that uses the display screen of the second display device as an instruction input area and receives an instruction input through the instruction input reception screen displayed on the display screen and the second position detection sensor by an electronic pen, and an information providing unit that transmits information input through the instruction input reception processing unit to the first terminal device, and the first position detection sensor of the first terminal device and the second position detection sensor of the second terminal device can be operated by the same electronic pen, and the second terminal device includes a second receiving means for receiving identification information of the electronic pen as second identification information, and a second identification information providing means for transmitting the second identification information to the first terminal device, and the first terminal device includes a first receiving means for receiving identification information of the electronic pen as first identification information, a second identification information receiving means for receiving the second identification information from the second identification information providing means, and a first authentication control means for connecting a communication path to the second terminal device when the first identification information and the second identification information are the same, characterized in that it comprises a drawing system.

2. The drawing system according to claim 1, wherein the first terminal device When a communication path is connected to the second terminal device, it includes information for forming a plurality of the instruction input reception screens for which the received information is different, and includes a screen information providing unit that transmits screen information such as a screen necessary for receiving and transmitting instruction information to the second terminal device. The second terminal device includes a screen information acquisition unit that acquires the screen information such as the above transmitted from the first terminal device and records it in the predetermined storage unit. A drawing system characterized by this.

3. The drawing system according to claim 1, wherein the second position detection sensor of the second terminal device is capable of a touch operation by a user's finger or the like. A drawing system characterized by this.

4. The drawing system according to claim 1, wherein the first terminal device includes a first communication unit that transmits and receives signals wirelessly or by wire, and a connection determination unit that performs connection determination based on the result of communication through the first communication unit. It is provided with The second terminal device includes a second communication unit that transmits and receives signals wirelessly or by wire, and a connection determination unit that performs connection determination based on the result of communication through the second communication unit. A drawing system characterized by this.

5. The drawing system according to claim 4, wherein the first terminal device includes a first operation unit for starting communication through the first communication unit, and when the first operation unit is operated, the first communication unit starts communication processing for connecting a communication path with the second communication unit of the second terminal device. A drawing system characterized by this.

6. The drawing system according to claim 4, wherein the second terminal device includes a second operation unit for starting communication through the second communication unit, and when the second operation unit is operated, the second communication unit starts communication processing for connecting a communication path with the first communication unit of the first terminal device. A drawing system characterized by this.

7. The drawing system according to claim 1, wherein the second terminal device includes a fixture for attaching to a user's body. A drawing system characterized by this.

Images