Drawing system

Abstract

To provide a drawing system for making it possible to secure a large drawing area and to receive an instruction input for an instruction input area at a proper timing to carry out drawing in response to the input.SOLUTION: According to the present invention, a first terminal device 1 and a second terminal device 2 are connected to each other so as to communicate with each other, with a display screen 115D of a display device of the first terminal device 1 being set as a drawing dedicated area and a display screen 215D of a display device of the second terminal device 2 being set as an instruction input dedicated area. The first terminal device 1 is operated in response to instruction information from the second terminal device 2, and carries out drawing in the drawing area provided on the display screen 115D of the first display device in response to a drawing operation input received through a first position detection sensor.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a drawing system including, for example, a display device and a position detection sensor, and a terminal device capable of receiving drawing input using an electronic pen. [Background technology]

[0002] For example, tablet PCs (Personal Computers) that are equipped with a display device such as an LCD (Liquid Crystal Display) and a position detection sensor and that allow drawing input using an electronic pen are widely used. When drawing input is performed on a tablet PC, so-called drawing software is executed. In the drawing software, a drawing area and an instruction input area are provided on the display screen to accept instruction input from a user.

[0003] The drawing area is an area that accepts drawing input by an electronic pen and displays a drawn image in response to the input. The instruction input area is an area that displays an instruction input acceptance screen and accepts various instruction inputs (parameter inputs) related to drawing, such as the line type, color, hue, vividness, brightness, degree of gradation, etc. The instruction input area is also sometimes called a palette section because it is used for color selection, etc.

[0004] Since the drawing area and the instruction input area are provided within a single display screen, if the electronic pen accidentally enters the instruction input area while drawing in the drawing area, unintended instruction input may be performed. To address this problem, Patent Document 1 described below discloses an invention relating to a coordinate input control method that invalidates instruction input to the instruction input area when the electronic pen continues from the drawing area into the instruction input area. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2005-11233 A Summary of the Invention [Problem to be solved by the invention]

[0006] Even in a tablet PC having a display device with a relatively large display screen, if both a drawing area and an instruction input area are provided on the display screen of the device, the drawing area is inevitably small. In recent years, with the improvement in computer performance, it is often the case that detailed drawing is performed by running drawing software on a small tablet PC equipped with a small display device with a display screen size of about 8 inches to 11 inches.

[0007] In this case, the drawing area becomes very small. If the drawing area is small, then when drawing a detailed image, the drawn image will have to be repeatedly enlarged and reduced, which can severely impair work efficiency. For this reason, there is a demand to make the drawing area as large as possible. At the same time, it is also necessary to be able to input instructions into the instruction input area appropriately and at the right time. If changes to line types and colors cannot be made at the right time, the user will not be able to flexibly draw according to their intentions.

[0008] In view of the above, an object of the present invention is to provide a drawing system that can ensure a large drawing area, and can also accept instruction input to an instruction input area at an appropriate timing and perform drawing in response to the instruction input. [Means for solving the problem]

[0009] In order to solve the above problems, A drawing system configured by communicatively connecting a first terminal device including a first display device and a first position detection sensor corresponding to a display screen of the first display device, and a second terminal device including a second display device and a second position detection sensor corresponding to a display screen of the second display device, The first terminal device is an information acquisition unit that acquires information transmitted from the second terminal device; a drawing processing unit that sets the display screen of the first display device as a drawing area and performs drawing in the drawing area with an electronic pen in response to a drawing operation input received through the first position detection sensor; Equipped with The second terminal device is a switching control means for storing a plurality of instruction input acceptance screens each having different information to be accepted in a predetermined storage unit, and for switching an instruction input screen to be displayed on the display screen of the second display device from among the plurality of instruction input acceptance screens in response to an instruction from a user; an instruction input reception processing unit that sets the display screen of the second display device as an instruction input area and receives an instruction input by an electronic pen through the instruction input reception screen displayed on the display screen and the second position detection sensor; an information providing unit that transmits information input through the instruction input reception processing unit to the first terminal device; Equipped with the first position detection sensor of the first terminal device and the second position detection sensor of the second terminal device can be operated by a same electronic pen; The second terminal device is a second receiving means for receiving the identification information of the electronic pen as second identification information; a second identification information providing means for transmitting the second identification information to the first terminal device; Equipped with The first terminal device is a first receiving means for receiving identification information of the electronic pen as first identification information; a second identification information receiving means for receiving the second identification information from the second identification information providing means; a first authentication control means for connecting a communication path to the second terminal device when the first identification information and the second identification information are the same; The present invention provides a drawing system comprising: [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram for explaining an example of the appearance of a drawing system according to an embodiment. [Diagram 2] FIG. 2 is an exploded configuration diagram for explaining the basic structures of first and second terminal devices according to the embodiment. [Diagram 3] FIG. 2 is a block diagram illustrating a configuration example of a first terminal device according to the first embodiment. [Figure 4] FIG. 2 is a block diagram illustrating a configuration example of a second terminal device according to the first embodiment. [Diagram 5] FIG. 2 is a diagram for explaining an overview of the operation of the first terminal device and the second terminal device in the first embodiment. [Figure 6] 5 is a flowchart for explaining a process performed in a first terminal device and a process performed in a second terminal device according to the first embodiment. [Figure 7] FIG. 13 is a block diagram for explaining a configuration example of a first terminal device and a configuration example of a second terminal device according to a second embodiment. [Figure 8] FIG. 11 is a diagram for explaining an overview of operations of a first terminal device and a second terminal device according to a second embodiment. [Figure 9] 13 is a flowchart for explaining a process performed in a first terminal device and a process performed in a second terminal device according to a second embodiment. [Figure 10] FIG. 13 is a block diagram for explaining a configuration example of a first terminal device and a configuration example of a second terminal device according to a third embodiment. [Figure 11] FIG. 13 is a diagram for explaining an overview of the operations of a first terminal device and a second terminal device according to a third embodiment. [Figure 12] 13 is a flowchart for explaining operations of a process performed in a first terminal device and a process performed in a second terminal device according to a third embodiment. [Figure 13] 11 is a diagram for explaining an example of how the second terminal device is attached to the body of a user. FIG. [Figure 14]1 is a block diagram illustrating an example of the configuration of a drawing system that performs authentication processing using electronic pen identification information. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the drawing system of the present invention will be described with reference to the drawings. Three embodiments will be described below, but first, the external appearance of the drawing system common to the drawing systems of the three embodiments and the basic structure of the terminal device constituting the drawing system will be described.

[0012] [Appearance of the drawing system] Fig. 1 is a diagram for explaining an example of the appearance of a drawing system according to an embodiment. As shown in Fig. 1, the drawing system is composed of a first terminal device 1 and a second terminal device 2. The first terminal device 1 is realized as a tablet PC or the like that includes a thin display device having a display screen size of, for example, about 8 to 12 inches, and a position detection sensor that corresponds to the display screen and detects a position pointed to by a pointer such as an electronic pen.

[0013] The second terminal device 2 includes a thin display device with a display screen size of, for example, about 4 to 6 inches, and a position detection sensor that detects a position indicated by a pointer such as an electronic pen corresponding to the display screen. Specifically, the second terminal device 2 is realized as a highly functional mobile phone terminal such as a smartphone, a tablet PC smaller than the first terminal device 1, or the like.

[0014] The first terminal device 1 and the second terminal device 2 can communicate with each other by connecting a communication path by a short-distance wireless communication function. There are various standards for short-distance wireless communication functions, and the drawing system can also use short-distance wireless communication functions of various standards. However, in the following, for the sake of simplicity, it is assumed that the short-distance wireless communication function of the Bluetooth (registered trademark) standard, which is widely used, is used between the first terminal device 1 and the second terminal device 2.

[0015] The first terminal device 1 is equipped with drawing software (hereinafter, referred to as drawing software), and by executing this, a drawing area R1 and an instruction input area R2 are provided on the display screen 115D as shown in Fig. 1, and input from a user can be received. The drawing area R1 is an area that receives drawing input from an electronic pen and displays a drawn image in response to the drawing. The instruction input area is an area that displays an instruction input reception screen and receives various instruction inputs (parameter inputs) related to drawing, such as the selection of a line type or color.

[0016] The first terminal device 1 can receive operation input from a user to the drawing area R1 and the instruction input area R2, and can draw an image in the drawing area R1 according to the instruction of the user. That is, in this specification, the drawing software is a two-dimensional computer graphics application that draws an image on a computer using a pointing device (mainly an electronic pen).

[0017] However, the size of the display screen 115D of the first terminal device 1 is small, ranging from 8 inches to 12 inches. Therefore, as shown in FIG. 1, by providing the instruction input area R2, the drawing area R1 becomes small, and the work efficiency when creating a drawing deteriorates. In recent years, smartphones and small tablet PCs have become widespread. Even users of the first terminal device as a drawing device often carry a smartphone or a small tablet PC.

[0018] Therefore, one drawing system is configured by utilizing a second terminal device 2 in addition to the first terminal device 1. In this drawing system, the entire surface of the display screen 115D of the first terminal device 1 is used as a drawing area, and the entire surface of the display screen 215D of the second terminal device 2 is used as an instruction input area. That is, the drawing area R1 and the instruction input area R2, which were conventionally provided within the display screen of one terminal device, are provided separately in the first terminal device 1 and the second terminal device 2.

[0019] This prevents the instruction input area from compressing the drawing area and narrowing the drawing area. Then, instruction information received through the instruction input area provided on the display screen 215D of the second terminal device 2 is provided to the first terminal device 1 through wireless communication. The first terminal device 1 is capable of drawing according to the instruction information from the second terminal device and the instruction input from the user to the drawing area provided on the entire surface of its own display screen 115D.

[0020] [Basic structure of the first and second terminal devices] FIG. 2 is an exploded view for explaining the basic structure of the first and second terminal devices. As shown in FIG. 1, the first terminal device 1 and the second terminal device 2 are different in size, but both are equipped with a thin display device and a position detection sensor, have a flat outer shape, and have the same basic structure. Therefore, the basic structures of the first terminal device 1 and the second terminal device 2 will be explained here using the first terminal device 1 as an example. Note that the reference numerals in parentheses in FIG. 2 refer to the second terminal device 2.

[0021] 2, the first terminal device 1 includes a circuit board 100, a first sensor 111, a display device 115, and a second sensor 113 housed in a housing 10 in this order from the bottom, and these are sealed in the housing 10 by a front panel 20. For example, transparent tempered glass is fitted inside the front panel 20, which is indicated by a dotted line, so that the entire display screen of the display device 115 can be viewed. In addition, the tempered glass surface of the front panel 20 serves as an operation surface, and a pointing operation can be performed on the first sensor 111 or the second sensor 113 using a pointing object without damaging the second sensor 113 or the like.

[0022] The circuit board 100 is equipped with various electronic circuits and electronic components such as a control circuit, a display control circuit, a position detection circuit for the first sensor, a position detection circuit for the second sensor, a short-range wireless communication circuit, and a semiconductor memory. The first sensor 111 is of an electromagnetic induction type. The display device 115 includes, for example, an LCD (Liquid Crystal Display) that is a thin display element, various filters, a backlight, and the like. The second sensor 113 is of a capacitance type. That is, the first terminal device 1 is provided with position detection sensors of different types on either side of the display device 115.

[0023] The first sensor 111 of the electromagnetic induction type is configured by arranging a plurality of loop coils in each of the X-axis direction and the Y-axis direction. A transmission period in which power is supplied sequentially to the plurality of loop coils of the first sensor 111 to generate a magnetic field and a reception period in which the supply of power is stopped and a magnetic field from the outside are alternately provided. The corresponding electronic pen of the electromagnetic induction type has a resonant circuit made of a coil and a capacitor, and generates a signal by causing a current to flow through the coil in response to the magnetic field from the first sensor 111, and transmits this signal including writing pressure information to the first sensor 111. The first sensor 111 receives this during the reception period and supplies it to a position detection circuit for the first sensor, and the position indicated by the electronic pen and the writing pressure are detected.

[0024] The second sensor 113 of the capacitance type has a plurality of linear conductors (line electrodes) arranged in each of the X-axis direction and the Y-axis direction. When a finger or an electrostatic pen (a pen-shaped position indicator having conductivity) is brought close to the second sensor 113, a change in capacitance (charge) occurs in the linear conductor, which is supplied to a position detection circuit for the second sensor, and the indicated position is detected. Note that some electrostatic pens are so-called active electrostatic pens that are driven by a battery and send out signals. However, the second sensor 113 is mainly operated by a finger or a simply electrostatic pen having conductivity.

[0025] Each of the first sensor 111 and the second sensor 113 corresponds to the entire display screen of the display device 115, and is capable of detecting any position on the display screen that is pointed to. In this manner, the first terminal device 1 can receive a pointing input using an electromagnetic induction type electronic pen through the first sensor 111, and can also receive a pointing input using a finger or an electrostatic pen through the second sensor 113. In particular, by using an electromagnetic induction type electronic pen, a position can be pointed to more precisely, and the writing pressure applied to the electronic pen can be detected and transmitted to the first sensor 111, allowing for fine drawing.

[0026] [First embodiment] <Configuration Example of First Terminal Device 1> 3 is a block diagram for explaining a configuration example of the first terminal device 1 according to the first embodiment. The first terminal device 1 includes a user interface unit 110, a drawing processing unit 120, a control unit 130, a connection unit 140, and a panel linkage unit 150, as shown surrounded by a dotted line.

[0027] The user interface unit 110 is a part that receives instruction input from a user and provides information to the user. As shown in Fig. 3, the user interface unit 110 includes a first sensor 111, a first position detection circuit 112, a second sensor 113, a second position detection circuit 114, a display device 115, and a display control circuit 116.

[0028] The first sensor 111 is an electromagnetic induction type position detection sensor equipped with an X-axis direction loop coil group and a Y-axis direction loop coil group, and the first position detection circuit 112 is a position detection circuit for the first sensor. The first position detection circuit 112 can provide a transmission period in which power is supplied to generate a signal (magnetic field) and a reception period in which power supply is stopped and a signal (magnetic field) is received from the electronic pen, while sequentially switching between the X-axis direction and Y-axis direction loop coils of the first sensor 111.

[0029] During the reception period, the first position detection circuit 112 detects the position indicated by the electronic pen according to the position of the loop coil that received the signal from the electronic pen, and can notify the control unit 130 and the like of the detection result. The signal from the electronic pen also includes information regarding writing pressure. Therefore, the first position detection circuit 112 can also detect writing pressure information from the received signal from the electronic pen, and can notify the control unit 130 and the like of the detection result.

[0030] The second sensor 113 is a capacitive position detection sensor having an X-axis direction linear conductor group and a Y-axis direction linear conductor group, and the second position detection circuit 114 is a position detection circuit for the second sensor. The second position detection circuit 114 detects a position indicated by a finger or electrostatic pen based on the capacitance generated in the linear conductors in the X-axis direction and Y-axis direction of the second sensor 113, and notifies the control unit 130 etc. of the detection result.

[0031] The display device 115 includes an LCD, various filters, a backlight, etc. The display control circuit 116, under the control of the control unit 130, performs processes such as displaying various information on the display screen of the display device 115 and erasing the displayed information.

[0032] The drawing processing unit 120 realizes a function of drawing on the first terminal device 1 in response to an instruction from a user. The drawing processing unit 120 includes a drawing image memory 121, a drawing parameter memory 122, and a drawing processing circuit 123. The drawing image memory 121 is a memory (VRAM) corresponding to the display screen of the display device 115, and stores and holds image data forming an image drawn in response to an instruction from a user. The drawing parameter memory 122 stores and holds setting information (parameter information) related to various drawing such as line type and color, which is accepted through an instruction input acceptance screen displayed in an instruction input area.

[0033] The drawing processing circuit 123 performs a process of forming an image in the drawing image memory 121 according to an instruction input received through the first sensor 111, based on the parameters stored and held in the drawing parameter memory 122. The drawing processing circuit 123 can also perform a process of erasing the image formed in the drawing image memory 121 according to an instruction input received through the first sensor 111. In this case, the image is erased so that only a part of the drawn image can be erased.

[0034] The control unit 130 is a part that realizes the function of controlling each part of the first terminal device 1, and includes a control circuit 131 and a storage device 132. The control circuit 131 includes a central processing unit (CPU), a read only memory (ROM), a random access memory (RAM), a non-volatile memory, and the like, which are not shown. The control circuit 131 executes various software and controls each part to realize various functions of the first terminal device 1. The storage device 132 is, for example, made up of a relatively large-capacity semiconductor memory and its driver, and writes, deletes, and changes information to the semiconductor memory, and reads information from the semiconductor memory. The storage device 132 stores and holds various application software, information required for processing, information created by the user, and the like, and is also used as a work area that holds the progress of processing.

[0035] The connection unit 140 is a part that realizes a short-distance wireless communication function, and is composed of a short-distance wireless communication circuit 141, a short-distance wireless communication antenna 141A, and a proximity determination circuit 142. The short-distance wireless communication circuit 141 and the short-distance wireless communication antenna 141A realize a short-distance wireless function of the Bluetooth (registered trademark) standard. The proximity determination circuit 142 determines, based on the state of the short-distance wireless communication circuit 141 and the received information, whether the second terminal device 2 has approached and whether a communication path has been connected via the short-distance wireless communication circuit 141 and the short-distance wireless communication antenna 141A to enable communication.

[0036] The panel linkage unit 150 cooperates with the second terminal device 2, provides an instruction input area in the second terminal device 2, and realizes a function of receiving instruction information accepted in the second terminal device. The panel linkage unit 150 includes a panel data providing circuit 151 and an instruction information acquiring circuit 152. The panel data providing circuit 151 functions when the second terminal device 2 is in proximity to the first terminal device and the proximity determining circuit 142 determines that the communication path is connected and communication is possible.

[0037] The panel data providing circuit 151 provides the second terminal device 2 with panel data (screen information, etc.) for making the display screen 215D of the second terminal device 2 an instruction input area, accepting an instruction input from a user, and transmitting the accepted instruction information to the first terminal device. The panel data includes image data forming an instruction input accepting screen to be displayed on the display screen 215D of the second terminal device 2, software for accepting an instruction input from a user through the instruction input accepting screen, and performing a process of transmitting the instruction input to the first terminal device. The panel data is provided to the second terminal device 2 through the short-range wireless communication circuit 141 and the short-range wireless communication antenna 141A.

[0038] The instruction information acquisition circuit 152 acquires instruction information (parameters) related to drawing from the second terminal device 2 received through the short-range wireless communication antenna 141A and the short-range wireless communication circuit 141, and performs processing to record the information in the drawing parameter memory 122. As described above, the instruction information from the second terminal device 2 is provided to the second terminal device 2 by the function of the panel data providing circuit 151 of the first terminal device 1, and is instruction information corresponding to an instruction input received through the instruction information input screen displayed on the display screen 215D.

[0039] When the first terminal device 1 is powered on, the control circuit 131 displays an icon corresponding to executable software on the display screen 115D of the display device 115 through the display control circuit 116 based on the information stored in the storage device 132. The control circuit 131 accepts an icon selection input through the second sensor 113 and the second position detection circuit 114, and executes the software corresponding to the selected icon, allowing the user to perform the processing desired.

[0040] In the first terminal device 1 of the first embodiment, the connection unit 140 and the panel linkage unit 150 function under the control of the control circuit 131, so that the first terminal device 1 can link with the second terminal device 2 and execute drawing software to realize a drawing function. The details of the drawing function realized by the linkage between the first terminal device 1 and the second terminal device 2 will be described later.

[0041] <Configuration Example of Second Terminal Device 2> 4 is a block diagram for explaining a configuration example of the second terminal device 2 according to the first embodiment. The second terminal device 2 includes a user interface unit 210, a drawing processing unit 220, a control unit 230, a connection unit 240, and a panel linkage unit 250, as shown surrounded by a dotted line.

[0042] The user interface unit 210, the drawing processing unit 220, the control unit 230, and the connection unit 240 of the second terminal device 2 are configured in the same manner as the corresponding components with the same names of the first terminal device 1. Therefore, the description of each of these components of the second terminal device 2 will be omitted to avoid duplication. However, the first sensor 211, the second sensor 213, and the display device 215 of the second terminal device are different in size from the first sensor 111, the second sensor 113, and the display device 115 of the first terminal device.

[0043] Furthermore, the panel linkage unit 250 of the second terminal device 2 has a different configuration from the panel linkage unit 150 of the first terminal device 1. The panel linkage unit 250 of the second terminal device 2 includes a panel data acquisition circuit 251 and an instruction information providing circuit 252. The panel data acquisition circuit 251 acquires panel data transmitted from the first terminal device 1 and received via the short-range wireless communication antenna 241A and the short-range wireless communication circuit 241. The panel data acquisition circuit 251 stores the acquired panel data in, for example, the storage device 232.

[0044] The panel data acquisition circuit 251 executes, for example, software in the control circuit 231 that accepts an instruction input from among the panel data stored in the storage device 232. As a result, information for displaying an instruction input acceptance screen is supplied to the display control circuit 216 under the control of the control circuit 231, and the instruction input acceptance screen is displayed on the display screen 215D of the display device 215. Then, an instruction input from the user can be accepted through the instruction input acceptance screen displayed on the display screen 215D and the first sensor 211 and the first position detection circuit 212 or the second sensor 213 and the second position detection circuit 214.

[0045] The instruction information providing circuit 252 performs a process of transmitting instruction information corresponding to an instruction input receiving screen displayed on the display screen 215D of the display device 215 and an instruction input received through the first sensor 211 and the first position detection circuit 212 to the first terminal device 1. In this case, the instruction information is transmitted to the first terminal device 1 through the short-range wireless communication circuit 241 and the short-range wireless communication antenna 241A.

[0046] Generally, it is considered that a user often operates the instruction input receiving screen using an electronic pen used for drawing, and in this case, the instruction input is received through the instruction input receiving screen, the first sensor 211 of the electromagnetic induction type, and the first position detection circuit 212. However, when the user touches the display screen 215D with a finger or the like, it is of course possible to receive the instruction input through the instruction input receiving screen, the second sensor 213 of the electrostatic induction type, and the second position detection circuit 214.

[0047] Therefore, in the second terminal device 2 of the first embodiment, under the control of the control circuit 231, the connection unit 240 and the panel linkage unit 250 function to link with the first terminal device 1 and realize a drawing function according to the drawing software executed on the first terminal device 1.

[0048] Also, in the second terminal device 2, when the power is turned on, the control circuit 231 displays an icon corresponding to executable software on the display screen 215D of the display device 215 through the display control circuit 216 based on the information stored and held in the storage device 232. The control circuit 231 accepts an icon selection input through the second sensor 213 and the second position detection circuit 214, executes the software corresponding to the selected icon, and performs the processing desired by the user.

[0049] <Overview of Operation of Drawing System of First Embodiment> FIG. 5 is a diagram for explaining an overview of the operation of the first terminal device 1 and the second terminal device 2 constituting the drawing system of the first embodiment. As shown in FIG. 5(A), the first terminal device 1 is equipped with drawing software. This drawing software also includes panel data to be provided to the second terminal device 2. As shown in FIG. 5(A), when the first terminal device 1 and the second terminal device 2 are each powered on, it is assumed that these terminal devices are far apart from each other and therefore cannot communicate wirelessly using the short-range wireless communication function. In this case, the first terminal device 1 and the second terminal device 2 function independently of each other.

[0050] Assume that the first terminal device 1 and the second terminal device 2, both in a powered-on state, are brought close to each other as indicated by the dotted arrow in Fig. 5(A). Then, as shown in Fig. 5(B), the first terminal device 1 and the second terminal device 2 are brought close to each other and are able to wirelessly communicate with each other by short-range wireless communication. In this case, as shown in Fig. 5(B), the drawing software is started (executed) in the first terminal device 1, and panel data is transmitted to the second terminal device 2. The second terminal device 2 receives the panel data from the first terminal device 1 and uses it.

[0051] 5(C), in the first terminal device 1, the entire surface of the display screen 115D of the display device 115 is made into a drawing area by the function of the drawing software, and drawing input can be performed through the drawing area. In the second terminal device 2, the entire surface of the display screen 215D of the display device 215 is made into an instruction input area by the function of the panel data from the first terminal device 1, and an instruction input acceptance screen is displayed here, allowing instruction input from the user to be accepted.

[0052] The instruction input receiving screen displayed on the display screen 215D of the second terminal device 2 and the instruction information received through the first sensor 211 and the first position detection circuit 212 are transmitted to the first terminal device 1 by the function of the instruction information providing circuit 252. The instruction information from the second terminal device 2 is various parameters related to drawing such as line type and color, and the first terminal device 1 is adapted to obtain the instruction information from the second terminal device 2 and draw in the drawing area accordingly.

[0053] <Processing of the first terminal device 1 and the second terminal device 2 in the first embodiment> Fig. 6 is a flow chart for explaining the process performed by the first terminal device 1 and the process performed by the second terminal device 2 in the first embodiment. When the first terminal device 1 is powered on and no software is running, it executes the process shown in Fig. 6(A). Similarly, when the second terminal device 2 is powered on and no software is running, it executes the process shown in Fig. 6(B).

[0054] In the first terminal device 1, the short-distance wireless communication circuit 141 transmits and receives a connection request signal, and the proximity determination circuit 142 performs a process of determining whether the second terminal device 2 is in proximity based on the reception status of the connection request signal from the external device (step S101). The determination process in step S101 continues until it is determined that the second terminal device 2 is in proximity, or a predetermined end event occurs, such as the execution of some software or the operation of turning off the power.

[0055] When the determination process of step S101 is completed, the control circuit 131 determines whether or not the second terminal device 2 is in proximity based on the detection output from the proximity determination circuit 142 (step S102). When it is determined in the determination process of step S102 that the second terminal device 2 is not in proximity, a predetermined end event has occurred, so the control circuit 131 ends the process shown in Fig. 6(A) and waits for the next execution timing. Also, when it is determined in the determination process of step S102 that the second terminal device 2 is in proximity, the control circuit 131 controls the short-range wireless communication circuit 141 to perform short-range wireless communication with the second terminal device 2 and performs a process of connecting a communication path (step S103).

[0056] Similarly, in the second terminal device 2, the short-distance wireless communication circuit 241 transmits and receives a connection request signal, and the proximity determination circuit 242 performs a process of determining whether the first terminal device 1 is in proximity based on the reception status of the connection request signal from the external device (step S201). The determination process of step S201 continues, as in the process of step S101, until it is determined that the first terminal device 1 is in proximity, or until a predetermined end event occurs, such as the execution of some software or the operation of turning off the power.

[0057] When the determination process of step S201 is completed, the control circuit 231 determines whether or not the first terminal device 1 is in proximity based on the detection output from the proximity determination circuit 242 (step S202). When it is determined in the determination process of step S202 that the first terminal device 1 is not in proximity, a predetermined end event has occurred, so the control circuit 231 ends the process shown in Fig. 6(B) and waits for the next execution timing. Also, when it is determined in the determination process of step S202 that the first terminal device 1 is in proximity, the control circuit 231 controls the short-range wireless communication circuit 241 to perform short-range wireless communication with the first terminal device 1 and performs a process of connecting a communication path (step S203).

[0058] This enables the first terminal device 1 to communicate wirelessly via short-range wireless communication circuit 141 and short-range wireless communication antenna 141A, and the second terminal device 2 to communicate wirelessly via short-range wireless communication circuit 241 and short-range wireless communication antenna 241A.

[0059] After the process of step S103, the first terminal device 1 starts up the drawing software in the control circuit 131, and the entire surface of the display screen 115D of the display device 115 is set as a drawing area, and drawing input from the user is made available (step S104). That is, after the process of step S104, the first terminal device 1 transitions to a state in which drawing according to an instruction input from the user is available. As a result, the first terminal device 1 is made able to accept drawing input (position instruction input) by the user using an electronic pen through the first sensor 111 and the first position detection circuit 112, and display a drawing image corresponding to the input on the display screen 115D of the display device 115. Furthermore, in the first terminal device 1, the panel data providing circuit 151 functions under the control of the control circuit 131, and transmits panel data to the second terminal device 2 by short-distance wireless communication (step S105).

[0060] In the second terminal device 2, the panel data from the first terminal device 1 is received, and the panel data acquisition circuit 251 acquires the panel data, and uses the panel data to display an instruction input acceptance screen on the display screen 215D of the display device 215, thereby making it possible to accept an instruction input (step S204). That is, after the process of step S204, the second terminal device 2 transitions to a state in which it is possible to accept instruction information according to an instruction input from the user. In this case, the entire surface of the display screen 215D of the display device 215 of the second terminal device 2 becomes an instruction input area, and the instruction input acceptance screen is displayed therein. Then, it is possible to accept an instruction input from the user through the instruction input acceptance screen displayed on the display screen 215D, and the first sensor 211 and the first position detection circuit 212 or the second sensor 213 and the second position detection circuit 214.

[0061] Thereafter, the control circuit 231 of the second terminal device 2 controls the instruction information providing circuit 252 to execute an instruction information providing process (step S205). In the process of step S205, when an instruction input related to drawing is received, the instruction information providing circuit 252 functions to form instruction information to be provided to the first terminal device 1, wirelessly transmits the instruction information, and then proceeds to the next step. In addition, in the process of step S205, when an instruction input related to drawing is not received, nothing is done and the process proceeds to the next step.

[0062] On the other hand, in the first terminal device 1, the control circuit 131 controls the instruction information acquisition circuit 152 to perform an acquisition and setting process of the instruction information (step S106). In the process of step S106, when instruction information related to drawing is acquired, the instruction information acquisition circuit 152 functions to store (set) the acquired instruction information in the drawing parameter memory 122. In addition, in the process of step S106, when instruction information from the second terminal device is not acquired, nothing is done and the process proceeds to the next step.

[0063] As described above, the instruction information from the second terminal device 2 is, for example, parameters related to drawing, such as line type and color. Therefore, by setting the instruction information in the drawing parameter memory 122, drawing can be performed according to the instruction information. Therefore, when the instruction information is related to, for example, line type and color, drawing can be performed with the specified line type and color.

[0064] Thereafter, in the first terminal device 1, the control circuit 131 determines whether or not an end event has occurred, such as a predetermined operation to end the execution of the drawing software (step S107). If it is determined in the determination process of step S107 that an end event has not occurred, the process from step S106 is repeated, and drawing input from the user is continuously accepted. If it is determined in the determination process of step S107 that an end event has occurred, end processes are performed, such as releasing the communication path connected in step S103 and returning the image displayed on the display screen to the state before the execution of the drawing software (step S108). Thereafter, the process shown in FIG. 6(A) is terminated.

[0065] On the other hand, in the second terminal device 2, after the process of step S205, the control circuit 231 also judges whether or not an end event has occurred, such as a predetermined operation to end the reception of instruction input through the instruction input reception screen (step S206). If it is judged in the judgment process of step S206 that an end event has not occurred, the process from step S205 is repeated so that the reception of instruction input from the user can be continued. If it is judged in the judgment process of step S206 that an end event has occurred, an end process is performed, such as releasing the communication path connected in step S203 and returning the display image on the display screen to the state before the instruction input reception screen was displayed (step S207). After this, the process shown in FIG. 6(B) is terminated.

[0066] In this way, the entire surface of the display screen 115D of the first terminal device 1 can be used as a drawing area. Also, the entire surface of the display screen 215D of the second terminal device 2 can be used as an instruction input area to display an instruction input reception screen, receive instruction inputs related to drawing, and transmit and provide instruction information corresponding to the received instruction inputs to the first terminal device. This allows a large drawing area to be secured, and drawing inputs can be performed appropriately without repeatedly enlarging or reducing the drawing. Moreover, the second terminal device 2 can receive instruction inputs related to drawing, such as line type and color, and provide instruction information (parameter information) corresponding to the inputs to the first terminal device. This allows the user to properly perform drawing as intended, even when using a drawing system consisting of the first terminal device 1 and the second terminal device 2.

[0067] [Second embodiment] <Example of configuration of first terminal device 1A and second terminal device 2A> The drawing system of the second embodiment is also configured with two terminal devices, a first terminal device and a second terminal device, similar to the drawing system of the first embodiment described with reference to Fig. 1. Specifically, it is configured with a first terminal device 1A realized as a tablet PC or the like, and a second terminal device 2A realized as a smartphone or a small tablet PC or the like. The first terminal device 1A and the second terminal device 2A of the second embodiment are both flat (thin) devices having the basic structure described with reference to Fig. 2.

[0068] However, the first terminal device 1 and the second terminal device 2 of the first embodiment and the first terminal device 1A and the second terminal device 2A of the second embodiment described below have different software to be executed and configurations of the panel linkage unit. FIG. 7 is a block diagram for explaining a configuration example of the first terminal device 1A and the second terminal device 2A of the second embodiment. In the first terminal device 1A shown in the upper part of FIG. 7, the same reference numerals are given to the parts configured similarly to the first terminal device 1 of the first embodiment described using FIG. 3, and detailed description of the parts is omitted. Similarly, in the second terminal device 2A shown in the lower part of FIG. 7, the same reference numerals are given to the parts configured similarly to the second terminal device 2 of the first embodiment described using FIG. 4, and detailed description of the parts is omitted.

[0069] The control unit 130 of the first terminal device 1A shown in the upper part of Fig. 7 also functions as a drawing software execution unit, similar to the first terminal device 1 of the first embodiment. However, the drawing software executed in the control unit 130 of the first terminal device 1A is different from the drawing software used in the first terminal device 1 of the first embodiment, and does not have a function of providing panel data to the second terminal device 2A. For this reason, the panel linkage unit 150A of the first terminal device 1A of the second embodiment has only an instruction information acquisition circuit 152A, and does not have a panel data providing circuit.

[0070] The control unit 230 of the second terminal device 2A shown in the lower part of FIG. 7 functions as an execution unit of panel software that displays an instruction input reception screen on the display screen 215D and receives instruction input from the user. Therefore, the second terminal device 2A of this second embodiment does not need to receive panel data from the first terminal device 1A. Therefore, the panel linkage unit 250A of the second terminal device 2A of the second embodiment has only an instruction information providing circuit 252A and does not have a panel data acquisition circuit. That is, in the case of the drawing system of this second embodiment, the second terminal device 2A is configured to have the panel data.

[0071] <Overview of Operation of Drawing System of Second Embodiment> FIG. 8 is a diagram for explaining an outline of the operation of the first terminal device 1A and the second terminal device 2A constituting the drawing system of the second embodiment. As shown in FIG. 8(A), the first terminal device 1A is equipped with drawing software. This drawing software is slightly different from the drawing software equipped in the first terminal device 1 of the first embodiment. This drawing software enables drawing to be performed using the entire surface of the display screen 115D of the first terminal device 1A as a drawing area, but does not have a function of providing panel data to the second terminal device 2A.

[0072] On the other hand, the second terminal device 2A is equipped with panel software. The panel software includes image data for forming an instruction input reception screen. The panel software also includes software that functions to make the entire surface of the display screen 215D of the second terminal device 2A an instruction input area, display an instruction input reception screen thereon, and receive instruction input from the user through the first sensor 211 and the second sensor 213. Note that, as in the case of the drawing system of the first embodiment, instruction information from the user can of course be received through the instruction input reception screen, the second sensor 213, and the second position detection circuit 214.

[0073] As shown in Fig. 8(A), when the first terminal device 1A and the second terminal device 2A are powered on, the terminal devices are far apart and cannot communicate with each other by the short-distance wireless communication function. In this case, the first terminal device 1A and the second terminal device 2A function independently. The first terminal device 1A and the second terminal device 2A are powered on and approach each other as shown by the dotted arrow in Fig. 8(A), and the first terminal device 1A and the second terminal device 2A are close to each other as shown in Fig. 8(B), and they can communicate with each other wirelessly.

[0074] In this case, as shown in Fig. 8(B), in the first terminal device 1A, the control unit 130 starts (executes) the drawing software. Meanwhile, in the second terminal device 2A, the control unit 230 starts (executes) the panel software. As a result, as shown in Fig. 8(C), in the first terminal device 1A, the entire surface of the display screen 115D of the display device 115 is made into a drawing area by the function of the drawing software, and drawing input can be performed through the drawing area. In the second terminal device 2A, the entire surface of the display screen 215D of the display device 215 is made into an instruction input area by the function of the panel software, and an instruction input acceptance screen is displayed here, so that instruction input from the user can be accepted.

[0075] The instruction input receiving screen displayed on the display screen 215D of the second terminal device 2A and, for example, instruction information corresponding to the instruction input received through the first sensor 211 and the first position detection circuit 212 are transmitted to the first terminal device 1A by the functioning of the instruction information providing circuit 252A. The instruction information from the second terminal device 2A is various parameters related to drawing such as line type and color, and the first terminal device 1A is adapted to obtain the instruction information from the second terminal device 2A and draw in the drawing area accordingly.

[0076] <Processing of the first terminal device 1A and the second terminal device 2A in the second embodiment> Fig. 9 is a flowchart for explaining the processing performed in the first terminal device 1A and the processing performed in the second terminal device 2A in the second embodiment, with Fig. 9(A) showing the processing in the first terminal device 1A and Fig. 9(B) showing the processing in the second terminal device 2A. In the flowcharts of Fig. 9(A) and (B), the same reference numerals are used for the processing performed in the same manner as in the flowcharts of Fig. 6(A) and (B) in the first embodiment, and detailed explanations of those parts are omitted to avoid duplication.

[0077] The first terminal device 1A of the second embodiment executes the process shown in FIG. 9(A) when the power is turned on and no software is being executed. When the first terminal device 1A comes close to the second terminal device 2A through the processes of steps S101 to S103, the first terminal device 1A connects a communication channel through short-range wireless communication. After the communication channel is connected, the first terminal device 1A executes drawing software in the control unit 130, and enables the user to input drawing by using the entire display screen 115D of the display device 115 as a drawing area (step S301). That is, after the process of step S301, the first terminal device 1A transitions to a state in which drawing according to an instruction input by the user is possible.

[0078] Thereafter, the first terminal device 1A receives instruction information from the second terminal device 2A through the short-range wireless communication antenna 141A and the short-range wireless communication circuit 141, which is acquired by the instruction information acquisition circuit 152A and stored in the drawing parameter memory 122 (step S106). This enables drawing to be performed according to an instruction input from the user. The control unit 130 repeats the process from step S106 until a predetermined end event occurs (step S107), and when the end event occurs, performs a predetermined end process (step S108), and ends the process shown in FIG. 9(A).

[0079] On the other hand, in the second terminal device 2A of the second embodiment, when no software is being executed, the process shown in FIG. 9(B) is executed. When the second terminal device 2A comes close to the first terminal device 1A by the processes of steps S201 to S203, the second terminal device 2A connects a communication channel by short-range wireless communication. After the communication channel is connected, the second terminal device 2A executes panel software in the control unit 230, and displays an instruction input acceptance image with the entire surface of the display screen 215D of the display device 215 as an instruction input area, thereby enabling an instruction input by the user (step S401). That is, after the process of step S401, the second terminal device 2A transitions to a state in which it is possible to accept instruction information according to an instruction input by the user. This allows the second terminal device 2A to accept an instruction input from the user.

[0080] Assume that the second terminal device 2A receives an instruction input from the user. In this case, the instruction information providing circuit 252A forms instruction information according to the received instruction input and transmits the instruction information to the first terminal device 1A through the short-range wireless communication circuit 241 and the short-range wireless communication antenna 241A (step S205). As a result, as described above, the first terminal device 1A is enabled to perform drawing according to the instruction input from the user. The control unit 230 repeats the process from step S205 until a predetermined end event occurs (step S206), and when the end event occurs, performs a predetermined end process (step S207), and ends the process shown in FIG. 9(B).

[0081] Thus, in the case of the drawing system of the second embodiment, the first terminal device 1A has drawing software, and the second terminal device 2A has panel software. By executing the drawing software, the first terminal device 1A can accept drawing input with the entire screen of the display screen 115D of the display device 115 as a drawing area. On the other hand, the second terminal device 2A can execute the panel software to use the entire screen of the display screen 215D of the display device 215 as an instruction input area, display an instruction input acceptance screen to accept instruction input, and provide the first terminal device 1A with instruction information corresponding thereto. Therefore, the first terminal device 1A can perform drawing according to instruction information from the user using the entire surface of the display screen 115D.

[0082] [Third embodiment] <Example of configuration of first terminal device 1B and second terminal device 2B> The drawing system of the third embodiment is also configured with two terminal devices, a first terminal device and a second terminal device, similar to the drawing system of the first embodiment described with reference to Fig. 1. Specifically, it is configured with a first terminal device 1B realized as a tablet PC or the like, and a second terminal device 2B realized as a smartphone or a small tablet PC or the like. And, like the drawing systems of the first and second embodiments described above, the first terminal device 1B and the second terminal device 2B of the third embodiment are both flat (thin) devices having the basic structure described with reference to Fig. 2.

[0083] Fig. 10 is a block diagram for explaining a configuration example of the first terminal device 1B and the second terminal device 2B of the third embodiment. As can be seen by comparing Fig. 10 with Fig. 7, the first terminal device 1B of the third embodiment is configured almost the same as the first terminal device 1A of the second embodiment, and the second terminal device 2B of the third embodiment is configured almost the same as the second terminal device 2A of the second embodiment. However, the software executed in the first terminal device 1B and the second terminal device 2B and the execution mode thereof are different from those of the first terminal device 1A and the second terminal device 2A of the second embodiment.

[0084] In the first terminal device 1B shown in the upper part of Fig. 10, the same reference numerals are used for the parts configured similarly to the first terminal device 1 of the first embodiment described with reference to Fig. 3, and detailed descriptions of those parts are omitted. In the second terminal device 2B shown in the lower part of Fig. 10, the same reference numerals are used for the parts configured similarly to the second terminal device 2 of the first embodiment described with reference to Fig. 4, and detailed descriptions of those parts are omitted.

[0085] The control unit 130 of the first terminal device 1B of the third embodiment functions as a drawing software execution unit. The drawing software executed by the control unit 130 has both a drawing function and an instruction input reception function. The drawing function is a function for providing a drawing area on the display screen 115D of the display device 115 and performing drawing. The instruction input reception function is a function for providing an instruction input area on the display screen 115D of the display device 115 and displaying an instruction input reception screen to receive input of instruction information.

[0086] In addition, the drawing software of this embodiment can be set to a priority order when the first terminal device 1B and the second terminal device 2B cooperate with each other. This priority order is determined so that the drawing function is the first priority, and the instruction input reception function is the second priority. Information indicating the first priority as the priority order for the drawing software is set (stored) in the storage device 132 of the control unit 130 of the first terminal device 1B, and the drawing function is set to be executed in the first terminal device 1B when cooperating with the second terminal device 2B.

[0087] As a result, if the second terminal device 2B is not nearby, the first terminal device 1B functions alone, and the drawing software is started up. In this case, since the first terminal device 1B functions alone, the priority of the drawing software does not matter, and as shown in Fig. 1, both the drawing area R1 and the instruction input area R2 are provided on the display screen 115D of the display device 115, so that both drawing input and instruction input can be received.

[0088] However, when the second terminal device 2B is nearby, a communication path is connected by short-range wireless communication, and the first terminal device 1B and the second terminal device 2B function in cooperation with each other, the priority of the drawing software is taken into consideration. In this case, as described above, the priority of the drawing software of the first terminal device 1B is the first, so the drawing software is executed so that only the drawing function functions. In this case, the instruction input receiving function does not work in the first terminal device 1B.

[0089] On the other hand, the control unit 230 of the second terminal device 2B of the third embodiment functions as a drawing software execution unit. The drawing software executed by the control unit 230 is similar to the drawing software executed by the control unit 130 of the first terminal device 1B, and has both a drawing function and an instruction input reception function, and the drawing software can be prioritized. Then, information indicating the second priority for the drawing software is set (stored) in the storage device 232 of the control unit 230 of the second terminal device 2B, and when cooperating with the first terminal device 1B, the second terminal device 2B is set to execute the instruction input reception function.

[0090] As a result, suppose that the first terminal device 1B is not nearby, the second terminal device 2B functions alone, and the drawing software is started. In this case, since it functions alone, the priority of the drawing software does not matter, and both the drawing area R1 and the instruction input area R2 are provided on the display screen 215D of the display device 215 so that both drawing input and instruction input can be received. In this case, although the display screen 215D itself is small, drawing processing can be performed in the same way as when the first terminal device 1B functions alone.

[0091] However, when the first terminal device 1B is nearby, a communication path is connected by short-range wireless communication, and the second terminal device 2B and the first terminal device 1B function in cooperation with each other, the priority of the drawing software is taken into consideration. In this case, as described above, the priority of the drawing software of the second terminal device 2B is second, so the drawing software is executed with the instruction input reception function functioning.

[0092] Thus, in the drawing system of the third embodiment, the first terminal device 1B and the second terminal device 2B are each equipped with drawing software having both a drawing function and an instruction input reception function, and are made executable. The drawing software installed in the first terminal device 1B and the second terminal device 2B may be the same drawing software if it is executable. However, in general, drawing software having the same functions and compatible with the operating system functioning in each terminal device is installed.

[0093] For example, suppose that the operating system functioning in the first terminal device 1B is Windows (registered trademark), and the operating system functioning in the second terminal device 2B is Android (registered trademark). In this case, drawing software having similar functions is installed in the first terminal device 1B for Windows (registered trademark), and in the second terminal device 2B for Android (registered trademark). Even if the first terminal device 1B and the second terminal device 2B have the same operating system, drawing software having both a drawing function and an instruction input reception function may be created according to the characteristics of each terminal device and installed in each terminal device.

[0094] <Outline of Operation of Drawing System of Third Embodiment> FIG. 11 is a diagram for explaining an outline of the operation of the first terminal device 1B and the second terminal device 2B constituting the drawing system of the third embodiment. As shown in FIG. 11(A), the first terminal device 1B is equipped with drawing software. As described above, the drawing software has a drawing function and an instruction input reception function. Similarly to the first terminal device 1B, the second terminal device 2B is also equipped with drawing software having a drawing function and an instruction input reception function.

[0095] In the first terminal device 1B and the second terminal device 2B, a priority order is set for the installed drawing software. In the case where the first terminal device 1B and the second terminal device 2B cooperate to perform drawing, the priority order for the drawing software is such that the terminal that executes the drawing function is first, and the terminal that executes the instruction input reception function is second. In this third embodiment, the priority order for the drawing software of the first terminal device 1B is first, and the priority order for the drawing software of the second terminal device 2B is second.

[0096] As shown in Fig. 11(A), assume that the first terminal device 1B and the second terminal device 2B are both powered on, but are too far apart to communicate with each other using the short-range wireless communication function. In this case, the first terminal device 1 and the second terminal device 2 function independently. Therefore, if the drawing software is executed on each of them in this state, a drawing area and an instruction input area can be provided in each of the first terminal device 1B and the second terminal device 2B, and drawing processing can be performed as in the conventional case.

[0097] Assume that the first terminal device 1B and the second terminal device 2B in a powered-on state are brought close to each other as indicated by the dotted arrow in Fig. 11(A). Then, as shown in Fig. 11(B), the first terminal device 1B and the second terminal device 2B are brought close to each other and are capable of short-distance wireless communication with each other.

[0098] In this case, as shown in Fig. 11(B), in the first terminal device 1B, the priority of the drawing software is set to the first place, so the drawing software is started (executed) so as to execute only the drawing function, whereas in the second terminal device 2B, the priority of the drawing software is set to the second place, so the drawing software is started (executed) so as to execute only the instruction input reception function.

[0099] 11(C), in the first terminal device 1B, the entire surface of the display screen 115D of the display device 115 is made into a drawing area by the drawing function of the drawing software, and drawing input can be performed through the drawing area. In the second terminal device 2B, the entire surface of the display screen 215D of the display device 215 is made into an instruction input area by the instruction input acceptance function of the drawing software, and an instruction input acceptance screen is displayed here, allowing instruction input from the user to be accepted.

[0100] The instruction input receiving screen displayed on the display screen 215D of the second terminal device 2B and instruction information corresponding to the instruction input received, for example, through the first sensor 211 and the first position detection circuit 212 are transmitted to the first terminal device 1B by the instruction information providing circuit 252A. The instruction information from the second terminal device 2B is various parameters related to drawing such as line type and color, and the first terminal device 1B is adapted to obtain the instruction information from the second terminal device 2A and draw in the drawing area accordingly.

[0101] <Processing of the first terminal device 1B and the second terminal device 2B in the third embodiment> Fig. 12 is a flowchart for explaining the processing performed in the first terminal device 1B and the processing performed in the second terminal device 2B in the third embodiment, with Fig. 12(A) showing the processing in the first terminal device 1B and Fig. 12(B) showing the processing in the second terminal device 2B. In the flowcharts of Fig. 12(A) and (B), the same reference numerals are used for the processing performed in the same manner as in the flowcharts of Fig. 6(A) and (B) in the first embodiment, and detailed explanations of those parts are omitted to avoid duplication.

[0102] When the first terminal device 1B is powered on and no software is being executed, the first terminal device 1B executes the process shown in FIG. 12(A). When the first terminal device 1B comes close to the second terminal device 2B through the processes of steps S101 to S103, the first terminal device 1B connects a communication channel through short-range wireless communication. After the communication channel is connected, the first terminal device 1B has the highest priority for the drawing software, so that the control unit 130 executes only the drawing function, thereby starting (executing) the drawing software (step S501). As a result, after the process of step S501, the first terminal device 1B transitions to a state in which drawing is possible according to a user's instruction input, and the entire display screen 115D of the display device 115 becomes a drawing area, allowing the user to input drawing.

[0103] Thereafter, the first terminal device 1B receives instruction information from the second terminal device 2B through the short-range wireless communication antenna 141A and the short-range wireless communication circuit 141, which is acquired by the instruction information acquisition circuit 152A and stored in the drawing parameter memory 122 (step S106). This enables drawing to be performed according to the instruction input from the user. The control unit 130 repeats the process from step S106 until a predetermined end event occurs (step S107), and when the end event occurs, performs a predetermined end process (step S108), and ends the process shown in FIG. 11(A).

[0104] On the other hand, in the second terminal device 2B, when the power is turned on and no software is being executed, the process shown in FIG. 12(B) is executed. When the second terminal device 2B comes close to the first terminal device 1B by the processes of steps S201 to S203, the second terminal device 2B connects a communication channel by short-range wireless communication. After the communication channel is connected, the second terminal device 2B has the second highest priority for the drawing software, so that the control unit 230 starts (executes) the drawing software by executing only the instruction input reception function (step S601). That is, after the process of step S601, the second terminal device 2B transitions to a state in which it is possible to receive instruction information according to an instruction input by the user. As a result, in the second terminal device 2B, the entire display screen 215D of the display device 215 is used as an instruction input area, and an instruction input reception image is displayed, enabling an instruction input by the user.

[0105] Assume that the second terminal device 2B receives an instruction input from the user. In this case, the instruction information providing circuit 252A forms instruction information according to the received instruction input and transmits the instruction information to the first terminal device 1B through the short-range wireless communication circuit 241 and the short-range wireless communication antenna 241A (step S205). As a result, as described above, the first terminal device 1B can perform drawing according to the instruction input from the user. The control unit 230 repeats the process from step S205 until a predetermined end event occurs (step S206), and when the end event occurs, performs a predetermined end process (step S207), and ends the process shown in FIG. 12(B).

[0106] In this way, in the drawing system of the third embodiment, when the first terminal device 1B and the second terminal device 2B are not close to each other and each device starts the drawing software by itself, a drawing area and an instruction input reception area are provided on the display screen of the device, and drawing processing can be performed as in the past. However, when the first terminal device 1B and the second terminal device 2B are close to each other, the drawing software is executed in each device, but the drawing function is executed in the first terminal device 1B, and the instruction input reception function is executed in the second terminal device 2B. In this case, drawing can be performed through the entire display screen 115D of the display device 115 of the first terminal device 1B. Also, instruction input can be performed through the entire display screen 215D of the display device 215 of the second terminal device 2B, and instruction information corresponding to the received instruction input can be provided to the first terminal device 1B.

[0107] [Attachment of the second terminal device 2, 2A, 2B to the user] The drawing systems of the first to third embodiments described above are each composed of two terminal devices, a first terminal device (1, 1A, 1B) and a second terminal device (2, 2A, 2B). Therefore, when using the drawing system on a desk, both terminal devices can be operated on the desk, so there is no problem in operation. However, when sketching outdoors, for example, it is necessary to hold both the first terminal device and the second terminal device in one's hands, and there is a possibility that the user will not be able to draw freely using the drawing system.

[0108] Therefore, the first terminal device (1, 1A, 1B) in which the drawing area is provided is held by hand, and the second terminal device (2, 2A, 2B) is attached to the arm holding the first terminal device (1, 1A, 1B), thereby freeing the other hand. This allows the other hand to hold an electronic pen and operate both the first terminal device and the second terminal device, allowing free drawing. FIG. 13 is a diagram for explaining an example of attaching the second terminal device (2, 2A, 2B) to the body of the user. Here, an example will be explained in which the first terminal device 1 and the second terminal device 2 of the first embodiment are used.

[0109] 13(A) and (B), the wristband 21 and the fingerband 22 are attached to the surface (back side) of the second terminal device 2 opposite to the display screen 215D. Various methods can be used for attaching the wristband 21, but for example, the wristband 21 is prevented from coming off easily by fitting locking members provided at both ends of the wristband 21 into grooves for the wristband provided on the back side of the second terminal device 2. Also, the fingerband 22 is prevented from coming off easily by fitting locking members provided thereon into grooves for the fingerband provided on the back side of the second terminal device 2.

[0110] 13(A) and 13(B), a user can wear the second terminal device 2 on the user's arm by putting the wristband 21 on his / her arm and the fingerband 22 on, for example, his / her thumb. The user can slightly shift the position of the second terminal device 2 worn on the user's arm or adjust the direction (tilt) of the display screen 215D by moving the arm on which the second terminal device 2 is worn from side to side or by moving the wrist of the arm on which the second terminal device 2 is worn.

[0111] 13(C), by holding the first terminal device 1 in the hand on which the second terminal device 2 is attached, the user can hold (hold) both the first terminal device 1 and the second terminal device 2 in that hand (including the arm). This allows the other hand to hold only the electronic pen, so that the user can operate both the first terminal device 1 and the second terminal device 2 with the electronic pen even outdoors and freely perform drawing input to the first terminal device 1 according to his or her intention.

[0112] In the example shown in FIG. 13(C), the second terminal device 2 is attached to the left arm of the user, and the first terminal device 1 is held in the left hand. Therefore, the user can hold the electronic pen in the right hand and freely input drawings. Of course, it is also possible to attach the second terminal device 2 to the right arm, hold the first terminal device 1 in the right hand, and hold the electronic pen in the left hand to operate both the first terminal device 1 and the second terminal device 2. The drawing systems of the second and third embodiments can also be used in the manner described with reference to FIG. 13.

[0113] [Authentication using electronic pen] In the above-mentioned first, second and third embodiments, the first terminal device (1, 1A, 1B) and the second terminal device (2, 2A, 2B) are arranged to operate as a drawing system when they are in close proximity to each other and a communication path is established by short-range wireless communication. However, there may be cases where a user has multiple terminal devices or where other people's terminal devices are present in the vicinity. In such cases, there is a slight possibility that the first terminal device and the second terminal device, which should be paired, will not be paired, and the drawing system will not be able to operate as it should.

[0114] Therefore, the electronic pen that the user uses in common on the first terminal device (1, 1A, 1B) and the second terminal device (2, 2A, 2B) is used to authenticate the terminals to which a communication path via short-range wireless communication is to be connected. Simply put, the terminal device that accepts an instruction input from the electronic pen issues a connection request via short-range wireless communication. Then, when a connection request is received from another terminal and a connection request has also been issued from the terminal itself, a communication path is connected between the sender of the connection request and the terminal itself, thereby enabling pairing of the first terminal device and the second terminal device that constitute the drawing system.

[0115] However, when there are three or more terminal devices capable of inputting instructions using an electronic pen, the above-mentioned method may not be able to perform appropriate pairing. Therefore, electronic pen identification information (electronic pen ID) unique to the electronic pen is included in a position instruction signal transmitted from an electronic pen used by a user of the drawing system. The first terminal device 1 and the second terminal device 2 that receive a position instruction signal including the electronic pen ID from the electronic pen extract the electronic pen ID included in the position instruction signal from the electronic pen and hold it. Furthermore, the first terminal device 1 and the second terminal device 2 form a connection request including the held electronic pen ID and transmit it by short-distance wireless communication.

[0116] Then, the first terminal device 1 and the second terminal device 2 connect a communication path to the terminal device that has transmitted a connection request including the same electronic pen ID as the electronic pen ID held by the first terminal device 1 and the second terminal device 2. This allows a communication path to be connected between the first terminal device 1 and the second terminal device 2 that form a pair to configure a drawing system, and allows the drawing system to be configured and functioned appropriately.

[0117] Fig. 14 is a block diagram for explaining a configuration example of a drawing system that performs authentication processing using an electronic pen ID. In Fig. 14, an electronic pen authentication unit 170 provided in a first terminal device 1C and an electronic pen authentication unit 270 provided in a second terminal device 2C are main parts that realize an electronic pen authentication function. The parts of the first terminal device 1C other than the electronic pen authentication unit 170 are configured similarly to the first terminal device 1 of the first embodiment. Similarly, the parts of the second terminal device 2C other than the electronic pen authentication unit 270 are configured similarly to the second terminal device 2 of the first embodiment.

[0118] That is, in the first terminal device 1C, the user interface unit 110 functions to receive a position indication signal from the electronic pen, extract an electronic pen ID from the position indication signal, and supply it to the electronic pen authentication unit 170. The electronic pen authentication unit 170 holds the electronic pen ID from the user interface unit 110, and cooperates with the connection unit 140 under the control of the control unit 130 to form a connection request including the electronic pen ID and transmits it by short-distance wireless communication. Furthermore, the electronic pen authentication unit 170 receives a connection request that includes the electronic pen ID through the connection unit 140 and transmits it by short-distance wireless communication. Therefore, when the electronic pen ID is the same as the electronic pen ID held in the electronic pen authentication unit 170, it controls the connection unit 140 to connect a communication path to the source of the connection request.

[0119] Similarly, in the second terminal device 2C, the user interface unit 210 functions to receive a position indication signal from the electronic pen, extract an electronic pen ID from the position indication signal, and supply the electronic pen ID to the electronic pen authentication unit 270. The electronic pen authentication unit 270 holds the electronic pen ID from the user interface unit 210, and cooperates with the connection unit 240 under the control of the control unit 230 to form a connection request including the electronic pen ID and transmits the connection request by short-distance wireless communication. Furthermore, the electronic pen authentication unit 270 includes the electronic pen ID in the connection request received through the connection unit 240. Therefore, when the electronic pen ID is the same as the electronic pen ID held in the electronic pen authentication unit 270, the electronic pen authentication unit 270 controls the connection unit 240 to connect a communication path to the source of the connection request.

[0120] As a result, a communication path is connected between the first terminal device 1C and the second terminal device 2C, and a drawing system consisting of the first terminal device 1 and the second terminal device 2 is appropriately configured. In this case, even if any other terminal device exists between the first terminal device 1C and the second terminal device 2C, the first terminal device 1C and the second terminal device 2C do not connect a communication path to the other terminal device. As a result, the drawing system can be appropriately configured at all times. As described above, the same authentication process can be performed in both the drawing system of the second embodiment and the drawing system of the third embodiment.

[0121] [Effects of the embodiment] As can be seen from the above description of the embodiment, in the first terminal device (1, 1A, 1B, 1C), the entire display screen of the display device 115 can be used as a drawing area to accept drawing input. In addition, in the second terminal device (2, 2A, 2B, 2C), the entire display screen of the display device 215 can be used as an instruction input area, and an instruction input acceptance screen can be displayed therein to accept instruction input from the user. Then, in the second terminal device (2, 2A, 2B, 2C), instruction information can be provided to the first terminal device (1, 1A, 1B, 1C) in response to the accepted instruction input. This allows the first terminal device (1, 1A, 1B, 1C) to perform drawing in response to the instruction input from the user.

[0122] In this way, in the case of the drawing system of the above-mentioned embodiment, a large drawing area can be secured on the display screen of the first terminal device (1, 1A, 1B, 1C). Also, an instruction input area can be provided on the display screen of the second terminal device (2, 2A, 2B, 2C), and instruction input to this instruction input area can be accepted at an appropriate time and provided to the first terminal device (1, 1A, 1B, 1C), so that drawing can be performed according to the user's instruction.

[0123] [Variations] In addition, since the first sensor 111 of the first terminal device (1, 1A, 1B, 1C) and the first sensor 211 of the second terminal device (2, 2A, 2B, 2C) in the above-mentioned embodiment are both of the electromagnetic induction type, drawing input and instruction input can be performed using the same electronic pen. In addition, since the second sensor 113 of the first terminal device (1, 1A, 1B, 1C) and the second sensor 213 of the second terminal device (2, 2A, 2B, 2C) in the above-mentioned embodiment are both of the electrostatic capacitance type, input by the user's finger or electrostatic pen is also possible. Therefore, drawing input to the first terminal device (1, 1A, 1B, 1C) can be performed using the electronic pen, and instruction input to the second terminal device (2, 2A, 2B, 2C) can be performed using the user's finger.

[0124] Furthermore, the first terminal device and the second terminal device constituting the drawing system do not need to have both an electromagnetic induction sensor and a capacitance sensor. The first terminal device and the second terminal device may have either an electromagnetic induction sensor or a capacitance sensor. And, since the first terminal device realizes the drawing function, it is sufficient that it has a sensor that can input drawing by an electronic pen or an electrostatic pen.

[0125] There are four possible combinations of sensors: (1) A case where both the first terminal device and the second terminal device are equipped with an electromagnetic induction type sensor. (2) A case where both the first terminal device and the second terminal device are equipped with a capacitance type sensor. (3) A case where the first terminal device is equipped with an electromagnetic induction type sensor, and the second terminal device is equipped with a capacitance type sensor. (4) A case where the first terminal device is equipped with a capacitance type sensor, and the second terminal device is equipped with an electromagnetic induction type sensor.

[0126] In the above-described embodiment, the first terminal device (1, 1A, 1B, 1C) and the second terminal device (2, 2A, 2B, 2C) are connected by short-distance wireless communication, but this is not limiting. The two terminal devices can also be connected by wire. In this case, when a wired connection with another terminal device is confirmed, a communication path between the two terminal devices can be connected by wire.

[0127] In the above-described embodiment, when the first terminal device (1, 1A, 1B, 1C) and the second terminal device (2, 2A, 2B, 2C) are in close proximity to each other, a communication path is connected and drawing software or panel software is automatically started (executed), but this is not limited to the above. Assume that the first terminal device (1, 1A, 1B, 1C) and the second terminal device (2, 2A, 2B, 2C) are in close proximity to each other and a communication path is connected. In this case, for example, when an operation input for performing drawing is received in one or both of the first terminal device (1, 1A, 1B, 1C) and the second terminal device (2, 2A, 2B, 2C), the drawing software or panel software may be started (executed).

[0128] The second terminal device (2, 2A, 2B, 2C) has been described as having a configuration of a smartphone or a tablet PC, but is not limited to this. For example, it may be a wristwatch-type terminal device called a smart watch, or may be various wearable terminals (terminals worn on the user's body) that can input instructions.

[0129] In addition, the number of command input reception screens used in the second terminal devices (2, 2A, 2B, 2C) is not limited to one, and it is possible to prepare multiple command input reception screens each having different information to be received, and switch between them according to the user's command. This control can be performed by the control circuit 231.

[0130] Also, the operation buttons provided on the second terminal device (2, 2A, 2B, 2C) can be used like the left click button or right click button of a mouse, which is a pointing device of a personal computer. That is, when a predetermined operation button provided on the second terminal device (2, 2A, 2B, 2C) is pressed, it is possible to select, move, or execute something on the display screen 115D of the display device 115 of the first terminal device (1, 1A, 1B, 1C). Also, when another predetermined operation button provided on the second terminal device (2, 2A, 2B, 2C) is pressed, it is possible to display a menu of functions that can be executed at that time on the first terminal device (1, 1A, 1B, 1C) and make them selectable.

[0131] Also, it is assumed that the electronic pen is equipped with a side switch, and operation information of the side switch can be transmitted by short-distance wireless communication. In this case, the side switch of the electronic pen can be used to operate, for example, the first terminal device (1, 1A, 1B, 1C) like a left click button or a right click button of a mouse, which is a pointing device of a personal computer. Of course, information according to the operation of the side switch of the electronic pen can also be used to operate the second terminal device (2, 2A, 2B, 2C). For this reason, it is sufficient for the user to set, for example, in each terminal device, whether the first terminal device (1, 1A, 1B, 1C) or the second terminal device (2, 2A, 2B, 2C) is to be operated according to the operation of the side switch of the electronic pen.

[0132] Furthermore, the size of the display screen of the display device of the first terminal device (1, 1A, 1B, 1C) and the second terminal device (2, 2A, 2B, 2C) is not limited to the embodiment shown in FIG. 1. The first terminal device (1, 1A, 1B, 1C) and the second terminal device (2, 2A, 2B, 2C) may have display devices of the same size. Furthermore, the display screen of the display device of the second terminal device (2, 2A, 2B, 2C) may be larger than the display screen of the display device of the first terminal device (1, 1A, 1B, 1C). [Explanation of symbols]

[0133] 1, 1A, 1B, 1C...first terminal device, 110...user interface unit, 111...first sensor, 112...first position detection circuit, 113...second sensor, 114...second position detection circuit, 115...display device, 115D...display screen, 116...display control circuit, 120...drawing processing unit, 121...drawing image memory, 122...drawing parameter memory, 123...drawing processing circuit, 130...control unit, 131...control circuit, 132...storage device, 140...connection unit, 141...near-field wireless communication circuit, 141A...near-field wireless communication antenna, 142...proximity determination circuit, 150...panel linkage unit, 151...panel data providing circuit, 152, 152A...instruction information acquisition circuit, 170...electronic pen authentication unit, 2, 2A, 2B, 2C...second terminal device, 210...user interface unit, 211...first sensor, 212...first position detection circuit, 213...second sensor, 214...second position detection circuit, 215...display device, 215D...display screen, 216...display control circuit, 220...drawing processing unit, 221...drawing image memory, 222...drawing parameter memory, 223...drawing processing circuit, 230...control unit, 231...control circuit, 232...storage device, 240...connection unit, 241...short-range wireless communication circuit, 241A...short-range wireless communication antenna, 242...proximity determination circuit, 250...panel linkage unit, 251...panel data acquisition circuit, 252, 252A...instruction information providing circuit, 270...electronic pen authentication unit, 21...wristband, 22...holder

Claims

1. A drawing system in which a first terminal device including a first display device and a first position detection sensor corresponding to a display screen of the first display device, and a second terminal device including a second display device and a second position detection sensor corresponding to a display screen of the second display device are communicatively connected, The first terminal device is an information acquisition unit that acquires information transmitted from the second terminal device; a drawing processing unit that sets the display screen of the first display device as a drawing area and performs drawing on the drawing area with an electronic pen in response to a drawing operation input received through the first position detection sensor; Equipped with The second terminal device is a switching control means for switching an instruction input screen to be displayed on the display screen of the second display device from among the plurality of instruction input acceptance screens stored in a predetermined storage unit, the instruction input acceptance screen having different information to be accepted, in response to an instruction from a user; an instruction input reception processing unit that sets the display screen of the second display device as an instruction input area and receives an instruction input by an electronic pen through the instruction input reception screen displayed on the display screen and the second position detection sensor; an information providing unit that transmits information input through the instruction input reception processing unit to the first terminal device; Equipped with the first position detection sensor of the first terminal device and the second position detection sensor of the second terminal device can be operated by a same electronic pen; The second terminal device is a second receiving means for receiving identification information of the electronic pen as second identification information; a second identification information providing means for transmitting the second identification information to the first terminal device; Equipped with The first terminal device is a first receiving means for receiving identification information of the electronic pen as first identification information; a second identification information receiving means for receiving the second identification information from the second identification information providing means; a first authentication control means for connecting a communication path to the second terminal device when the first identification information and the second identification information are the same; A drawing system comprising:

2. The drawing system according to claim 1 , The first terminal device is a screen information providing unit that, when a communication path is connected to the second terminal device, transmits to the second terminal device screen information required for receiving and transmitting the instruction information, the screen information including information for forming the plurality of instruction input receiving screens having different information to be received; The second terminal device is a screen information acquisition unit that acquires the screen information transmitted from the first terminal device and records the screen information in the predetermined storage unit; A drawing system comprising:

3. The drawing system according to claim 1 , A drawing system, wherein the second position detection sensor of the second terminal device can be touched by a user's finger or the like.

4. The drawing system according to claim 1 , The first terminal device is a first communication unit that transmits and receives signals wirelessly or via a wire; a connection determination unit that performs connection determination based on a result of communication through the first communication unit; Equipped with The second terminal device is a second communication unit that transmits and receives signals wirelessly or via a wire; a connection determination unit that performs connection determination based on a result of communication through the second communication unit; A drawing system comprising:

5. The drawing system according to claim 4, The first terminal device is a first operation unit for starting communication through the first communication unit; A drawing system characterized in that, when the first operation unit is operated, the first communication unit starts a communication process to connect a communication path between the first communication unit and the second communication unit of the second terminal device.

6. The drawing system according to claim 4, The second terminal device is a second operation unit for starting communication through the second communication unit; A drawing system characterized in that, when the second operation unit is operated, the second communication unit starts a communication process to connect a communication path between the second communication unit and the first communication unit of the first terminal device.

7. The drawing system according to claim 1 , A drawing system, wherein the second terminal device is provided with an attachment for attachment to a user's body.

Images