Drawing system

The drawing system addresses the challenge of small display screens in tablet PCs by using two devices connected via wireless communication to separate drawing and instruction input areas, ensuring a large drawing area and flexible input capabilities.

JP2025137716APending Publication Date: 2025-09-19WACOM CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2025122954
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2019-02-01
Filing Date
2025-07-23
Publication Date
2025-09-19

Smart Images

  • Figure 2025137716000001_ABST
    Figure 2025137716000001_ABST
Patent Text Reader

Abstract

To provide a drawing system for making it possible to secure a large drawing area and to receive an instruction input for an instruction input area at a proper timing to carry out drawing in response to the input.SOLUTION: According to the present invention, a first terminal device 1 and a second terminal device 2 are connected to each other so as to communicate with each other, with a display screen 115D of a display device of the first terminal device 1 being set as a drawing dedicated area and a display screen 215D of a display device of the second terminal device 2 being set as an instruction input dedicated area. The first terminal device 1 is operated in response to instruction information from the second terminal device 2, and carries out drawing in the drawing area provided on the display screen 115D of the first display device in response to a drawing operation input received through a first position detection sensor.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a drawing system configured with a terminal device that has, for example, a display device and a position detection sensor and that allows drawing input using an electronic pen. [Background technology]

[0002] For example, tablet PCs (Personal Computers) that are equipped with a display device such as an LCD (Liquid Crystal Display) and a position detection sensor and that allow drawing input using an electronic pen are widely used. When drawing input is performed on a tablet PC, so-called drawing software is executed. The drawing software provides a drawing area and an instruction input area on the display screen and accepts instruction input from the user.

[0003] The drawing area is an area that accepts drawing input from an electronic pen and displays the corresponding drawn image. The instruction input area is an area that displays an instruction input acceptance screen and accepts various instruction inputs (parameter inputs) related to drawing, such as the line type, color, hue, vividness, brightness, and degree of gradation used in the drawing. The instruction input area is also sometimes called a palette area because it is used to select colors, etc.

[0004] Furthermore, since the drawing area and the instruction input area are provided within a single display screen, if the electronic pen accidentally enters the instruction input area while drawing in the drawing area, unintended instruction input may be performed. To address this problem, Patent Document 1, described below, discloses an invention relating to a coordinate input control method that invalidates instruction input to the instruction input area when the electronic pen enters the instruction input area continuously from the drawing area. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2005-11233 Summary of the Invention [Problem to be solved by the invention]

[0006] Even in tablet PCs with a display device having a relatively large display screen, if both a drawing area and an instruction input area are provided on the display screen of the device, the drawing area will inevitably be small. In recent years, with the improvement in computer performance, it is becoming common to run drawing software on small tablet PCs equipped with small display devices with display screens of approximately 8 to 11 inches to perform detailed drawing.

[0007] In this case, the drawing area becomes very small. If the drawing area is small, when drawing a detailed image, the drawn image will have to be repeatedly enlarged and reduced, which can severely reduce work efficiency. For this reason, there is a demand to make the drawing area as large as possible. At the same time, it is also necessary to be able to input instructions into the instruction input area at the appropriate time. If changes such as line type and color cannot be made at the appropriate time, it will be impossible to draw flexibly according to the user's intentions.

[0008] In view of the above, an object of the present invention is to provide a drawing system that can secure a large drawing area, accept instruction inputs to an instruction input area at appropriate timing, and perform drawing in accordance with the instruction inputs. [Means for solving the problem]

[0009] In order to solve the above problems, A drawing system configured by a first terminal device having a first display device, and a second terminal device having a second display device and a second position detection sensor corresponding to a display screen of the second display device, which are communicatively connected, The first terminal device an information acquisition unit that acquires instruction information transmitted from the second terminal device; a drawing processing unit that uses the display screen of the first display device as a drawing area and performs drawing in the drawing area in accordance with the instruction information; Equipped with The second terminal device an instruction input reception processing unit that uses the display screen of the second display device as an instruction input area and receives an instruction input by an electronic pen through the second position detection sensor; an information providing unit that transmits information input through the instruction input reception processing unit to the first terminal device; The present invention provides a drawing system comprising: [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a diagram illustrating an example of the appearance of a drawing system according to an embodiment; [Figure 2] FIG. 2 is an exploded configuration diagram for explaining the basic structure of the first and second terminal devices according to the embodiment. [Figure 3] FIG. 2 is a block diagram illustrating a configuration example of a first terminal device according to the first embodiment. [Figure 4] FIG. 4 is a block diagram illustrating a configuration example of a second terminal device according to the first embodiment. [Figure 5] FIG. 2 is a diagram for explaining an outline of operations of a first terminal device and a second terminal device according to the first embodiment. [Figure 6] 5 is a flowchart for explaining a process performed in a first terminal device and a process performed in a second terminal device according to the first embodiment. [Figure 7] FIG. 10 is a block diagram illustrating an example of the configuration of a first terminal device and an example of the configuration of a second terminal device according to the second embodiment. [Figure 8] FIG. 10 is a diagram for explaining an outline of operations of a first terminal device and a second terminal device according to the second embodiment. [Figure 9] 10 is a flowchart illustrating a process performed in a first terminal device and a process performed in a second terminal device according to a second embodiment. [Figure 10] FIG. 10 is a block diagram illustrating an example of the configuration of a first terminal device and an example of the configuration of a second terminal device according to a third embodiment. [Figure 11] FIG. 10 is a diagram for explaining an outline of operations of a first terminal device and a second terminal device according to the third embodiment. [Figure 12] 10 is a flowchart illustrating the operations of a process performed in a first terminal device and a process performed in a second terminal device according to the third embodiment. [Figure 13] 10 is a diagram for explaining an example of how the second terminal device is attached to the body of a user. FIG. [Figure 14] 1 is a block diagram illustrating an example of the configuration of a drawing system that performs authentication processing using electronic pen identification information. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments of the drawing system of the present invention will be described with reference to the drawings. Three embodiments will be described below, but first, the appearance of the drawing system common to the drawing systems of the three embodiments and the basic structure of the terminal device that constitutes the drawing system will be described.

[0012] [Drawing system appearance] Fig. 1 is a diagram illustrating an example of the appearance of a drawing system according to an embodiment. As shown in Fig. 1, the drawing system is composed of a first terminal device 1 and a second terminal device 2. The first terminal device 1 is realized as a tablet PC or the like, which includes a thin display device with a display screen size of, for example, about 8 to 12 inches, and a position detection sensor that corresponds to the display screen and detects a position pointed to by a pointer such as an electronic pen.

[0013] The second terminal device 2 is equipped with a thin display device with a display screen size of, for example, about 4 to 6 inches, and a position detection sensor that corresponds to the display screen and detects a position indicated by a pointer such as an electronic pen. Specifically, the second terminal device 2 is realized as a highly functional mobile phone terminal such as a smartphone, or a tablet PC that is smaller than the first terminal device 1.

[0014] The first terminal device 1 and the second terminal device 2 can connect a communication path by a short-range wireless communication function and communicate with each other. There are various standards for short-range wireless communication functions, and the drawing system can also use short-range wireless communication functions of various standards. However, for simplicity of explanation, the following description will be given assuming that the short-range wireless communication function of the widely used Bluetooth (registered trademark) standard is used between the first terminal device 1 and the second terminal device 2.

[0015] The first terminal device 1 is equipped with drawing software (hereinafter referred to as drawing software), and by executing this software, a drawing area R1 and an instruction input area R2 are provided on the display screen 115D as shown in Fig. 1, and input from the user can be received. The drawing area R1 is an area that receives drawing input from an electronic pen and displays a drawing image in response to the input. The instruction input area is an area that displays an instruction input reception screen and receives various instruction inputs (parameter inputs) related to drawing, such as selection of line type and color.

[0016] The first terminal device 1 can accept operation input from a user to the drawing area R1 and the instruction input area R2, and can draw an image in the drawing area R1 according to the user's instructions. In other words, in this specification, the drawing software is a two-dimensional computer graphics application that draws an image on a computer using a pointing device (mainly an electronic pen).

[0017] However, the size of the display screen 115D of the first terminal device 1 is small, ranging from 8 inches to 12 inches. Therefore, as shown in FIG. 1, providing the instruction input area R2 reduces the size of the drawing area R1, which reduces work efficiency when creating a drawing. In recent years, smartphones and small tablet PCs have become widespread. Even users of the first terminal device as a drawing device often carry smartphones or small tablet PCs.

[0018] Therefore, a single drawing system is configured by utilizing a second terminal device 2 in addition to the first terminal device 1. In this drawing system, the entire surface of the display screen 115D of the first terminal device 1 is used as a drawing area, and the entire surface of the display screen 215D of the second terminal device 2 is used as an instruction input area. In other words, the drawing area R1 and the instruction input area R2, which were conventionally provided on the display screen of a single terminal device, are now provided separately on the first terminal device 1 and the second terminal device 2.

[0019] This prevents the instruction input area from compressing the drawing area and narrowing the drawing area. Then, instruction information received through the instruction input area provided on the display screen 215D of the second terminal device 2 is provided to the first terminal device 1 via wireless communication. The first terminal device 1 is able to perform drawing in accordance with the instruction information from the second terminal device and instruction input from the user to the drawing area provided on the entire surface of its own display screen 115D.

[0020] [Basic structure of the first and second terminal devices] FIG. 2 is an exploded view illustrating the basic structure of the first and second terminal devices. As shown in FIG. 1, the first terminal device 1 and the second terminal device 2 are different in size, but both are equipped with a thin display device and a position detection sensor, have a flat outer shape, and have the same basic structure. Therefore, the basic structures of the first terminal device 1 and the second terminal device 2 will be described here using the first terminal device 1 as an example. Note that in FIG. 2, the reference numerals in parentheses refer to the second terminal device 2.

[0021] 2, the first terminal device 1 accommodates, in order from the bottom, a circuit board 100, a first sensor 111, a display device 115, and a second sensor 113 in a housing 10, which are sealed within the housing 10 by a front panel 20. A transparent tempered glass, for example, is fitted inside the front panel 20, indicated by the dotted line, so that the entire display screen of the display device 115 can be viewed. In addition, the tempered glass surface of the front panel 20 serves as an operation surface, and a pointing operation can be performed on the first sensor 111 or the second sensor 113 using a pointer without damaging the second sensor 113 or the like.

[0022] The circuit board 100 is equipped with various electronic circuits and electronic components, such as a control circuit, a display control circuit, a position detection circuit for the first sensor, a position detection circuit for the second sensor, a short-range wireless communication circuit, and a semiconductor memory. The first sensor 111 is of an electromagnetic induction type. The display device 115 includes, for example, an LCD (Liquid Crystal Display), which is a thin display element, various filters, a backlight, and the like. The second sensor 113 is of a capacitance type. In other words, the first terminal device 1 is provided with position detection sensors of different types on either side of the display device 115.

[0023] The first sensor 111 employs an electromagnetic induction system and is configured with multiple loop coils arranged in both the X-axis and Y-axis directions. A transmission period, in which power is sequentially supplied to the multiple loop coils of the first sensor 111 to generate a magnetic field, alternates with a reception period, in which power supply is stopped and the sensor receives a magnetic field from an external device. The corresponding electronic pen employs an electromagnetic induction system and includes a resonant circuit made up of a coil and a capacitor. In response to the magnetic field from the first sensor 111, a signal is generated by causing a current to flow through the coil. This signal, including writing pressure information, is then transmitted to the first sensor 111. The first sensor 111 receives this signal during the reception period and supplies it to a position detection circuit for the first sensor, which detects the position and writing pressure indicated by the electronic pen.

[0024] The second sensor 113 of the capacitance type has a plurality of linear conductors (line electrodes) arranged in each of the X-axis and Y-axis directions. When a finger or an electrostatic pen (a conductive pen-type position indicator) is brought close to the second sensor 113, a change in capacitance (charge) occurs in the linear conductors, which is supplied to a position detection circuit for the second sensor, thereby detecting the indicated position. Note that some electrostatic pens are so-called active electrostatic pens that are battery-powered and transmit signals. However, the second sensor 113 is primarily operated by a finger or a simply conductive electrostatic pen.

[0025] Each of the first sensor 111 and the second sensor 113 corresponds to the entire display screen of the display device 115, and is capable of detecting any position on the display screen that is designated. In this way, the first terminal device 1 can receive instruction input using an electromagnetic induction type electronic pen through the first sensor 111, and can also receive instruction input using a finger or an electrostatic pen through the second sensor 113. In particular, by using an electromagnetic induction type electronic pen, it is possible to designate a position more precisely, and the writing pressure applied to the electronic pen can be detected and transmitted to the first sensor 111, allowing for detailed drawing.

[0026] [First embodiment] <Configuration example of first terminal device 1> 3 is a block diagram illustrating an example of the configuration of the first terminal device 1 according to the first embodiment. The first terminal device 1 includes a user interface unit 110, a drawing processing unit 120, a control unit 130, a connection unit 140, and a panel linkage unit 150, as shown enclosed by a dotted line.

[0027] The user interface unit 110 is a part that receives instruction inputs from a user and provides information to the user. As shown in Fig. 3, the user interface unit 110 includes a first sensor 111, a first position detection circuit 112, a second sensor 113, a second position detection circuit 114, a display device 115, and a display control circuit 116.

[0028] The first sensor 111 is an electromagnetic induction type position detection sensor equipped with an X-axis direction loop coil group and a Y-axis direction loop coil group, and the first position detection circuit 112 is a position detection circuit for the first sensor. The first position detection circuit 112 can provide a transmission period in which it supplies power to the X-axis direction loop coils of the first sensor 111 and generates a signal (magnetic field) while sequentially switching between them, and a reception period in which it stops supplying power and receives a signal (magnetic field) from the electronic pen.

[0029] During the reception period, the first position detection circuit 112 detects the position indicated by the electronic pen according to the position of the loop coil that received the signal from the electronic pen, and can notify the control unit 130 or the like of the detection result. The signal from the electronic pen also includes information about writing pressure. Therefore, the first position detection circuit 112 can also detect writing pressure information from the received signal from the electronic pen, and can notify the control unit 130 or the like of the detection result.

[0030] The second sensor 113 is a capacitance-type position detection sensor including an X-axis linear conductor group and a Y-axis linear conductor group, and the second position detection circuit 114 is a position detection circuit for the second sensor. The second position detection circuit 114 detects the position indicated by a finger or electrostatic pen based on the capacitance generated in the linear conductors in the X-axis and Y-axis directions of the second sensor 113, and notifies the control unit 130 or the like of the detection result.

[0031] The display device 115 includes an LCD, various filters, a backlight, etc. The display control circuit 116, under the control of the control unit 130, performs processes such as displaying various information on the display screen of the display device 115 and erasing the displayed information.

[0032] The drawing processing unit 120 realizes a function of drawing on the first terminal device 1 in response to instructions from the user. The drawing processing unit 120 includes a drawing image memory 121, a drawing parameter memory 122, and a drawing processing circuit 123. The drawing image memory 121 is a memory (VRAM) corresponding to the display screen of the display device 115, and stores and holds image data that forms an image drawn in response to instructions from the user. The drawing parameter memory 122 stores and holds setting information (parameter information) related to various drawing operations, such as line type and color, that is received via an instruction input reception screen displayed in an instruction input area.

[0033] The drawing processing circuit 123 performs processing to form an image in the drawing image memory 121 according to an instruction input received through the first sensor 111, based on the parameters stored and held in the drawing parameter memory 122. The drawing processing circuit 123 can also perform processing to erase the image formed in the drawing image memory 121 according to an instruction input received through the first sensor 111. In this case, the image can be erased in part by erasing the drawn image.

[0034] The control unit 130 is a part that realizes the function of controlling each part of the first terminal device 1 and includes a control circuit 131 and a storage device 132. The control circuit 131 includes a central processing unit (CPU), read-only memory (ROM), random access memory (RAM), non-volatile memory, etc., although not shown. The control circuit 131 executes various software programs and controls each part to realize the various functions of the first terminal device 1. The storage device 132 is, for example, composed of a relatively large-capacity semiconductor memory and its driver, and writes, deletes, and changes information to the semiconductor memory, and reads information from the semiconductor memory. The storage device 132 stores and holds various application software, information required for processing, information created by the user, etc., and is also used as a work area for holding the progress of processing.

[0035] The connection unit 140 is a part that realizes a short-range wireless communication function, and is composed of a short-range wireless communication circuit 141, a short-range wireless communication antenna 141A, and a proximity determination circuit 142. The short-range wireless communication circuit 141 and the short-range wireless communication antenna 141A realize a short-range wireless function of the Bluetooth (registered trademark) standard. The proximity determination circuit 142 determines, based on the state of the short-range wireless communication circuit 141 and received information, whether the second terminal device 2 has approached and whether a communication path has been connected via the short-range wireless communication circuit 141 and the short-range wireless communication antenna 141A, thereby enabling communication.

[0036] The panel linkage unit 150 links with the second terminal device 2, provides an instruction input area in the second terminal device 2, and realizes a function of receiving instruction information accepted by the second terminal device. The panel linkage unit 150 includes a panel data providing circuit 151 and an instruction information acquiring circuit 152. The panel data providing circuit 151 functions when the proximity determination circuit 142 determines that the second terminal device 2 is in proximity to the first terminal device, a communication path is connected, and communication is possible.

[0037] The panel data providing circuit 151 provides the second terminal device 2 with panel data (screen information, etc.) for receiving instruction input from a user using the display screen 215D of the second terminal device 2 as an instruction input area and transmitting the received instruction information to the first terminal device. The panel data includes image data forming an instruction input receiving screen to be displayed on the display screen 215D of the second terminal device 2, software for receiving instruction input from a user through the instruction input receiving screen and transmitting the instruction input to the first terminal device, etc. The panel data is provided to the second terminal device 2 through the short-range wireless communication circuit 141 and the short-range wireless communication antenna 141A.

[0038] The instruction information acquisition circuit 152 acquires instruction information (parameters) related to drawing from the second terminal device 2 received through the short-range wireless communication antenna 141A and the short-range wireless communication circuit 141, and performs processing to record the information in the drawing parameter memory 122. As described above, the instruction information from the second terminal device 2 is provided to the second terminal device 2 by the function of the panel data providing circuit 151 of the first terminal device 1, and is instruction information corresponding to an instruction input received through the instruction information input screen displayed on the display screen 215D.

[0039] When the first terminal device 1 is powered on, the control circuit 131 displays an icon corresponding to executable software on the display screen 115D of the display device 115 via the display control circuit 116 based on the information stored in the storage device 132. The control circuit 131 accepts an icon selection input via the second sensor 113 and the second position detection circuit 114, and executes the software corresponding to the selected icon, allowing the user to perform the desired process.

[0040] Furthermore, in the first terminal device 1 of the first embodiment, the connection unit 140 and the panel linkage unit 150 function under the control of the control circuit 131, so that the first terminal device 1 can link with the second terminal device 2 and execute drawing software to realize a drawing function. Details of the drawing function realized by the linkage between the first terminal device 1 and the second terminal device 2 will be described later.

[0041] <Configuration example of second terminal device 2> 4 is a block diagram illustrating an example of the configuration of the second terminal device 2 according to the first embodiment. The second terminal device 2 includes a user interface unit 210, a drawing processing unit 220, a control unit 230, a connection unit 240, and a panel linkage unit 250, as shown enclosed by a dotted line.

[0042] The user interface unit 210, drawing processing unit 220, control unit 230, and connection unit 240 of the second terminal device 2 are configured in the same manner as the corresponding components with the same names in the first terminal device 1. Therefore, a description of these components of the second terminal device 2 will be omitted to avoid duplication. However, the first sensor 211, second sensor 213, and display device 215 of the second terminal device are different in size from the first sensor 111, second sensor 113, and display device 115 of the first terminal device.

[0043] Furthermore, the panel linkage unit 250 of the second terminal device 2 has a different configuration from the panel linkage unit 150 of the first terminal device 1. The panel linkage unit 250 of the second terminal device 2 includes a panel data acquisition circuit 251 and an instruction information providing circuit 252. The panel data acquisition circuit 251 acquires panel data transmitted from the first terminal device 1 and received via the short-range wireless communication antenna 241A and the short-range wireless communication circuit 241. The panel data acquisition circuit 251 stores the acquired panel data in, for example, the storage device 232.

[0044] The panel data acquisition circuit 251 causes the control circuit 231 to execute software for accepting instruction inputs from, for example, panel data stored in the storage device 232. As a result, information for displaying an instruction input acceptance screen is supplied to the display control circuit 216 under the control of the control circuit 231, and the instruction input acceptance screen is displayed on the display screen 215D of the display device 215. Then, instruction inputs from the user can be accepted through the instruction input acceptance screen displayed on the display screen 215D and the first sensor 211 and first position detection circuit 212 or the second sensor 213 and second position detection circuit 214.

[0045] The instruction information providing circuit 252 performs processing to transmit instruction information corresponding to the instruction input reception screen displayed on the display screen 215D of the display device 215 and the instruction input received through the first sensor 211 and the first position detection circuit 212 to the first terminal device 1. In this case, the instruction information is transmitted to the first terminal device 1 through the short-range wireless communication circuit 241 and the short-range wireless communication antenna 241A.

[0046] It is generally considered that a user will often use an electronic pen used for drawing to perform operations on the instruction input acceptance screen, and in this case, the instruction input is accepted through the instruction input acceptance screen, the first electromagnetic induction sensor 211, and the first position detection circuit 212. However, if the user touches the display screen 215D with a finger or the like, it is of course also possible to accept the instruction input through the instruction input acceptance screen, the second electrostatic induction sensor 213, and the second position detection circuit 214.

[0047] Therefore, in the second terminal device 2 of the first embodiment, under the control of the control circuit 231, the connection unit 240 and the panel linkage unit 250 function, thereby linking with the first terminal device 1 and realizing drawing functions according to the drawing software executed on the first terminal device 1.

[0048] Also, in the second terminal device 2, when the power is turned on, the control circuit 231 displays an icon corresponding to executable software on the display screen 215D of the display device 215 via the display control circuit 216 based on the information stored and held in the storage device 232. The control circuit 231 accepts an icon selection input via the second sensor 213 and the second position detection circuit 214, executes the software corresponding to the selected icon, and performs the processing desired by the user.

[0049] <Outline of Operation of Drawing System of First Embodiment> FIG. 5 is a diagram for explaining an overview of the operation of the first terminal device 1 and the second terminal device 2 constituting the drawing system of the first embodiment. As shown in FIG. 5(A), the first terminal device 1 is equipped with drawing software. This drawing software also includes panel data to be provided to the second terminal device 2. As shown in FIG. 5(A), assume that the first terminal device 1 and the second terminal device 2 are both powered on, but are so far apart that they cannot communicate wirelessly using the short-range wireless communication function. In this case, the first terminal device 1 and the second terminal device 2 function independently.

[0050] Assume that the first terminal device 1 and the second terminal device 2, both of which are powered on, are brought close to each other as indicated by the dotted arrows in Fig. 5(A). Then, as shown in Fig. 5(B), the first terminal device 1 and the second terminal device 2 are brought close to each other and are able to communicate with each other wirelessly via short-range wireless communication. In this case, as shown in Fig. 5(B), the drawing software is started (executed) in the first terminal device 1, and panel data is transmitted to the second terminal device 2. The second terminal device 2 receives the panel data from the first terminal device 1 and uses it.

[0051] 5(C), in the first terminal device 1, the entire surface of the display screen 115D of the display device 115 is made into a drawing area by the function of the drawing software, and drawing input can be performed through this drawing area. In the second terminal device 2, the entire surface of the display screen 215D of the display device 215 is made into an instruction input area by the function of the panel data from the first terminal device 1, and an instruction input acceptance screen is displayed here, allowing instruction input from the user to be accepted.

[0052] The instruction input receiving screen displayed on the display screen 215D of the second terminal device 2 and the instruction information received through the first sensor 211 and the first position detection circuit 212 are transmitted to the first terminal device 1 by the function of the instruction information providing circuit 252. The instruction information from the second terminal device 2 is various parameters related to drawing, such as line type and color, and the first terminal device 1 is able to obtain the instruction information from the second terminal device 2 and draw in the drawing area accordingly.

[0053] <Processing of the first terminal device 1 and the second terminal device 2 in the first embodiment> Figure 6 is a flowchart for explaining the processing performed by the first terminal device 1 and the processing performed by the second terminal device 2 in the first embodiment. When the first terminal device 1 is powered on and no software is running, it executes the processing shown in Figure 6(A). Similarly, when the second terminal device 2 is powered on and no software is running, it executes the processing shown in Figure 6(B).

[0054] In the first terminal device 1, the short-range wireless communication circuit 141 transmits and receives a connection request signal, and the proximity determination circuit 142 performs a process of determining whether the second terminal device 2 is in proximity based on the reception status of the connection request signal from the external device (step S101). The determination process in step S101 continues until it is determined that the second terminal device 2 is in proximity, or a predetermined termination event occurs, such as the execution of some software or the operation of turning off the power.

[0055] When the determination process of step S101 is completed, the control circuit 131 determines whether or not the second terminal device 2 has approached, based on the detection output from the proximity determination circuit 142 (step S102). If it is determined in the determination process of step S102 that the second terminal device 2 has not approached, a predetermined termination event has occurred, so the control circuit 131 terminates the process shown in Fig. 6(A) and waits for the next execution timing. Furthermore, if it is determined in the determination process of step S102 that the second terminal device 2 has approached, the control circuit 131 controls the short-range wireless communication circuit 141 to perform short-range wireless communication with the second terminal device 2 and performs a process of connecting a communication path (step S103).

[0056] Similarly, in the second terminal device 2, the short-range wireless communication circuit 241 transmits and receives a connection request signal, and the proximity determination circuit 242 performs a process of determining whether the first terminal device 1 is in proximity based on the reception status of the connection request signal from the external device (step S201). The determination process of step S201 continues, as in the process of step S101, until it is determined that the first terminal device 1 is in proximity, or until a predetermined termination event occurs, such as the execution of some software or the operation to turn off the power.

[0057] When the determination process of step S201 is completed, the control circuit 231 determines whether or not the first terminal device 1 has approached, based on the detection output from the proximity determination circuit 242 (step S202). If it is determined in the determination process of step S202 that the first terminal device 1 has not approached, a predetermined termination event has occurred, so the control circuit 231 terminates the process shown in Fig. 6(B) and waits for the next execution timing. Furthermore, if it is determined in the determination process of step S202 that the first terminal device 1 has approached, the control circuit 231 controls the short-range wireless communication circuit 241 to perform short-range wireless communication with the first terminal device 1 and performs a process of connecting a communication path (step S203).

[0058] This enables the first terminal device 1 to communicate with the second terminal device 2 via the short-range wireless communication circuit 141 and the short-range wireless communication antenna 141A, and the second terminal device 2 to communicate with the first terminal device 1 via the short-range wireless communication circuit 141 and the short-range wireless communication antenna 241A, via the short-range wireless communication circuit 241 and the short-range wireless communication antenna 241A.

[0059] After the process of step S103, the first terminal device 1 activates the drawing software in the control circuit 131, and the entire surface of the display screen 115D of the display device 115 is set as a drawing area, making it possible to accept drawing input from the user (step S104). That is, after the process of step S104, the first terminal device 1 transitions to a state in which drawing according to instruction input from the user is possible. As a result, the first terminal device 1 is able to accept drawing input (position instruction input) by the user using the electronic pen through the first sensor 111 and the first position detection circuit 112, and display a drawing image corresponding to the input on the display screen 115D of the display device 115. Furthermore, in the first terminal device 1, under the control of the control circuit 131, the panel data providing circuit 151 functions and transmits panel data to the second terminal device 2 via short-range wireless communication (step S105).

[0060] In the second terminal device 2, the panel data from the first terminal device 1 is received by the panel data acquisition circuit 251, and the panel data acquisition circuit 251 uses the panel data to display an instruction input acceptance screen on the display screen 215D of the display device 215, thereby enabling acceptance of an instruction input (step S204). That is, after the processing of step S204, the second terminal device 2 transitions to a state in which it is able to accept instruction information corresponding to an instruction input from the user. In this case, the entire display screen 215D of the display device 215 of the second terminal device 2 becomes an instruction input area, and the instruction input acceptance screen is displayed thereon. Then, it becomes possible to accept an instruction input from the user through the instruction input acceptance screen displayed on the display screen 215D and the first sensor 211 and the first position detection circuit 212 or the second sensor 213 and the second position detection circuit 214.

[0061] Thereafter, the control circuit 231 of the second terminal device 2 controls the instruction information providing circuit 252 to execute instruction information providing processing (step S205). In the processing of step S205, when an instruction input related to drawing is received, the instruction information providing circuit 252 functions to form instruction information to be provided to the first terminal device 1, and after wirelessly transmitting this, the processing proceeds to the next step. In addition, in the processing of step S205, when an instruction input related to drawing is not received, the processing proceeds to the next step without doing anything.

[0062] Meanwhile, in the first terminal device 1, the control circuit 131 controls the instruction information acquisition circuit 152 to perform an acquisition and setting process of the instruction information (step S106). In the process of step S106, when instruction information related to drawing is acquired, the instruction information acquisition circuit 152 functions to store (set) the acquired instruction information in the drawing parameter memory 122. In addition, in the process of step S106, when instruction information from the second terminal device is not acquired, nothing is done and the process proceeds to the next step.

[0063] As described above, the instruction information from the second terminal device 2 is, for example, parameters related to drawing, such as line type and color. Therefore, by setting the instruction information in the drawing parameter memory 122, drawing can be performed in accordance with the instruction information. Therefore, if the instruction information is related to, for example, line type or color, drawing can be performed using the specified line type and color.

[0064] Thereafter, in the first terminal device 1, the control circuit 131 determines whether or not a termination event has occurred, such as a predetermined operation to terminate the execution of the drawing software (step S107). If it is determined in the determination process of step S107 that a termination event has not occurred, the control circuit 131 repeats the process from step S106, and continues to accept drawing input from the user. If it is determined in the determination process of step S107 that a termination event has occurred, it performs termination processes, such as releasing the communication path connected in step S103 and returning the image displayed on the display screen to the state it was in before the execution of the drawing software (step S108). Thereafter, the process shown in FIG. 6(A) ends.

[0065] Meanwhile, in the second terminal device 2, after the process of step S205, the control circuit 231 also determines whether or not a termination event has occurred, such as a predetermined operation being performed to terminate the reception of instruction input through the instruction input reception screen (step S206). If it is determined in the determination process of step S206 that a termination event has not occurred, the process from step S205 onwards is repeated, allowing the reception of instruction input from the user to continue. If it is determined in the determination process of step S206 that a termination event has occurred, termination processes are performed, such as releasing the communication path connected in step S203 and returning the display image on the display screen to the state it was in before the instruction input reception screen was displayed (step S207). Thereafter, the process shown in FIG. 6(B) is terminated.

[0066] In this way, the entire display screen 115D of the first terminal device 1 can be used as a drawing area. Furthermore, the entire display screen 215D of the second terminal device 2 can be used as an instruction input area, displaying an instruction input reception screen, receiving instruction inputs related to drawing, and transmitting instruction information corresponding to the received instruction inputs to the first terminal device. This allows a large drawing area to be secured, enabling appropriate drawing input without the need for repeated zooming of the drawing. Furthermore, the second terminal device 2 can receive instruction inputs related to drawing, such as line type and color, and provide corresponding instruction information (parameter information) to the first terminal device. This allows the user to appropriately draw as intended, even when using a drawing system consisting of the first terminal device 1 and the second terminal device 2.

[0067] [Second embodiment] <Configuration Example of First Terminal Device 1A and Second Terminal Device 2A> The drawing system of the second embodiment is also configured with two terminal devices, a first terminal device and a second terminal device, similar to the drawing system of the first embodiment described with reference to Fig. 1. Specifically, it is configured with a first terminal device 1A realized as a tablet PC or the like, and a second terminal device 2A realized as a smartphone, a small tablet PC or the like. The first terminal device 1A and the second terminal device 2A of the second embodiment are both flat (thin) devices having the basic structure described with reference to Fig. 2.

[0068] However, the first terminal device 1 and the second terminal device 2 of the first embodiment differ from the first terminal device 1A and the second terminal device 2A of the second embodiment described below in the software executed and the configuration of the panel linkage unit. FIG. 7 is a block diagram for explaining an example configuration of the first terminal device 1A and the second terminal device 2A of the second embodiment. In the first terminal device 1A shown in the upper part of FIG. 7, the same reference numerals are used to designate components configured similarly to the first terminal device 1 of the first embodiment described with reference to FIG. 3, and detailed descriptions of these components will be omitted. Similarly, in the second terminal device 2A shown in the lower part of FIG. 7, the same reference numerals are used to designate components configured similarly to the second terminal device 2 of the first embodiment described with reference to FIG. 4, and detailed descriptions of these components will be omitted.

[0069] The control unit 130 of the first terminal device 1A shown in the upper part of Fig. 7 also functions as a drawing software execution unit, similar to the first terminal device 1 of the first embodiment. However, the drawing software executed by the control unit 130 of the first terminal device 1A differs from the drawing software used in the first terminal device 1 of the first embodiment in that it does not have a function for providing panel data to the second terminal device 2A. For this reason, the panel linkage unit 150A of the first terminal device 1A of the second embodiment has only an instruction information acquisition circuit 152A, and does not have a panel data providing circuit.

[0070] The control unit 230 of the second terminal device 2A shown in the lower part of FIG. 7 functions as a panel software execution unit that displays an instruction input acceptance screen on the display screen 215D and accepts instruction input from the user. Therefore, the second terminal device 2A of this second embodiment does not need to receive panel data from the first terminal device 1A. Therefore, the panel linkage unit 250A of the second terminal device 2A of the second embodiment only has an instruction information providing circuit 252A, and does not have a panel data acquisition circuit. In other words, in the drawing system of this second embodiment, the panel data is configured to be stored in the second terminal device 2A.

[0071] <Outline of Operation of Drawing System of Second Embodiment> 8A and 8B are diagrams for explaining an outline of the operation of the first terminal device 1A and the second terminal device 2A constituting the drawing system of the second embodiment. As shown in FIG. 8A, the first terminal device 1A is equipped with drawing software. This drawing software is slightly different from the drawing software equipped in the first terminal device 1 of the first embodiment. This drawing software enables drawing to be performed using the entire display screen 115D of the first terminal device 1A as a drawing area, but does not have a function for providing panel data to the second terminal device 2A.

[0072] On the other hand, the second terminal device 2A is equipped with panel software. The panel software includes image data for forming an instruction input reception screen. The panel software also includes software that sets the entire surface of the display screen 215D of the second terminal device 2A as an instruction input area, displays an instruction input reception screen on the area, and receives instruction inputs from the user via the first sensor 211 and the second sensor 213. As in the drawing system of the first embodiment, instruction information from the user can also be received via the instruction input reception screen, the second sensor 213, and the second position detection circuit 214.

[0073] As shown in Fig. 8(A), it is assumed that the first terminal device 1A and the second terminal device 2A are powered on, but are too far apart to communicate with each other using the short-range wireless communication function. In this case, the first terminal device 1A and the second terminal device 2A function independently. It is assumed that the first terminal device 1A and the second terminal device 2A, which are powered on, approach each other as indicated by the dotted arrows in Fig. 8(A), and then, as shown in Fig. 8(B), the first terminal device 1A and the second terminal device 2A approach each other and are able to communicate with each other wirelessly.

[0074] In this case, as shown in FIG. 8(B), in the first terminal device 1A, the control unit 130 starts (executes) the drawing software. Meanwhile, in the second terminal device 2A, the control unit 230 starts (executes) the panel software. As a result, as shown in FIG. 8(C), in the first terminal device 1A, the entire surface of the display screen 115D of the display device 115 is made into a drawing area by the function of the drawing software, and drawing input can be performed through this drawing area. In the second terminal device 2A, the panel software function makes the entire surface of the display screen 215D of the display device 215 into an instruction input area, and an instruction input acceptance screen is displayed therein, allowing instruction input from the user to be accepted.

[0075] The instruction input receiving screen displayed on the display screen 215D of the second terminal device 2A and instruction information corresponding to the instruction input received, for example, through the first sensor 211 and the first position detection circuit 212, are transmitted to the first terminal device 1A by the functioning of the instruction information providing circuit 252A. The instruction information from the second terminal device 2A is various parameters related to drawing, such as line type and color, and the first terminal device 1A is able to obtain the instruction information from the second terminal device 2A and draw in the drawing area accordingly.

[0076] <Processing of the first terminal device 1A and the second terminal device 2A in the second embodiment> Figure 9 is a flowchart for explaining the processing performed by the first terminal device 1A and the processing performed by the second terminal device 2A in the second embodiment, with Figure 9(A) showing the processing by the first terminal device 1A and Figure 9(B) showing the processing by the second terminal device 2A. In the flowcharts of Figures 9(A) and (B), the same reference numerals are used to designate the processing that is performed in the same way as in the flowcharts of Figures 6(A) and (B) in the first embodiment, and detailed explanations of those parts will be omitted to avoid duplication.

[0077] When the first terminal device 1A of the second embodiment is powered on and no software is running, it executes the process shown in FIG. 9(A). When the first terminal device 1A comes close to the second terminal device 2A through the processes of steps S101 to S103, it establishes a communication path via short-range wireless communication. After the communication path is established, the first terminal device 1A executes drawing software in the control unit 130, and uses the entire display screen 115D of the display device 115 as a drawing area, allowing the user to input a drawing (step S301). That is, after the process of step S301, the first terminal device 1A transitions to a state in which it can draw in response to a user's instruction input.

[0078] Thereafter, the first terminal device 1A receives instruction information from the second terminal device 2A via the short-range wireless communication antenna 141A and the short-range wireless communication circuit 141, which is acquired by the instruction information acquisition circuit 152A and stored in the drawing parameter memory 122 (step S106). This enables drawing to be performed in accordance with the instruction input from the user. The control unit 130 repeats the process from step S106 until a predetermined end event occurs (step S107), and when the end event occurs, performs a predetermined end process (step S108), thereby terminating the process shown in FIG. 9(A).

[0079] On the other hand, in the second terminal device 2A of the second embodiment, when no software is running, the process shown in FIG. 9(B) is executed. When the second terminal device 2A comes close to the first terminal device 1A through the processes of steps S201 to S203, the second terminal device 2A establishes a communication path via short-range wireless communication. After the communication path is established, the second terminal device 2A executes panel software in the control unit 230, and displays an instruction input acceptance image with the entire display screen 215D of the display device 215 as an instruction input area, thereby enabling the user to input instructions (step S401). That is, after the process of step S401, the second terminal device 2A transitions to a state in which it can accept instruction information in response to an instruction input by the user. This enables the second terminal device 2A to accept instruction input from the user.

[0080] Assume that the second terminal device 2A receives an instruction input from the user. In this case, the instruction information providing circuit 252A forms instruction information according to the received instruction input and performs a process of transmitting this to the first terminal device 1A via the short-range wireless communication circuit 241 and the short-range wireless communication antenna 241A (step S205). As a result, as described above, the first terminal device 1A is enabled to perform drawing according to the instruction input from the user. The control unit 230 repeats the process from step S205 until a predetermined end event occurs (step S206). When the end event occurs, the control unit 230 performs a predetermined end process (step S207) and ends the process shown in FIG. 9(B).

[0081] Thus, in the drawing system of the second embodiment, the first terminal device 1A is equipped with drawing software, and the second terminal device 2A is equipped with panel software. By executing the drawing software, the first terminal device 1A can accept drawing input using the entire screen of the display screen 115D of the display device 115 as a drawing area. Meanwhile, the second terminal device 2A, by executing the panel software, can use the entire screen of the display screen 215D of the display device 215 as an instruction input area, display an instruction input acceptance screen to accept instruction input, and provide corresponding instruction information to the first terminal device 1A. Therefore, the first terminal device 1A can perform drawing in response to instruction information from the user using the entire surface of the display screen 115D.

[0082] [Third embodiment] <Configuration Example of First Terminal Device 1B and Second Terminal Device 2B> The drawing system of the third embodiment is also configured with two terminal devices, a first terminal device and a second terminal device, similar to the drawing system of the first embodiment described with reference to Fig. 1. Specifically, it is configured with a first terminal device 1B realized as a tablet PC or the like, and a second terminal device 2B realized as a smartphone, a small tablet PC or the like. Similarly to the drawing systems of the first and second embodiments described above, the first terminal device 1B and the second terminal device 2B of the third embodiment are both flat (thin) devices having the basic structure described with reference to Fig. 2.

[0083] 10 is a block diagram for explaining a configuration example of a first terminal device 1B and a second terminal device 2B according to the third embodiment. As can be seen by comparing FIG. 10 with FIG. 7, the first terminal device 1B according to the third embodiment is configured almost the same as the first terminal device 1A according to the second embodiment, and the second terminal device 2B according to the third embodiment is configured almost the same as the second terminal device 2A according to the second embodiment. However, the software executed by the first terminal device 1B and the second terminal device 2B and the manner of execution thereof are different from those of the first terminal device 1A and the second terminal device 2A according to the second embodiment.

[0084] In the first terminal device 1B shown in the upper part of Fig. 10, the same reference numerals are used to designate parts configured in the same way as the first terminal device 1 of the first embodiment described with reference to Fig. 3, and detailed descriptions of these parts will be omitted. In the second terminal device 2B shown in the lower part of Fig. 10, the same reference numerals are used to designate parts configured in the same way as the second terminal device 2 of the first embodiment described with reference to Fig. 4, and detailed descriptions of these parts will be omitted.

[0085] The control unit 130 of the first terminal device 1B of the third embodiment functions as a drawing software execution unit. The drawing software executed by the control unit 130 has both a drawing function and an instruction input acceptance function. The drawing function is a function for providing a drawing area on the display screen 115D of the display device 115 and performing drawing. The instruction input acceptance function is a function for providing an instruction input area on the display screen 115D of the display device 115 and displaying an instruction input acceptance screen to accept input of instruction information.

[0086] Furthermore, the drawing software of this embodiment is configured to allow for setting of a priority order when the first terminal device 1B and the second terminal device 2B cooperate with each other. This priority order is set so that the drawing function is prioritized first and the instruction input reception function is prioritized second. Information indicating the first priority order for the drawing software is set (stored) in the storage device 132 of the control unit 130 of the first terminal device 1B, and the drawing function is set to be executed in the first terminal device 1B when cooperating with the second terminal device 2B.

[0087] As a result, suppose that the second terminal device 2B is not nearby, the first terminal device 1B functions independently, and the drawing software is started up. In this case, since the first terminal device 1B functions independently, the priority of the drawing software does not matter, and as shown in Fig. 1, both the drawing area R1 and the instruction input area R2 are provided on the display screen 115D of the display device 115, so that both drawing input and instruction input can be received.

[0088] However, when the second terminal device 2B is nearby, a communication path is connected by short-range wireless communication, and the first terminal device 1B and the second terminal device 2B function in cooperation with each other, the priority of the drawing software is taken into consideration. In this case, as described above, the priority of the drawing software of the first terminal device 1B is the highest, so the drawing software is executed so that only the drawing function is functioning. In this case, the instruction input receiving function does not work in the first terminal device 1B.

[0089] On the other hand, the control unit 230 of the second terminal device 2B of the third embodiment functions as a drawing software execution unit. The drawing software executed by the control unit 230 is the same as the drawing software executed by the control unit 130 of the first terminal device 1B, and has both a drawing function and an instruction input reception function, and the drawing software can be prioritized. Information indicating the second priority for the drawing software is set (stored) in the storage device 232 of the control unit 230 of the second terminal device 2B, and when cooperating with the first terminal device 1B, the second terminal device 2B is set to execute the instruction input reception function.

[0090] As a result, suppose that the first terminal device 1B is not nearby, the second terminal device 2B is functioning alone, and the drawing software is started. In this case, since the second terminal device 2B is functioning alone, the priority of the drawing software does not matter, and both the drawing area R1 and the instruction input area R2 are provided on the display screen 215D of the display device 215 so that both drawing input and instruction input can be received. In this case, although the display screen 215D itself is small, drawing processing can be performed in the same way as when the first terminal device 1B is functioning alone.

[0091] However, when the first terminal device 1B is nearby, a communication path is connected by short-range wireless communication, and the second terminal device 2B and the first terminal device 1B function in cooperation with each other, the priority of the drawing software is taken into consideration. In this case, as described above, the priority of the drawing software of the second terminal device 2B is second, and therefore the drawing software is executed so that the instruction input reception function is enabled.

[0092] As described above, in the drawing system of the third embodiment, drawing software having both a drawing function and an instruction input reception function is installed and made executable in each of the first terminal device 1B and the second terminal device 2B. The drawing software installed in the first terminal device 1B and the second terminal device 2B may be identical if it is executable. However, typically, drawing software having the same functions and compatible with the operating system functioning on each terminal device is installed.

[0093] For example, suppose the operating system running on the first terminal device 1B is Windows (registered trademark), and the operating system running on the second terminal device 2B is Android (registered trademark). In this case, drawing software having similar functions, drawing software for Windows (registered trademark), is installed on the first terminal device 1B, and drawing software for Android (registered trademark) is installed on the second terminal device 2B. Furthermore, even if the same operating system runs on the first terminal device 1B and the second terminal device 2B, drawing software created according to the characteristics of each terminal device may be installed on each terminal device, as long as the drawing software has both a drawing function and a command input reception function.

[0094] <Outline of Operation of Drawing System of Third Embodiment> 11A and 11B are diagrams for explaining an outline of the operation of the first terminal device 1B and the second terminal device 2B constituting the drawing system of the third embodiment. As shown in FIG. 11A, the first terminal device 1B is equipped with drawing software. As described above, the drawing software has a drawing function and an instruction input reception function. Similarly to the first terminal device 1B, the second terminal device 2B is also equipped with drawing software having a drawing function and an instruction input reception function.

[0095] In the first terminal device 1B and the second terminal device 2B, a priority order is set for the installed drawing software. When the first terminal device 1B and the second terminal device 2B cooperate to perform drawing, the priority order for the drawing software is such that the terminal that executes the drawing function is first, and the terminal that executes the instruction input reception function is second. In this third embodiment, the priority order for the drawing software of the first terminal device 1B is first, and the priority order for the drawing software of the second terminal device 2B is second.

[0096] 11(A), assume that the first terminal device 1B and the second terminal device 2B are both powered on, but are too far apart to communicate with each other via short-range wireless communication. In this case, the first terminal device 1 and the second terminal device 2 function independently. Therefore, if drawing software is executed on each of the first terminal device 1B and the second terminal device 2B in this state, a drawing area and an instruction input area can be provided in each of the first terminal device 1B and the second terminal device 2B, and drawing processing can be performed as in the conventional case.

[0097] It is assumed that the first terminal device 1B and the second terminal device 2B in a powered-on state are brought close to each other as indicated by the dotted arrows in Fig. 11(A). Then, it is assumed that the first terminal device 1B and the second terminal device 2B are brought close to each other as shown in Fig. 11(B), and are now capable of short-range wireless communication with each other.

[0098] 11(B), in the first terminal device 1B, the priority of the drawing software is set to the first place, so the drawing software is started (executed) so as to execute only the drawing function. On the other hand, in the second terminal device 2B, the priority of the drawing software is set to the second place, so the drawing software is started (executed) so as to execute only the instruction input reception function.

[0099] 11(C), in first terminal device 1B, the entire surface of display screen 115D of display device 115 is made into a drawing area by the drawing function of the drawing software, and drawing input can be performed through this drawing area. In second terminal device 2B, the entire surface of display screen 215D of display device 215 is made into an instruction input area by the instruction input acceptance function of the drawing software, and an instruction input acceptance screen is displayed therein, allowing instruction input from the user to be accepted.

[0100] The instruction input receiving screen displayed on the display screen 215D of the second terminal device 2B and instruction information corresponding to the instruction input received, for example, through the first sensor 211 and the first position detection circuit 212, are transmitted to the first terminal device 1B by the functioning of the instruction information providing circuit 252A. The instruction information from the second terminal device 2B is various parameters related to drawing, such as line type and color, and the first terminal device 1B is able to obtain the instruction information from the second terminal device 2A and draw in the drawing area accordingly.

[0101] <Processing of the first terminal device 1B and the second terminal device 2B in the third embodiment> Figure 12 is a flowchart for explaining the processing performed by the first terminal device 1B and the processing performed by the second terminal device 2B in the third embodiment, with Figure 12(A) showing the processing by the first terminal device 1B and Figure 12(B) showing the processing by the second terminal device 2B. In the flowcharts of Figures 12(A) and (B), the same reference numerals are used to denote processing that is performed in the same way as in the flowcharts of Figures 6(A) and (B) in the first embodiment, and detailed explanations of those parts will be omitted to avoid duplication.

[0102] When the first terminal device 1B is powered on and no software is running, it executes the process shown in FIG. 12(A). When the first terminal device 1B comes close to the second terminal device 2B through the processes of steps S101 to S103, it establishes a communication path via short-range wireless communication. After the communication path is established, the first terminal device 1B has the highest priority for the drawing software, so it starts (executes) the drawing software by causing the control unit 130 to execute only the drawing function (step S501). As a result, after the process of step S501, the first terminal device 1B transitions to a state in which it can draw in response to a user's instruction input, and the entire display screen 115D of the display device 115 becomes a drawing area, allowing the user to input a drawing.

[0103] Thereafter, the first terminal device 1B receives instruction information from the second terminal device 2B via the short-range wireless communication antenna 141A and the short-range wireless communication circuit 141, which is acquired by the instruction information acquisition circuit 152A and stored in the drawing parameter memory 122 (step S106). This enables drawing to be performed in accordance with the instruction input from the user. The control unit 130 repeats the process from step S106 until a predetermined end event occurs (step S107), and when the end event occurs, performs a predetermined end process (step S108), thereby terminating the process shown in FIG. 11(A).

[0104] On the other hand, when the second terminal device 2B is powered on and no software is running, it executes the process shown in FIG. 12(B). When the second terminal device 2B comes close to the first terminal device 1B through the processes of steps S201 to S203, it establishes a communication channel via short-range wireless communication. After the communication channel is established, the second terminal device 2B has the second highest priority for the drawing software, so the control unit 230 starts (executes) the drawing software by executing only the instruction input reception function (step S601). That is, after the process of step S601, the second terminal device 2B transitions to a state in which it can receive instruction information in response to an instruction input by the user. As a result, the second terminal device 2B displays an instruction input reception image on the entire display screen 215D of the display device 215 as an instruction input area, allowing the user to input instructions.

[0105] Assume that the second terminal device 2B receives an instruction input from the user. In this case, the instruction information providing circuit 252A forms instruction information according to the received instruction input and performs a process of transmitting this to the first terminal device 1B via the short-range wireless communication circuit 241 and the short-range wireless communication antenna 241A (step S205). As a result, as described above, the first terminal device 1B is enabled to perform drawing according to the instruction input from the user. The control unit 230 repeats the process from step S205 until a predetermined end event occurs (step S206). When the end event occurs, the control unit 230 performs a predetermined end process (step S207) and ends the process shown in FIG. 12(B).

[0106] As described above, in the drawing system of the third embodiment, when the first terminal device 1B and the second terminal device 2B are not adjacent to each other and each device starts its own drawing software, a drawing area and an instruction input reception area are provided on its display screen, allowing conventional drawing processing. However, when the first terminal device 1B and the second terminal device 2B are adjacent to each other, the drawing software is executed on each device, but the drawing function is executed on the first terminal device 1B and the instruction input reception function is executed on the second terminal device 2B. In this case, drawing can be performed using the entire display screen 115D of the display device 115 of the first terminal device 1B. Furthermore, instruction input can be performed using the entire display screen 215D of the display device 215 of the second terminal device 2B, and instruction information corresponding to the received instruction input can be provided to the first terminal device 1B.

[0107] [Attachment of second terminal devices 2, 2A, 2B to users] The drawing systems of the first to third embodiments described above are each composed of two terminal devices: a first terminal device (1, 1A, 1B) and a second terminal device (2, 2A, 2B). Therefore, when using the drawing system on a desk, both terminal devices can be operated on the desk, so there are no operational problems. However, when sketching outdoors, for example, it is necessary to hold both the first terminal device and the second terminal device in one's hand, which may prevent free drawing when using the drawing system.

[0108] Therefore, the first terminal device (1, 1A, 1B) provided with the drawing area is held in the hand, and the second terminal device (2, 2A, 2B) is worn on the arm holding the first terminal device (1, 1A, 1B), leaving the other hand free. This allows the other hand to hold an electronic pen and operate both the first terminal device and the second terminal device, allowing for free drawing. FIG. 13 is a diagram illustrating an example of how the second terminal device (2, 2A, 2B) is worn on the user's body. Here, an example will be described in which the first terminal device 1 and the second terminal device 2 of the first embodiment are used.

[0109] 13(A) and 13(B), a wristband 21 and a finger band 22 are attached to the surface (back surface) of the second terminal device 2 opposite to the display screen 215D. Various methods of attachment can be used, but the wristband 21, for example, is prevented from easily coming off by having locking members provided on both ends thereof fitted into grooves for the wristband provided on the back surface of the second terminal device 2. Also, the finger band 22 is prevented from easily coming off by having locking members provided thereon fitted into grooves for the finger band provided on the back surface of the second terminal device 2.

[0110] 13(A) and 13(B), the user can wear the second terminal device 2 on their arm by putting the wristband 21 on their arm and putting the finger band 22 on, for example, their thumb. The user can slightly shift the position of the second terminal device 2 worn on the user's arm or adjust the orientation (tilt) of the display screen 215D by moving the arm on which the second terminal device 2 is worn from side to side or by moving the wrist of the arm on which the second terminal device 2 is worn.

[0111] 13(C), by holding the first terminal device 1 in the hand on which the second terminal device 2 is worn, the user can hold (hold) both the first terminal device 1 and the second terminal device 2 in that hand (including the arm). This allows the other hand to hold only the electronic pen, so the user can operate both the first terminal device 1 and the second terminal device 2 with the electronic pen even outdoors, and freely input drawings to the first terminal device 1 according to their intentions.

[0112] In the example shown in FIG. 13(C), the second terminal device 2 is attached to the user's left arm and the first terminal device 1 is held in the left hand. Therefore, the user can hold the electronic pen in the right hand and freely input drawings. Of course, it is also possible to attach the second terminal device 2 to the right arm, hold the first terminal device 1 in the right hand, and hold the electronic pen in the left hand to operate both the first terminal device 1 and the second terminal device 2. The drawing systems of the second and third embodiments can also be used in the manner described with reference to FIG. 13.

[0113] [Authentication using an electronic pen] In the first, second, and third embodiments described above, the first terminal device (1, 1A, 1B) and the second terminal device (2, 2A, 2B) are configured to operate as a drawing system when they are in close proximity to each other and a communication path is established through short-range wireless communication. However, there may be cases where a user owns multiple terminal devices or where other people's terminal devices are located nearby. In such cases, there is a slight possibility that the first terminal device and the second terminal device that should be paired will not be paired, and the drawing system will not be able to operate as it should.

[0114] Therefore, the electronic pen that the user uses in common on the first terminal device (1, 1A, 1B) and the second terminal device (2, 2A, 2B) is used to authenticate the terminal to which a communication path via short-range wireless communication is connected. Simply put, a terminal device that accepts an instruction input from the electronic pen issues a connection request via short-range wireless communication. Then, when a connection request from another terminal is received and the terminal device has also issued a connection request, a communication path is established between the sender of the connection request and the terminal device, thereby enabling pairing of the first terminal device and the second terminal device that constitute the drawing system.

[0115] However, when there are three or more terminal devices capable of inputting instructions using an electronic pen, the above-mentioned method may not be able to perform appropriate pairing. Therefore, electronic pen identification information (electronic pen ID) unique to the electronic pen is included in the position instruction signal transmitted from the electronic pen used by the user of the drawing system. The first terminal device 1 and the second terminal device 2 that receive the position instruction signal including the electronic pen ID from the electronic pen extract and store the electronic pen ID included in the position instruction signal from the electronic pen. Furthermore, the first terminal device 1 and the second terminal device 2 form a connection request including the stored electronic pen ID and transmit it via short-range wireless communication.

[0116] Then, the first terminal device 1 and the second terminal device 2 connect a communication path to the terminal device that has transmitted a connection request including the same electronic pen ID as the electronic pen ID held by the first terminal device 1 and the second terminal device 2. This connects a communication path between the first terminal device 1 and the second terminal device 2 that form a pair to form a drawing system, allowing the drawing system to be configured and functioned appropriately.

[0117] Fig. 14 is a block diagram for explaining an example of the configuration of a drawing system that performs authentication processing using an electronic pen ID. In Fig. 14, an electronic pen authentication unit 170 provided in a first terminal device 1C and an electronic pen authentication unit 270 provided in a second terminal device 2C are main units that realize the electronic pen authentication function. The parts of the first terminal device 1C other than the electronic pen authentication unit 170 are configured in the same way as the first terminal device 1 of the first embodiment. Similarly, the parts of the second terminal device 2C other than the electronic pen authentication unit 270 are configured in the same way as the second terminal device 2 of the first embodiment.

[0118] That is, in the first terminal device 1C, the user interface unit 110 functions to receive a position indication signal from the electronic pen, extract an electronic pen ID from the position indication signal, and supply the electronic pen ID to the electronic pen authentication unit 170. The electronic pen authentication unit 170 holds the electronic pen ID from the user interface unit 110, and under the control of the control unit 130, cooperates with the connection unit 140 to form a connection request including the electronic pen ID and transmits this via short-range wireless communication. Furthermore, the electronic pen authentication unit 170 receives a connection request via the connection unit 140 and includes the electronic pen ID. Therefore, if the electronic pen ID is the same as the electronic pen ID held in the electronic pen authentication unit 170, it controls the connection unit 140 to connect a communication path to the sender of the connection request.

[0119] Similarly, in the second terminal device 2C, the user interface unit 210 functions to receive a position indication signal from the electronic pen, extract an electronic pen ID from the position indication signal, and supply the electronic pen ID to the electronic pen authentication unit 270. The electronic pen authentication unit 270 holds the electronic pen ID from the user interface unit 210, and under the control of the control unit 230, cooperates with the connection unit 240 to form a connection request including the electronic pen ID and transmits the request via short-range wireless communication. Furthermore, the electronic pen authentication unit 270 receives a connection request that includes the electronic pen ID through the connection unit 240. Therefore, if the electronic pen ID is the same as the electronic pen ID held in the electronic pen authentication unit 270, the electronic pen authentication unit 270 controls the connection unit 240 to connect a communication path to the sender of the connection request.

[0120] As a result, a communication path is connected between the first terminal device 1C and the second terminal device 2C, and a drawing system consisting of the first terminal device 1 and the second terminal device 2 is properly configured. In this case, even if any other terminal device exists between the first terminal device 1C and the second terminal device 2C, the first terminal device 1C and the second terminal device 2C do not connect a communication path to the other terminal device. This allows the drawing system to be properly configured at all times. As described above, the same authentication process can be performed in both the drawing system of the second embodiment and the drawing system of the third embodiment.

[0121] [Effects of the embodiment] As can be seen from the above description of the embodiment, in the first terminal device (1, 1A, 1B, 1C), the entire display screen of the display device 115 can be used as a drawing area to accept drawing input. In addition, in the second terminal device (2, 2A, 2B, 2C), the entire display screen of the display device 215 can be used as an instruction input area, and an instruction input acceptance screen can be displayed therein to accept instruction input from the user. Then, in the second terminal device (2, 2A, 2B, 2C), instruction information can be provided to the first terminal device (1, 1A, 1B, 1C) in accordance with the accepted instruction input. This allows the first terminal device (1, 1A, 1B, 1C) to perform drawing in accordance with the instruction input from the user.

[0122] In this way, in the case of the drawing system of the above-described embodiment, a large drawing area can be secured on the display screen of the first terminal device (1, 1A, 1B, 1C). Also, an instruction input area can be provided on the display screen of the second terminal device (2, 2A, 2B, 2C), and instructions input to this instruction input area can be accepted at an appropriate time and provided to the first terminal device (1, 1A, 1B, 1C), allowing drawing to be performed in accordance with the user's instructions.

[0123] [Variations] In the above-described embodiment, the first sensor 111 of the first terminal device (1, 1A, 1B, 1C) and the first sensor 211 of the second terminal device (2, 2A, 2B, 2C) are both electromagnetic induction type sensors, so drawing input and instruction input can be performed using the same electronic pen. Furthermore, the second sensor 113 of the first terminal device (1, 1A, 1B, 1C) and the second sensor 213 of the second terminal device (2, 2A, 2B, 2C) are both capacitance type sensors, so input can also be performed using a user's finger or an electrostatic pen. Therefore, drawing input to the first terminal device (1, 1A, 1B, 1C) can be performed using an electronic pen, and instruction input to the second terminal device (2, 2A, 2B, 2C) can be performed using a user's finger.

[0124] Furthermore, the first and second terminal devices constituting the drawing system do not need to be equipped with both an electromagnetic induction sensor and a capacitance sensor. The first and second terminal devices may be equipped with either an electromagnetic induction sensor or a capacitance sensor. The first terminal device realizes the drawing function, so it is sufficient that it is equipped with a sensor that can input drawings using an electronic pen or an electrostatic pen.

[0125] There are four possible combinations of sensors: (1) Both the first terminal device and the second terminal device may be equipped with electromagnetic induction type sensors; (2) Both the first terminal device and the second terminal device may be equipped with capacitance type sensors; (3) The first terminal device may be equipped with an electromagnetic induction type sensor, and the second terminal device may be equipped with a capacitance type sensor; (4) The first terminal device may be equipped with a capacitance type sensor, and the second terminal device may be equipped with an electromagnetic induction type sensor.

[0126] In the above-described embodiment, the first terminal device (1, 1A, 1B, 1C) and the second terminal device (2, 2A, 2B, 2C) are connected by short-range wireless communication, but this is not limiting. The two terminal devices can also be connected by wire. In this case, when a wired connection with another terminal device is confirmed, a wired communication path can be established between the two terminal devices.

[0127] In the above-described embodiment, when the first terminal device (1, 1A, 1B, 1C) and the second terminal device (2, 2A, 2B, 2C) come close to each other, a communication path is connected and drawing software or panel software is automatically started (executed). However, this is not a limitation. Suppose the first terminal device (1, 1A, 1B, 1C) and the second terminal device (2, 2A, 2B, 2C) come close to each other and connect a communication path. In this case, for example, when an operation input for drawing is received on one or both of the first terminal device (1, 1A, 1B, 1C) and the second terminal device (2, 2A, 2B, 2C), the drawing software or panel software may be started (executed).

[0128] Furthermore, the second terminal devices (2, 2A, 2B, 2C) have been described as having the configuration of a smartphone or a tablet PC, but are not limited to this. For example, they may be wristwatch-type terminal devices such as smart watches, or various wearable terminals (terminals worn on the user's body) that allow instructions to be input.

[0129] Furthermore, the number of instruction input reception screens used in the second terminal devices (2, 2A, 2B, 2C) is not limited to one, and it is of course possible to prepare multiple instruction input reception screens that receive different information and switch between them according to the user's instructions. This control can be performed by the control circuit 231.

[0130] Furthermore, the operation buttons provided on the second terminal devices (2, 2A, 2B, 2C) can be used like the left and right click buttons of a mouse, which is a pointing device of a personal computer. That is, when a predetermined operation button provided on the second terminal devices (2, 2A, 2B, 2C) is pressed, an item on the display screen 115D of the display device 115 of the first terminal devices (1, 1A, 1B, 1C) can be selected, moved, or executed. Furthermore, when another predetermined operation button provided on the second terminal devices (2, 2A, 2B, 2C) is pressed, a menu of executable functions can be displayed on the first terminal devices (1, 1A, 1B, 1C) and selected.

[0131] Furthermore, the electronic pen is equipped with a side switch, and operation information of this side switch can be transmitted via short-range wireless communication. In this case, the side switch of the electronic pen can be used to operate, for example, the first terminal device (1, 1A, 1B, 1C) like the left and right click buttons of a mouse, which is a pointing device of a personal computer. Of course, information corresponding to the operation of the side switch of the electronic pen can also be used to operate the second terminal device (2, 2A, 2B, 2C). Therefore, whether the operation of the side switch of the electronic pen will operate the first terminal device (1, 1A, 1B, 1C) or the second terminal device (2, 2A, 2B, 2C) can be determined by, for example, setting it in each terminal device by the user.

[0132] Furthermore, the sizes of the display screens of the display devices of the first terminal devices (1, 1A, 1B, 1C) and the second terminal devices (2, 2A, 2B, 2C) are not limited to the embodiment shown in Fig. 1. The first terminal devices (1, 1A, 1B, 1C) and the second terminal devices (2, 2A, 2B, 2C) may have display devices of the same size. Furthermore, the display screen of the display device of the second terminal devices (2, 2A, 2B, 2C) may be larger than the display screen of the display device of the first terminal devices (1, 1A, 1B, 1C). [Explanation of symbols]

[0133] 1, 1A, 1B, 1C...first terminal device, 110...user interface unit, 111...first sensor, 112...first position detection circuit, 113...second sensor, 114...second position detection circuit, 115...display device, 115D...display screen, 116...display control circuit, 120...drawing processing unit, 121...drawing image memory, 122...drawing parameter memory, 123...drawing processing circuit, 130...control unit, 131...control circuit, 132...storage device, 140...connection unit, 141...short-range wireless communication circuit, 141A...short-range wireless communication antenna, 142...proximity determination circuit, 150...panel linkage unit, 151...panel data providing circuit, 152, 152A...instruction information acquisition circuit, 170...electronic pen authentication unit, 2, 2A, 2B, 2C...second terminal device, 210...user interface unit, 211...first sensor, 212...first position detection circuit, 213...second sensor, 214...second position detection circuit, 215...display device, 215D...display screen, 216...display control circuit, 220...drawing processing unit, 221...drawing image memory, 222...drawing parameter memory, 223...drawing processing circuit, 230...control unit, 231...control circuit, 232...storage device, 240...connection unit, 241...short-range wireless communication circuit, 241A...short-range wireless communication antenna, 242...proximity determination circuit, 250...panel linkage unit, 251...panel data acquisition circuit, 252, 252A...instruction information providing circuit, 270...electronic pen authentication unit, 21...wristband, 22...holder

Claims

1. A drawing system configured by a first terminal device having a first display device, and a second terminal device having a second display device and a second position detection sensor corresponding to a display screen of the second display device, which are communicatively connected, The first terminal device an information acquisition unit that acquires instruction information transmitted from the second terminal device; a drawing processing unit that uses the display screen of the first display device as a drawing area and performs drawing in the drawing area in accordance with the instruction information; Equipped with The second terminal device an instruction input reception processing unit that uses the display screen of the second display device as an instruction input area and receives an instruction input by an electronic pen through the second position detection sensor; an information providing unit that transmits information input through the instruction input reception processing unit to the first terminal device; A drawing system comprising:

2. The second terminal device a second receiving means for receiving the identification information of the electronic pen as second identification information; a second identification information providing means for transmitting the second identification information to the first terminal device; Equipped with The first terminal device a first receiving means for receiving identification information of the electronic pen as first identification information; second identification information receiving means for receiving the second identification information from the second identification information providing means; a first authentication control means for connecting a communication path to the second terminal device when the first identification information and the second identification information are the same; The drawing system of claim 1 further comprising:

3. the first terminal device further includes a first position detection sensor corresponding to a display screen of the first display device; the first position detection sensor and the second position detection sensor can be operated by the same electronic pen, The drawing processing unit further sets the display screen of the first display device as a drawing area, and draws on the drawing area with an electronic pen in response to a drawing operation input received through the first position detection sensor.

2. The drawing system according to claim 1.

4. 2. The drawing system according to claim 1, wherein the second position detection sensor of the second terminal device can be touched by a user's finger or the like.

5. The first terminal device a first communication unit that transmits and receives signals wirelessly or via a wire; a connection determination unit that determines whether a connection is possible based on a result of communication through the first communication unit; Equipped with The second terminal device a second communication unit that transmits and receives signals wirelessly or via a wire; a connection determination unit that determines whether a connection is possible based on a result of communication through the second communication unit; The drawing system according to claim 1 , further comprising:

6. The first terminal device a first operation unit for starting communication through the first communication unit; The drawing system according to claim 5, characterized in that, when the first operation unit is operated, the first communication unit starts a communication process to connect a communication path between the first operation unit and the second communication unit of the second terminal device.

7. The second terminal device a second operation unit for starting communication through the second communication unit; The drawing system according to claim 5, characterized in that, when the second operation unit is operated, the second communication unit starts a communication process to connect a communication path between the second operation unit and the first communication unit of the first terminal device.

8. 2. The drawing system according to claim 1, wherein the second terminal device includes a mounting fixture for mounting the second terminal device on the user's body.

Citation Information

Patent Citations

  • Coordinate input control method

    JP2005011233A