Display device, display method, program

Abstract

To provide a display device which displays different identification information.SOLUTION: A display device 2 which can communicate with a terminal device 30 comprises: a display control unit which displays different first identification information every time preset timing elapses; and a communication unit which receives second identification information input to the terminal device from the terminal device. The communication unit communicates with the terminal device when the first identification information coincides with the second identification information, and limits communication with the terminal device when the first identification information does not coincide with the second identification information.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a display device, a display method, and a program.

Background Art

[0002] There is known a display device that displays data handwritten on a touch panel by an input means such as a pen or a finger. A display device equipped with a relatively large touch panel is arranged indoors or outdoors and is used as an electronic blackboard or the like by a plurality of users.

[0003] There is known a technique for linking two devices (see, for example, Patent Document 1). Patent Document 1 discloses a technique in which a linking code is displayed on a dynamic display of a medical device, and when a portable device located within a predetermined range with respect to the medical device reads the linking code, pairing is performed for the medical device to respond to an instruction transmitted from the portable device.

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, the conventional technology has a problem that the identification information to be displayed is the same every time. If the linking code displayed on the dynamic display is the same every time, there is a risk that the linking code will be leaked and paired with a portable device not located within a predetermined range with respect to the medical device.

[0005] In view of the above problems, an object of the present invention is to provide a display device that displays different identification information.

Means for Solving the Problems

[0006] In view of the above problems, the present invention is a display device capable of communicating with a terminal device, and includes a display control unit that displays different first identification information every time a preset timing elapses, and a communication unit that receives second identification information input to the terminal device from the terminal device Let and The system includes a location information receiving unit that acquires location information from the terminal device when the first identification information and the second identification information match.The communication unit communicates with the terminal device if the first identification information and the second identification information match, and restricts communication with the terminal device if they do not match. The location information receiving unit has a display control unit that displays the location information it receives, and the character recognition unit converts handwritten data entered by the input means into string candidates. When the character recognition unit converts the handwritten data into "current location," "place," "location information," or their hiragana or katakana equivalents, the display control unit displays the location information it received from the location information receiving unit as the string candidate. It is characterized by the following: [Effects of the Invention]

[0007] A display device that shows different identification information can be provided. [Brief explanation of the drawing]

[0008] [Figure 1] This is a schematic diagram illustrating the procedure by which a display device acquires location information. [Figure 2] This is an example of a schematic diagram of a display system. [Figure 3] This is an example of a hardware configuration diagram for a display device. [Figure 4] This is an example of a hardware configuration diagram for a terminal device. [Figure 5] This is an example of a functional block diagram that explains the functions of a display device and a terminal device by dividing them into blocks. [Figure 6] This figure shows an example of an operation guide and the selectable options displayed by the operation guide. [Figure 7] This figure shows an example of an input screen displayed by a display device. [Figure 8] This figure shows an example of a PIN input screen displayed by a terminal device connected to a display device. [Figure 9] This figure shows an example of a menu list screen displayed by a terminal device. [Figure 10] This is an example of a sequence diagram illustrating the process from when a display device receives location information from a mobile device. [Figure 11] This is an example of a flowchart illustrating the process a display device performs when it receives location information. [Figure 12] This figure shows an example of a location information notification screen displayed by the display device when location information is saved when the power is turned on in step S2 of Figure 11. [Figure 13] It is a diagram showing an example of an update execution confirmation screen displayed in step S6 of FIG. 11. [Figure 14] It is a diagram showing an example of a movement detection screen when movement is detected by an acceleration sensor, which is displayed in step S9 of FIG. 11. [Figure 15] It is a diagram showing an example of a save selection screen displayed when display data is saved, which is displayed in step S11 of FIG. 11. [Figure 16] It is a diagram for explaining the display of position information based on handwritten data by a prediction conversion function. [Figure 17] It is an example of a flowchart diagram for explaining the processing of a display device when a user handwrites "current location", "location", "position information", etc. [Figure 18] It is a diagram showing an example of the display of a position information mark indicating that the display device has already saved position information. [Figure 19] It is an example of a flowchart diagram for explaining the procedure for the display control unit to display a position information mark. [Figure 20] It is a diagram for explaining character recognition when two or more display devices are connected. [Figure 21] It is an example of a right side view of the display device of the present embodiment. [Figure 22] It is an example of a system configuration diagram when a display device is connected. [Figure 23] It is an example of a flowchart diagram for explaining the procedure for connected display devices to share position information.

Mode for Carrying Out the Invention

[0009] Hereinafter, as an example of a mode for carrying out the present invention, a display device and a display method performed by the display device will be described with reference to the drawings.

[0010] <Regarding the display device and position information> For the sake of convenience in explaining the display device of the present embodiment, the display device and the position information will be described. The display device described in the present embodiment may be carried to an outdoor construction site, a disaster site, etc., and may be used for purposes such as work progress management and disaster response. The display device is also equipped with a wireless function and can be used for applications such as remotely communicating with multiple sites and headquarters to share information. Further, when an electronic paper is adopted for the display of the display device, the power consumption is low, so it is easy to secure power (operable by battery) at a construction site, a disaster site, etc.

[0011] However, if the display device does not have a GNSS (Global Navigation Satellite System) in the main body, the position information cannot be obtained. Similar to a smartphone, if it has a built-in SIM card and can communicate with a mobile phone base station via 3G, 4G, 5G, etc., position measurement by radio wave positioning is possible, but there are many display devices that cannot install a SIM card.

[0012] In order to equip with strength, waterproof and dustproof functions assumed for use at a construction site, a disaster site, etc. (hereinafter referred to as on-site use), it is impossible to provide an antenna slit or an external antenna connector, so it is difficult to provide a GNSS antenna or the like. In addition, since the communication between the GNSS positioning satellite and the mobile phone base station has a large current consumption, the advantage of low power consumption, which is the merit of the electronic paper, cannot be fully utilized.

[0013] If the display device cannot detect the position, accurate position information cannot be recorded at the site. Also, when the user searches for the display data (including the information handwritten on the display device) stored on the display device or in the cloud, the search cannot be performed from the position information, and it is necessary to check the file name and the handwritten data to search.

[0014] If the display device can acquire location information, it will be possible to associate location information with a certain degree of accuracy with the displayed data at disaster sites, construction sites, etc., where the address is uncertain. This will allow headquarters and each site to confirm the accurate location information of each other during remote meetings connecting headquarters and the field. In addition, by associating location information with the displayed data, it will be possible to search for the displayed data based on the location information when finding relevant data from a large amount of saved displayed data.

[0015] <Method for obtaining location information of a display device> Figure 1 is a schematic diagram illustrating the procedure by which the display device 2 acquires location information. The display device 2 and the terminal device 30 have communication functions via Wi-Fi (wireless LAN) and Bluetooth (registered trademark). The terminal device 30 has a location detection function using GNSS.

[0016] (1) The display device 2 preferably displays a different PIN (Personal Identification Number) each time it is started.

[0017] (2) The user of terminal device 30 enters a PIN into terminal device 30.

[0018] (3) The terminal device 30 transmits the PIN to the display device 2.

[0019] (4) The display device 2 verifies whether the received PIN (an example of the second identification information) matches the displayed PIN (an example of the first identification information). If they match, it receives location information from the terminal device 30 and stores it as the current location information.

[0020] Therefore, even if the display device 2 cannot communicate with GNSS or a mobile phone base station, it can save the current location information by receiving location information from the terminal device 30 connected via Wi-Fi or the like.

[0021] Furthermore, since the PIN displayed by the display device 2 is changed at predetermined intervals, it is guaranteed that the terminal device 30 into which the PIN is entered is within sight of the display device 2's screen, making it possible to obtain more accurate location information that is closer to the display device 2.

[0022] <About Terminology> An input method can be any means that allows handwriting by specifying coordinates on a touch panel. Examples include a pen, a person's finger or hand, or a rod-shaped object. A stroke is a series of operations in which the user presses the input method against the display, moves it continuously, and then lifts it off the display.

[0023] Stroke data refers to information displayed on a screen based on the trajectory of coordinates entered via an input device. Stroke data may be interpolated as appropriate. Handwritten data is called stroke data. Handwritten data, when it has one or more stroke data points, is sometimes referred to as an object when it is displayed on a screen based on that stroke data.

[0024] A string is one or more character codes converted from handwritten data. Characters include numbers, letters, and symbols.

[0025] The pre-configured timing refers to the timing for changing the PIN, and is set on the display device 2 by the administrator or other relevant party. The pre-configured timing can be, for example, each time the display device 2 is started up, after a certain period of time has elapsed, at a time instructed by the user, or at the time the displayed PIN is used (sent from the terminal device).

[0026] Location information is information that allows the user to know where the display device is located. Location information can be, for example, an address, but it can also be coordinates, a landmark, a regional name, a building name, a building and floor number, or a building and room number.

[0027] The identification information displayed by the display device is information that ensures communication with a terminal device carried by a user within the display device's line of sight. In this embodiment, this information is referred to as a PIN.

[0028] <Example System Configuration> Referring to Figure 2, the configuration of the display system 100 will be described. Figure 2 is an example of a schematic configuration diagram of the display system 100. The display system 100 has a display device 2, and the display device 2 and the terminal device 30 communicate wirelessly over short range. The wireless communication method may be, for example, Wi-Fi (wireless LAN), Bluetooth (registered trademark), infrared communication, visible light communication, or IC card communication. In the case of Wi-Fi, the communication method may be ad-hoc mode or infrastructure mode.

[0029] Display device 2 displays data handwritten on the touch panel using input means such as a pen or finger. The display device 2 in this embodiment is expected to be equipped with a large display for use by multiple people on-site and to be used as an electronic whiteboard. The display device 2 is not expected to have a location detection function (such as GNSS or communication function with a mobile phone base station), but it may have one. In this case, the display device 2 will not use its own location detection function to reduce power consumption and will use the same location information as the terminal device 30. Furthermore, the display device 2 can be any device that has a touch panel and short-range wireless communication function. For example, the display device 2 may be a tablet terminal, a notebook PC (Personal Computer), a PDA (Personal Digital Assistant), a game console, etc.

[0030] Alternatively, the display device 2 may be implemented using a projector and a whiteboard without a touch panel. In this case, the projector detects the contact position of the input means using a camera or sensor.

[0031] The display device 2 automatically or in response to user input displays the SSID and PIN required by the terminal device 30 for Wi-Fi communication. By entering at least the PIN into the terminal device 30, the terminal device 30 can communicate with the display device 2 via Wi-Fi.

[0032] Furthermore, display device 2 can be linked with other display devices 2 in a tile-like manner. Since almost the entire display device 2, excluding the bezel, is a display, when multiple display devices 2 are linked, the user can use a larger screen. Display device 2 and other display devices 2 communicate data using infrared interfaces provided on each other's sides, and display data by treating the two displays as a single display. For example, multiple linked display devices 2 can display large drawings without scaling them down. Display device 2 and other display devices 2 can not only display data by treating the two displays as a single display, but can also display the same content on the two displays or display different pages.

[0033] In Figure 2, two display devices 2 are connected, but there are also cases where three or more display devices 2 are connected.

[0034] Terminal device 30 is an information processing device having a location detection function and a wireless communication function. Terminal device 30 is used for PIN input and location detection. Terminal device 30 is, for example, a smartphone, but may also be an imaging device (digital camera), tablet terminal, notebook PC, mobile phone, game console, PDA, wearable PC, etc.

[0035] The terminal device 30 has a web browser and a dedicated application installed for communication with the display device 2. The user launches these and sends location information to the display device 2.

[0036] <Device Hardware Configuration> Next, the hardware configuration of the display device 2 will be explained using Figure 3. As shown in the figure, the display device 2 has the configuration of an information processing device or a computer. Figure 3 is an example of a hardware configuration diagram of the display device 2. As shown in Figure 3, the display device 2 is equipped with a CPU (Central Processing Unit) 201, ROM (Read Only Memory) 202, RAM (Random Access Memory) 203, and SSD (Solid State Drive) 204.

[0037] Of these components, the CPU 201 controls the overall operation of the display device 2. The ROM 202 stores programs used to drive the CPU 201, such as the IPL (Initial Program Loader). The RAM 203 is used as the work area for the CPU 201. The SSD 204 stores various data, such as the OS and programs for the display device 2, although this data may also be stored in the ROM 202. This program may also be an application program that runs on an information processing device equipped with a general-purpose OS (such as Windows®, Mac OS®, Android®, iOS®, etc.). In other words, the display device 2 may also be an information processing device.

[0038] The display device 2 also includes a display controller 213, a touch sensor controller 215, a touch sensor 216, a display 220, a power switch 227, a tilt sensor 217, a serial interface 218, a speaker 219, a microphone 221, a wireless communication device 222, an infrared interface 223, a power control circuit 224, an AC adapter 225, a battery 226, and an acceleration sensor 228.

[0039] The display controller 213 controls and manages the screen display in order to output the output image to the display 220, etc. The touch sensor 216 detects when the pen 2500 or the user's hand (the pen or the user's hand serves as an input means) touches the display 220. The touch sensor 216 also receives the pen ID.

[0040] The touch sensor controller 215 controls the processing of the touch sensor 216. The touch sensor 216 performs coordinate input and coordinate detection. The method of this coordinate input and coordinate detection will be described below. For example, in the case of an optical system, two light-receiving devices installed at both ends of the upper side of the display 220 emit multiple infrared rays parallel to the display 220. The infrared rays are reflected by reflective members provided around the display 220. The light-receiving element receives the light that returns along the same optical path as the emitted light.

[0041] The touch sensor 216 outputs infrared position information emitted by two light-emitting / receiving devices that are blocked by an object to the touch sensor controller 215, which then identifies the coordinate position of the object's contact point. The touch sensor controller 215 also has a communication unit 215a that can communicate wirelessly with the pen 2500. For example, if communication is using a standard such as Bluetooth (registered trademark), commercially available pens can be used. If one or more pens 2500 are registered in advance with the communication unit 215a, the user can communicate with the display device 2 without having to perform connection settings to connect the pen 2500 to the display device 2.

[0042] The power switch 227 is a switch for turning the power of the display device 2 ON / OFF. The tilt sensor 217 is a sensor for detecting the tilt angle of the display device 2. The tilt sensor 217 may have the same function as the acceleration sensor 228. It is mainly used to detect whether the display device 2 is being used in a vertical, horizontal, or horizontal installation state, and the thickness of characters, etc. can be automatically changed according to the installation state.

[0043] The serial interface 218 is a communication interface with external devices such as USB and LAN interfaces. The serial interface 218 is used for inputting information from external sources. The speaker 219 is used for audio output, and the microphone 221 is used for audio input. The wireless communication device 222 communicates with the user's portable terminal and relays connections to the internet, for example. The wireless communication device 222 communicates using Wi-Fi or Bluetooth (registered trademark), but the communication standard is not specified. The wireless communication device 222 forms an access point, and when the user sets the SSID (Service Set Identifier) ​​and password obtained by the user on the user's portable terminal, the user can connect to the access point.

[0044] It is preferable that the wireless communication device 222 has two access points. a. Access point → Internet b. Access point → Internal network → Internet Access point a is for external users; users cannot access the internal network but can use the internet. Access point b is for internal users; users can use both the internal network and the internet.

[0045] The infrared interface 223 detects the adjacent display device 2. The infrared interface 223 can detect only the adjacent display device 2 by utilizing the straight-line propagation of infrared light. Preferably, one infrared interface 223 is provided on each side, so that it is possible to detect in which direction the other display device 2 is located (in this embodiment, they are provided on three sides). The adjacent display device 2 can display handwritten data that has been previously written (handwritten data from another page, with the area of ​​one display 220 being considered one page).

[0046] The power control circuit 224 controls the AC adapter 225 and battery 226, which are the power sources for the display device 2. The AC adapter 225 converts the alternating current supplied by the commercial power supply to direct current.

[0047] If the display 220 is so-called electronic paper, it consumes little to no power to maintain the image after it has been drawn, so it can be powered by a battery 226. This makes it possible to use the display device 2 for applications such as digital signage even in places where it is difficult to connect to a power source, such as outdoors.

[0048] Furthermore, the display device 2 is equipped with a bus line 210. The bus line 210 is an address bus, data bus, etc., for electrically connecting each component, such as the CPU 201 shown in Figure 3.

[0049] The touch sensor 216 is not limited to optical; it may also be a capacitive touch panel that identifies the contact position by detecting changes in capacitance. The touch sensor 216 may also be a resistive touch panel that identifies the contact position by voltage changes between two opposing resistive films. The touch sensor 216 may also use various detection means, such as an electromagnetic induction touch panel that identifies the contact position by detecting electromagnetic induction caused by contact between an object and the display.

[0050] The touch sensor 216 does not require an electronic pen to detect whether or not the pen tip is touching the surface. In this case, a fingertip or a pen-shaped stick can be used for touch operation. The pen 2500 does not need to be a long, slender pen shape.

[0051] The accelerometer 228 detects acceleration in the display device 2, at least in the horizontal direction. That is, the accelerometer 228 can detect acceleration in a direction horizontal to the ground surface, enabling the determination of whether or not movement is occurring. The accelerometer 228 may also function as the tilt sensor 217. Please note that the configuration of this display device 2 is merely an example and is not limited to this configuration.

[0052] <<Terminal device>> Figure 4 is a hardware configuration diagram of the terminal device 30. As shown in Figure 4, the terminal device 30 includes a CPU 401, ROM 402, RAM 403, EEPROM 404, CMOS sensor 405, image sensor I / F 406, acceleration / direction sensor 407, media I / F 409, and GPS receiver 411.

[0053] Of these, the CPU 401 controls the operation of the entire terminal device 30. The ROM 402 stores programs used to drive the CPU 401, such as IPLs. The RAM 403 is used as the work area for the CPU 401. The EEPROM 404 reads or writes various data, such as programs for the terminal device 30, according to the control of the CPU 401. The CMOS (Complementary Metal Oxide Semiconductor) sensor 405 is a type of built-in imaging means that captures an image of a subject (mainly a self-portrait) according to the control of the CPU 401 to obtain image data. Note that the CMOS sensor may be an imaging means such as a CCD (Charge Coupled Device) sensor. The image sensor I / F 406 is a circuit that controls the driving of the CMOS sensor 405. The acceleration / direction sensor 407 is a type of sensor such as an electronic magnetic compass, gyrocompass, or acceleration sensor that detects the Earth's magnetic field. The media I / F 409 controls the reading or writing (storage) of data to or from the recording medium 408, such as flash memory. The GPS receiver 411 receives GPS signals from GPS satellites.

[0054] Furthermore, the terminal device 30 includes a long-range communication circuit 412, a CMOS sensor 413, an image sensor interface 414, a microphone 415, a speaker 416, an audio input / output interface 417, a display 418, an external device connection interface 419, a short-range communication circuit 420, an antenna 420a for the short-range communication circuit 420, and a touch panel 421.

[0055] Of these, the long-range communication circuit 412 is a circuit that communicates with other devices via a communication network. The CMOS sensor 413 is a type of built-in imaging means that captures an image of a subject and obtains image data according to the control of the CPU 401. The image sensor interface 414 is a circuit that controls the driving of the CMOS sensor 413. The microphone 415 is a built-in circuit that converts sound into electrical signals. The speaker 416 is a built-in circuit that converts electrical signals into physical vibrations to produce sound such as music and speech. The sound input / output interface 417 is a circuit that processes the input and output of sound signals between the microphone 415 and the speaker 416 according to the control of the CPU 401. The display 418 is a type of display means such as liquid crystal or organic EL (electroluminescence) that displays images of the subject and various icons. The external device connection interface 419 is an interface for connecting various external devices. The short-range communication circuit 420 is a communication circuit such as NFC (Near Field Communication) or Bluetooth (registered trademark). The touch panel 421 is a type of input method that allows the user to operate the smartphone 4 by pressing the display 418.

[0056] Furthermore, the terminal device 30 is equipped with a bus line 410. The bus line 410 is an address bus, data bus, etc., for electrically connecting each component, such as the CPU 401 shown in Figure 4.

[0057] <About the features> Next, the functions of the display device 2 and the terminal device 30 will be explained using Figure 5. Figure 5 is an example of a functional block diagram that explains the functions of the display device 2 and the terminal device 30 by dividing them into blocks.

[0058] <<Display device>> The display device 2 includes a contact position detection unit 11, a drawing data generation unit 12, a character recognition unit 13, a display control unit 14, a data recording unit 15, a communication unit 16, an operation reception unit 17, a verification unit 18, a web server function unit 19, a location information reception unit 20, a movement detection unit 21, a connection detection unit 22, and an inter-display device communication unit 23. Each function of the display device 2 is a function or means realized by any of the components shown in Figure 3 operating according to instructions from the CPU 201 in accordance with a program deployed from the SSD 204 onto the RAM 203.

[0059] The contact position detection unit 11 detects the coordinates of the position where the pen 2500 makes contact with the touch sensor 216. The drawing data generation unit 12 obtains the coordinates of the contact point of the pen tip of the pen 2500 from the contact position detection unit 11. The drawing data generation unit 12 connects these coordinate points by interpolation to generate stroke data.

[0060] The character recognition unit 13 performs character recognition processing on one or more stroke data (handwritten data) written by the user and converts them into character codes. The character recognition unit 13 recognizes characters (not only Japanese but also multiple languages ​​such as English), numbers, symbols (%), $, &, etc., shapes (lines, circles, triangles, etc.) in parallel with the user's pen operation. Various algorithms have been devised for recognition methods, but in this embodiment, known technology can be used, so the details are omitted.

[0061] The display control unit 14 displays handwritten data, strings converted from handwritten data, and operation menus for the user on the display.

[0062] The data recording unit 15 stores handwritten data, converted strings, and PC screens, files, etc., written on the display device 2 in the display data storage unit 2001. Handwritten data, strings (including graphics), images such as PC screens, files, etc., are treated as display data. For handwritten data, a set of stroke data becomes one display data according to temporal divisions due to interruptions in handwriting and spatial divisions due to differences in handwriting location. In this embodiment, the data recording unit 15 can store location information in association with the display data.

[0063] The communication unit 16 communicates with the terminal device 30 via short-range wireless communication such as Wi-Fi. The communication unit 16 can also communicate by connecting to a wired LAN. Furthermore, the communication unit 16 can connect to the internet by utilizing the communication function with the mobile phone base station of the terminal device 30 (the terminal device 30 must support tethering). The communication unit 16 can share handwritten data, converted strings, PC screens, files, etc. with other display devices 2 located at other locations.

[0064] The verification unit 18 issues a different PIN each time a predetermined interval has elapsed, and determines whether the PIN received by the communication unit 16 matches the issued PIN. If they match, it determines whether communication with the terminal device 30 is possible, or whether the location information received from the terminal device 30 can be associated with the display data and saved. The predetermined timing may be each time the display device 2 is started up, after a certain period of time has elapsed, at a timing instructed by the user, or at the timing when the displayed PIN is used (transmitted from the terminal device).

[0065] The Web server function unit 19 provides the terminal device 30 with the functionality of a Web server (also called an HTML server or WWW server). That is, the Web server function unit 19 interprets HTTP requests sent from the terminal device 30 and sends an HTTP response (Web page). This allows the terminal device 30 to display the Web page. The Web server function unit 19 may also run a Web application. While a Web page is only a static Web document, a Web application can dynamically change the displayed data in response to user requests.

[0066] When the location information receiving unit 20 acquires location information from the terminal device 30 or another display device 2, it stores it in the location information storage unit 2002. The location information receiving unit 20 also performs tasks such as determining if the location information is identical.

[0067] The movement detection unit 21 determines whether the display device 2 has been moved based on the signal output by the acceleration sensor 228. The movement detection unit 21 integrates the acceleration generated in the horizontal direction to convert it into velocity, and detects the amount of movement from the product of velocity and time.

[0068] The coupling detection unit 22 determines that two or more display devices 2 are coupled together when the infrared interface 223 detects a display device 2 located next to it. The coupling detection unit 22 can also detect where the other display devices 2 are coupled to.

[0069] The inter-display unit 23 communicates with other display devices 2 via the infrared interface 223. In this embodiment, location information is shared via the inter-display unit 23, but it may also be shared via the server 9 described later.

[0070] Furthermore, the display device 2 has a storage unit 2000 which is built on an SSD 204 or RAM 203 as shown in Figure 3, and the storage unit 2000 has a display data storage unit 2001 and a location information storage unit 2002 built on it.

[0071] [Table 1] Table 1 schematically shows the display data held by the display data storage unit 2001. The display data consists of various types of data displayed by the display device 2.

[0072] • The data ID is an identifier that identifies the displayed data.

[0073] The "type" refers to the type of display data, which includes handwritten text, characters, shapes, images, etc. Handwritten text is stroke data (a sequence of coordinate points). Characters are strings of characters (character codes) converted from handwritten data. Strings of characters are sometimes also called text data. Shapes are geometric shapes such as triangles and squares converted from handwritten data. Images are image data such as JPEG, PNG, and TIFF imported from PCs or the internet.

[0074] Each screen of display device 2 is referred to as a page. The item on a page is its page number.

[0075] The coordinates indicate the position of the display data relative to a predetermined origin of the display device 2. The position of the display data is, for example, the top-left vertex of the bounding rectangle of the display data. The coordinates are expressed, for example, in pixels of the display.

[0076] • The size is the width and height of the bounding rectangle of the displayed data.

[0077] • Location information is the location information saved for each page when it is saved. Preferably, the location information is converted to an address, but it may also be in the form of coordinates, etc.

[0078] [Table 2] Table 2 schematically shows the location information held by the location information storage unit 2002. Note that location information may not be stored in some cases.

[0079] <<Terminal device>> The terminal device 30 includes a location information acquisition unit 31, a display control unit 32, an operation reception unit 33, and a communication unit 34. Each function of the terminal device 30 is a function or means realized by any of the components shown in Figure 4 operating according to instructions from the CPU 401 based on a program deployed from the EEPROM 404 onto the RAM 403. This program may be either a web browser or a dedicated application for the display device 2.

[0080] The communication unit 34 communicates with the display device 2 using short-range wireless communication such as Wi-Fi. The terminal device 30 can also communicate with a mobile phone base station and can connect to the internet via a gateway.

[0081] The display control unit 32 retrieves web pages and web applications from the web server function within the display device 2 and displays them on the display. The operation reception unit 33 receives operations on the terminal device 30, such as web pages and web applications.

[0082] The location information acquisition unit 31 detects the position (coordinates) of the terminal device 30 based on signals received from positioning satellites operating under GNSS. The location information acquisition unit 31 may also detect the position based on the strength of radio waves transmitted by a mobile phone base station. If the display device 2 is indoors, the location information acquisition unit 31 can acquire location information using IMES (Indoor Messaging System).

[0083] <Example of displaying selectable options> Next, with reference to Figure 6, we will explain the operation guide 500 displayed by character recognition. Note that the string candidates 539 displayed by the operation guide 500 vary depending on the dictionary. Since dictionaries are prepared according to the specific site and application, the following is merely one example.

[0084] Figure 6 shows an example of an operation guide and the selectable candidates 530 displayed by the operation guide. The operation guide 500 is displayed when the user writes handwritten data 504 (due to a timeout of the timer that measures the time since the pen was lifted). The operation guide 500 has an operation header 520, operation command candidates 510, handwritten recognition string candidates 506, converted string candidates 507, string / predictive conversion candidates 508, and a handwritten data rectangular area display 503. The selectable candidates 530 are the operation command candidates 510, handwritten recognition string candidates 506, converted string candidates 507, and string / predictive conversion candidates 508. The selectable candidates 530 excluding the operation command candidates 510 are called string candidates 539.

[0085] The operation header 520 has buttons 501, 509, 502, and 505. Button 501 accepts switching operations between predictive text and "kana conversion". Button 502 accepts page operation for candidate display. In the example in Figure 6, there are 3 pages of candidate display, and currently the first page is displayed. Button 505 accepts the deletion of the operation guide 500. When the user presses button 505, the contact position detection unit 11 receives the notification and notifies the display control unit 14, and the display control unit 14 deletes the display other than the handwritten data 504.

[0086] Button 509 accepts a request to erase all displays at once. When the user presses button 509, the contact position detection unit 11 receives the request and notifies the display control unit 14, which then erases all displays shown in Figure 6, including handwritten data, allowing the user to start writing again from the beginning.

[0087] The handwritten data 504 is the character "ぎ" written by the user. A handwritten data rectangular area display 503 is displayed surrounding the handwritten data 504. In the example in Figure 6, the handwritten data rectangular area display 503 is displayed with a dotted line frame. The handwritten data 504 is recognized in real time, and the string candidates 539 are arranged in descending order of probability.

[0088] For the handwritten recognition string candidates 506, the converted string candidates 507, and the string / predicted conversion candidates 508, the respective string candidates are arranged in descending order of probability. The "gi" in the handwritten recognition string candidates 506 is a candidate for the recognition result. In this example, the display device 2 correctly recognizes "gi". The converted string candidates 507 are string candidates that include "gi" or, when "gi" is converted to a Chinese character, "gi" or the string containing this Chinese character. In this example, "Giryoushitei" is an abbreviation of "Gijutsuryou-sangyoushisaku". The string / predicted conversion candidates 508 are string candidates that are generated from the handwritten recognition string candidates 506 or the converted string candidates 507 and are expected to be selected by the user. The string / predicted conversion candidates 508 do not necessarily have to include "gi" or "the Chinese character converted from gi".

[0089] The operation command candidates 510 are candidates for operation commands. An operation command is an instruction for the display device 2. In the example of FIG. 6, the leading character "》" 511 indicates that it is a candidate for an operation command. The operation command is associated in advance with the handwritten recognition string candidates 506 and the converted string candidates 507, and is displayed when the associated handwritten recognition string candidates 506 and converted string candidates 507 are displayed. In FIG. 6, "Gijiroku", which is a string candidate for "gi", is associated with an operation command. Thus, since the operation command candidates 510 are displayed when operation command definition data including the converted string is found, they are not always displayed.

[0090] <Example of the screen of the display device> FIG. 7 shows an example of an input screen 600 displayed by the display device 2. The input screen 600 mainly has a handwritten area 601, a menu button 602, a zoom / pan window display 603, a page number display 604, a page navigation display 605, and an information display area 606.

[0091] The handwritten area 601 is an area where the user can arbitrarily write by the pen 2500. The handwritten data is automatically converted into a string. The handwritten data may be converted into a string by the user's operation.

[0092] The menu button 602 displays icons for the user to select options such as line type 602a, line color 602b, undo 602c, redo 602d, ghost removal 602e, rotation 602f, handwriting recognition 602g, and delete 602h for handwritten data. • Line type 602a for handwritten data is an icon that accepts changes to the line type (thickness, solid / dotted line, etc.) of the handwritten data. • Line color 602b is an icon that accepts color changes for handwritten data. Note that in the case of e-paper, monochrome is the mainstream, so color differences are represented by line type. • Cancel 602c is an icon that accepts the cancellation of the last entered operation. • Redo 602d is an icon that accepts the request to perform an action that was previously undone. • Ghost Removal 602e is an icon that accepts the operation to reset the entire screen and redisplay the display data before pressing Ghost Removal 602e in order to remove ghosting (gray traces of display data that remain because they cannot be completely erased) that occurs on e-paper. Rotate 602f is an icon that accepts the operation of rotating the screen in 90-degree increments. • The 602g handwriting recognition icon accepts character recognition for handwritten data. The delete icon (602h) accepts the action of deleting (moving to the trash) the currently displayed page or a part of it.

[0093] The zoom-pan window display 603 is an icon that accepts operations to zoom (enlarge) and pan (reduce) the handwriting area.

[0094] The page number 604 indicates which page the current handwritten data is on.

[0095] Page Navigation Display 605 is a button that displays thumbnails of each page at the right edge of the handwriting area.

[0096] Information display area 606 is an area that displays today's date 606a, time 606b, IP address 606c, SSID 606d, PIN 606e, etc. The IP address 606c is the IP address for the terminal device 30 to connect to the display device 2. The SSID 606d is the identifier of the access point provided by the display device 2. The PIN 606e is the encryption key (password) for the terminal device 30 to connect to the access point. The PIN 606e may be displayed separately from the encryption key (password). Security can be improved by using different encryption keys and PINs.

[0097] The user enters this IP address 606e into a web browser running on terminal device 30. The user can also transmit the IP address 606e to a user in a remote location, enabling remote conferencing with another display device 2 or linked display with an adjacent display device 2.

[0098] <Example of terminal device screen> Figure 8(a) shows an example of a PIN input screen 610 displayed by a terminal device 30 connected to the display device 2. Since the PIN input screen 610 varies depending on the terminal device 30, Figure 8(a) is just one example. The PIN input screen 610 includes an SSID field 611, a PIN input field 612, a send button 613, and a cancel button 614. When a user enters a PIN in the PIN input field 612 and presses the send button 613, the terminal device 30 can connect to the display device 2 via Wi-Fi, using it as an access point.

[0099] As shown in Figure 8(b), the user may be prompted to enter a PIN after the display device 2 and the terminal device 30 have communicated via Wi-Fi or the like. Figure 8(b) is a modified example of the PIN input screen 610. When the above IP address is entered into the web browser of the terminal device 30 connected to the display device 2, the terminal device 30 displays the PIN input screen 620.

[0100] The PIN input screen 620 has a PIN input field 622, a submit button 623, and a cancel button 624. When the user enters a PIN in the PIN input field 622 and presses the submit button 623, PIN authentication is performed.

[0101] In this embodiment, we will describe a case where the terminal device 30 communicates via Wi-Fi using the display device 2 as an access point via PIN input, as shown in Figure 8(a).

[0102] As shown in Figure 9, after the terminal device 30 starts communicating via Wi-Fi, when the user enters an IP address into a web browser, the terminal device 30 is redirected to the web server function unit 19 of the display device 2 and displays the menu list screen 630. Figure 9 is an example of the menu list screen 630 displayed by the terminal device 30. The menu list screen 630 displays a menu list.

[0103] The location information transmission menu 631 is a menu for the terminal device 30 to transmit its location information to the display device 2. When the user presses the location information transmission menu, the location information acquisition unit 31 acquires the location information or transmits the last acquired location information to the display device 2.

[0104] The upload menu 632 is a menu for uploading files from the terminal device 30 to the display device 2.

[0105] Download menu 633 is a menu for downloading the screen displayed by display device 2 and saving it as a PDF file.

[0106] The viewer 634 is a menu that allows the terminal device 30 to display the screen shown by the display device 2 in real time. Users can view the screen even when they are in a different location from the display device 2, and can also view handwritten data as it is added to the terminal device 30.

[0107] The remote control 635 is a menu that allows the user to operate functions such as ghost removal, rotation, handwriting recognition, and deletion on the terminal device 30.

[0108] Administrator setting 636 is a menu for configuring settings that require administrator privileges, such as the SSID and the number of digits in the PIN.

[0109] <Operating Procedure> Next, based on Figure 10, we will explain the overall flow from when the terminal device 30 communicates with the display device 2, to when the display device 2 receives location information from the mobile terminal.

[0110] Figure 10 is an example of a sequence diagram illustrating the process from when the display device 2 receives location information from a mobile terminal.

[0111] S101: The verification unit 18 of the display device 2 preferably issues a different PIN 606e each time it starts up when the power is turned on, and the display control unit 14 displays it. The PIN 606e does not necessarily have to be different each time. The PIN 606e may also be issued using the date and time. The user can predict the PIN to some extent.

[0112] S102: The user enters the PIN 606e on the PIN input screen 610 and presses the send button 613. The operation reception unit 33 of the terminal device 30 receives the operation.

[0113] S103: The communication unit 34 of the terminal device 30 transmits PIN 606e to the display device 2. The communication unit 16 of the display device 2 receives PIN 606e and verifies whether the PIN displayed by the verification unit 18 matches the received PIN. In Figure 10, it is assumed that they match. As a result, the terminal device 30 is connected to the access point of the display device 2. The communication unit 11 communicates with the terminal device 30. If the verification unit 18 determines that the displayed PIN and the received PIN do not match, the communication unit 16 restricts communication with the terminal device 30. Restriction means, for example, allowing the communication of the PIN but not sending or receiving other information.

[0114] S104: The user enters the IP address 606c of the display device 2 into the web browser. The operation reception unit 33 of the terminal device 30 receives the operation.

[0115] S105~S107: When the communication unit 34 of the terminal device 30 connects to an IP address, the communication unit 16 of the display device 2 redirects the terminal device 30 to the Web server function unit 19. This allows the display device 2 to improve security by switching from http to https communication.

[0116] S108: The Web server function unit 19 of the display device 2 transmits the screen information of the menu list screen 630 to the terminal device 30 via the communication unit 16. The communication unit 34 of the terminal device 30 receives the screen information of the menu list screen 630, and the display control unit 32 displays it.

[0117] S109: The user presses the location information transmission menu 631 on the menu list screen 630. The operation reception unit 33 of the terminal device 30 receives the operation.

[0118] S110: The location information acquisition unit 31 of the terminal device 30 acquires the current location information. If communication with positioning satellites is difficult, the location information acquisition unit 31 may read the last acquired location information. In this case, the location information acquisition unit 31 may ask the user whether to use the last acquired location information.

[0119] S111: The communication unit 34 of the terminal device 30 transmits location information to the display device 2. The location information receiving unit 20 of the display device 2 receives the location information via the communication unit 16.

[0120] With the above steps, the display device 2 has successfully acquired the location information of the terminal device 30. Detailed processing when the display device 2 receives location information will be explained in Figure 11.

[0121] Figure 11 is a flowchart illustrating the process that the display device 2 performs when it receives location information.

[0122] When the display device 2 is powered on, the location information receiving unit 20 determines whether or not location information has already been saved (S1). That is, the location information receiving unit 20 determines whether or not location information has already been saved in the location information storage unit 2002.

[0123] If location information has been saved, the display control unit 14 displays a location information notification screen 640 containing the saved location information (S2). This allows the user to check the location information when the device is started up, even if the display device 2 is moved while the power is off. An example of the location information notification screen 640 is shown in Figure 12.

[0124] Next, the location information receiving unit 20 determines whether or not it has received location information from the terminal device 30 (S3). If the communication unit 16 has received location information, the location information receiving unit 20 stores the location information in the location information storage unit 2002 (S4). Here, we will describe the state in which no location information is stored in the location information storage unit 2002. If location information is already stored in the location information storage unit 2002, the location information will be overwritten when the user performs an overwrite operation, as will be explained in step S6.

[0125] If location information is stored in the location information storage unit 2002 and the communication unit 16 receives location information from the terminal device 30 that is different from the stored location information, the display control unit 14 displays a location information update confirmation screen 650 (S5, S6). An example of the update confirmation screen 650 is shown in Figure 13.

[0126] The update confirmation screen 650 is a screen that asks the user whether the location information has been updated (i.e., whether the display device 2 has moved). Note that the terminal device 30 that transmits the location information in step S5 may be the same as or different from the terminal device 30 that transmitted the location information in step S3. However, since multiple terminal devices 30 can be connected to the display device 2 simultaneously, it is more likely that a different terminal device 30 will transmit the location information. Also, it is unlikely that the same user will transmit location information multiple times.

[0127] If the operation reception unit 17 accepts the selection to update the location information (Yes in S7), the process returns to step S4, and the location information reception unit 20 overwrites and saves the new location information to the location information storage unit 2002 (S4).

[0128] If the operation reception unit 17 does not accept the option to update the location information (No. in S7), the location information received in step S5 is discarded.

[0129] Next, the movement detection unit 21 determines whether or not it has detected movement of the display device 2 based on the signal detected by the acceleration sensor 228 (S8). Since the display device 2 consumes little power, it can be battery-powered and may be moved while the power is on. Minor movements may be ignored. For example, the movement detection unit 21 detects movement when it detects movement that continues for a certain period of time, such as 10 seconds, with an acceleration of a certain level or higher.

[0130] When the movement detection unit 21 detects movement, the display control unit 14 displays the movement detection screen 660 (S9). An example of the movement detection screen 660 is shown in Figure 14.

[0131] In response to the display on the movement detection screen 660, the user may send location information to the display device 2. In this case, the update confirmation screen 650 shown in Figure 13 is displayed.

[0132] If the operation reception unit 17 receives a selection to update the location information (Yes in S10), the process returns to step S4, and the location information reception unit 20 saves the new location information to the storage unit (S4).

[0133] If the user does not send location information to the display device 2 (No. in S10), the location information will not be updated.

[0134] When the user performs an operation to save the displayed data, the display control unit 14 displays a save selection screen 670 that prompts the user to select a method for saving the displayed data (S11). The user then selects a method for saving the displayed data. An example of the save selection screen 670 is shown in Figure 15.

[0135] If the user inputs that location information should be included, the data recording unit 15 attaches the location information to the displayed data and saves it in association with the displayed data (S12).

[0136] If the user inputs that they do not want to save the displayed data, the data recording unit 15 will not save either the displayed data or the location information.

[0137] If the user inputs that they do not want to include location information, the data recording unit 15 saves the display data without attaching location information to the display data (S13).

[0138] The display device 2 repeats the process shown in the flowchart in Figure 11 until the power is turned off (S14). The process ends when the power is turned off. In principle, the location information in the location information storage unit 2002 is not deleted when the power is turned off, but it may be deleted by user operation.

[0139] <Screen example> Figure 12 shows an example of the location information notification screen 640 displayed by the display device 2 in step S2 of Figure 11 when location information is saved when the power is turned on. The location information notification screen 640 is displayed as a pop-up on the input screen. The location information notification screen 640 has a message 641 that says "The currently saved location information is as follows," the currently saved location information 642, and an OK button 643. The user can determine whether the location information 642 is valid as the current location and, if necessary, operate the terminal device 30 to send the location information.

[0140] Figure 13 shows an example of the update confirmation screen 650 displayed in step S6 of Figure 11. The update confirmation screen 650 is also displayed as a pop-up on any screen (determined at the time of receiving location information). While the update confirmation screen 650 is displayed, the contact location detection unit 11 does not accept input to anything other than the update confirmation screen 650.

[0141] The update confirmation screen 650 displays the message 651, "Multiple location information has been received. Please select one," and two location information entries 652. The update confirmation screen 650 is a screen that asks the user which location information to select when new, different location information has been sent, even though location information has already been received and saved.

[0142] If the location information sent for the second time or later matches location information that has already been stored, the display control unit 14 will not display the update confirmation screen 650. The same applies when there are two or more terminal devices 30.

[0143] This allows the user to select more accurate location information on the display device 2 if one of the multiple terminal devices 30 malfunctions using GNSS.

[0144] Furthermore, the display device 2 may be able to store multiple location information. In this case, the user only needs to specify the location information to be attached to the display data. By storing multiple location information, the user can avoid resending location information in applications where they frequently move to the same location.

[0145] Figure 14 is an example of the movement detection screen 660 displayed in step S9 of Figure 11 when movement is detected by the accelerometer 228. The movement detection screen 660 prompts the user to send location information when movement is detected. The movement detection screen 660 has a message 661 that says, "Movement of the device has been detected. Please send location information again to manage the correct location information." In response to the message 661, the user sends location information from the terminal device 30, thus preventing the user from continuing to use the display device 2 without noticing that it has been moved, and allowing the location information to be updated to the correct information.

[0146] Figure 15 shows an example of the save selection screen 670 displayed when saving display data, as shown in step S11 of Figure 11. The save selection screen 670 has a message 674 that says, "Save the document to the cloud. Do you want to add the current location information to the document name when saving?", an add button 671, a do not add button 672, and a do not save button 673. The user can choose whether or not to add the location information if the location information is already stored on the display device 2.

[0147] This section explains how to save a file. If the "Do not add" button 672 is pressed, the data recording unit 15 automatically sets the file name to include date and time information, for example, "YYMMDD_hhmm". If location information is stored in the display device 2 and the "Add" button 671 is pressed when saving, the data recording unit 15 adds the location information (address in Figure 15) to the file name, for example, "YYMMDD_hhmm_1-chome, Nakamagome, Ota-ku, Tokyo".

[0148] <Display of location information based on handwritten data> As shown in Figure 16, the character recognition unit 13 can use the saved location information to display it as a string candidate 539. Figure 16(a) is a diagram illustrating the display of location information based on handwritten data 683 using the predictive text function. As described above, the character recognition unit 13 of the display device 2 can convert handwritten data 683 into a string in real time. For example, when a user writes "genzaichi", "current location", "place", "location information", etc., the display control unit 14 displays the location information stored in the location information storage unit 2002 as a string candidate. In Figure 16(a), for the handwritten data 683 "genzaichi", the string candidates 539 displayed are "current location" 684, "1-chome, Nakamagome, Ota-ku, Tokyo" 685, "current value" 686, and "genzaichi" 687.

[0149] As shown in Figure 16(b), when the user selects "1-chome, Nakamagome, Ota-ku, Tokyo" (685), "1-chome, Nakamagome, Ota-ku, Tokyo" is displayed in the location name field (688), which is the location that was handwritten. This function allows users to easily enter the correct address, even if it is a complicated address, simply by handwriting "location" or similar.

[0150] In Figures 16(a) and 16(b), Table 682 is displayed. This Table 682 is automatically displayed by the display control unit 14 after reading a predetermined initial setup page. The table has cells arranged for the column headings: No., Age, Gender, Injury / Illness Name, Treatment / Status, and Triage. Each cell has a format set according to the column heading. The location name column 688 also has a format set. The format includes numbers, gender, and alphabets. The string candidates are recognized using character recognition according to the format of the cell into which the handwritten data is entered, thus improving recognition accuracy.

[0151] Furthermore, the display control unit 14 changes the font size of the string candidates selected by the user so that they fit within the cell, and displays the string candidates within the cell. Therefore, the display device 2 can display the neatly written characters in each cell without them overflowing.

[0152] Figure 17 is a flowchart illustrating the processing of the display device 2 when a user handwrites "current location," "location," "location information," etc.

[0153] First, when the user writes with the pen 2500, the contact position detection unit 11 detects the contact of the pen, and when the user lifts the pen, the display control unit 14 starts displaying the recognition result of the handwritten data (operation guide) (S41).

[0154] The character recognition unit 13 performs character recognition in the background for each handwritten stroke, and confirms the recognition result after a certain period of time has elapsed since the pen was lifted (S42). Character recognition is the conversion of handwritten data into character codes.

[0155] The character recognition unit 13 determines whether handwritten data containing "current value," "location," "location information," or their hiragana or katakana equivalents have been input (S43). In other words, the character recognition unit 13 determines whether "current value," "location," "location information," or their hiragana or katakana equivalents are included in the handwritten recognition string candidate 506, the converted string candidate 507, or the string / predictive conversion candidate 508.

[0156] If the determination in step S43 is Yes, the character recognition unit 13 determines whether or not the location information has been saved (S44).

[0157] If the determination in step S44 is Yes, the character recognition unit 13 displays the location information stored in the location information storage unit 2002 as the string candidate 539 (S45). The location information may be displayed as, for example, a string / predictive conversion candidate 508, or as other string candidates.

[0158] <Display of location information marker> Furthermore, as shown in Figure 18, if the display device 2 indicates that location information has been saved, the user can display the location information in the string candidates. Figure 18 shows an example of the display of the location information mark 690 indicating that the display device 2 has saved location information. The display device 2, having saved the location information, displays the location information mark 690 as shown in Figure 18. The location information mark 690 may always be displayed or may be displayed by user operation. The location information mark 690 may be displayed anywhere, and the design in Figure 18 is just one example. The user can now determine whether the display device 2 has saved the location information received from the terminal device 30.

[0159] Furthermore, when a user taps the location information marker 690, the saved location information may be displayed in a pop-up or similar manner.

[0160] Figure 19 is a flowchart illustrating the procedure by which the display control unit 14 displays the location information mark 690. The display control unit 14 determines whether or not location information has already been stored in the location information storage unit 2002 (S31).

[0161] If location information has been saved (Yes in S31), the display control unit 14 displays the location information mark 690 (S32).

[0162] <Sharing location information when two or more display devices are connected> The display devices 2 can be linked together in a tile-like manner to maximize screen space. In this case, if the linked display devices 2 can also share location information, the user can write on any of the display devices 2 and the location information will be displayed in the string candidate 539.

[0163] Figure 20 illustrates character recognition when two or more display devices 2 are connected. Similar to the case where a single display device 2 is used, when the display devices 2 are connected, the terminal device 30 and the display devices 2 communicate via short-range wireless communication. When display device 2A receives location information from terminal device 30, it shares the location information from display device 2A to display device 2B, for example, via infrared I / F 223.

[0164] When a user writes "current location," "place," or "location information" on display device 2B, display device 2B displays the location information (address) in the string candidate 539, just as it does when used alone. When the user selects location information, the saved location information is displayed as a string. Therefore, when linked, the user can write on any of the display devices 2 and the location information will be displayed in the string candidate 539.

[0165] The connection of multiple display devices 2 will be described with reference to Figures 21 and 22. Figure 21 is a right side view of the display device 2 of this embodiment. The right side surface 121 is located to the right when facing the display. The right side surface 121 has a vertical side surface 121a perpendicular to the display and an inclined side surface 121b inclined with respect to the vertical direction of the display. The vertical side surface 121a is a surface parallel to the YZ plane. The inclined side surface 121b is a surface that is inclined to the left when viewed from the front with respect to the YZ plane, from the rear end 121a1 of the vertical side surface 121a.

[0166] The right side surface 121 has an infrared sensor window 131 on the vertical side surface 121a. The infrared I / F 223 transmits and receives infrared signals through the infrared sensor window 131. The coupling detection unit 22 detects the coupling of other display devices 2 when it detects infrared communication.

[0167] Figure 22 is a system configuration diagram when the display devices 2 are connected. In this embodiment, for design reasons, the infrared I / F 223 is located only on three sides of the display device 2. Therefore, when multiple display devices 2 are connected with two infrared I / F 223s facing each other, the top and bottom of each display device 2 will be reversed. In Figure 22(a), the same character is displayed by display devices 2A and 2B, but the top and bottom of the character are reversed. Even when displaying one image on two display devices 2 at a larger size, the portion displayed by display device 2B will have the top and bottom of the image reversed.

[0168] Therefore, one of the display devices 2A or 2B needs to rotate the image. However, since image processing is computationally intensive, a method is sometimes adopted in which the server 9 performs the image processing. (1) Display device 2A connects to server 9 via LAN and sends image data and the IP address of display device 2B received via infrared I / F223 to server 9 along with a request to rotate the image to be displayed. (2) Server 9 rotates the image data by 180 degrees and sends it to display device 2B.

[0169] By doing this, as shown in Figure 22(b), even if the top and bottom of each display device 2 are connected in reverse, display devices 2A and 2B can display images in the same orientation.

[0170] Note that in Figure 22, display devices 2A and 2B are showing the same image, but the same applies when the same image is displayed on both display devices 2A and 2B at a larger size. (1) Display device 2A sends image data and the IP address of display device 2B received via infrared I / F 223 to server 9, along with a request to divide and rotate the image to be displayed. (2) Server 9 divides the image data in half, rotates one half by 180 degrees, and sends one half to display device 2A and the other half to display device 2B. In this way, even if the top and bottom of each display device 2 are connected in reverse, display devices 2A and 2B can display a single image in the same orientation.

[0171] Figure 23 is a flowchart illustrating the procedure for the connected display devices 2 to share location information. Note that the process in Figure 23 corresponds to the process of display device 2B.

[0172] The connection detection unit 22 determines whether or not the unit is connected to another display device 2 (S21). If it is not connected (No. in S21), the process shown in Figure 23 ends.

[0173] If the connection detection unit 22 detects a connection (Yes in S21), the inter-display unit 23 acquires location information from the other device (S22). If the other device does not have location information stored, it cannot be acquired.

[0174] Then, the location information receiving unit 20 determines the storage status of the location information of its own aircraft and other aircraft (S23).

[0175] First, if both the user's own device and the other device have saved location information, the display control unit 14 displays the update confirmation screen 650 and accepts the user's selection (S24). If the location information of both the user's own device and the other device are the same, the display control unit 14 does not need to display the update confirmation screen 650.

[0176] If only the player's own aircraft has saved its location information, the location information receiving unit 20 decides to use the player's own aircraft's location information as is (S25).

[0177] If only another device has stored location information, the location information receiving unit 20 stores the location information of the other device in the location information storage unit 2002 (S26).

[0178] Through the above process, location information can be shared between the connected display devices 2.

[0179] <Main effects> As explained above, even if the display device 2 cannot communicate with GNSS or a mobile phone base station, it can save the current location information by receiving location information from the terminal device 30 connected via Wi-Fi or the like.

[0180] Furthermore, since the PIN displayed by the display device 2 is changed at predetermined intervals, it is guaranteed that the terminal device 30 into which the PIN is entered is within sight of the display device 2's screen, making it possible to obtain more accurate location information that is closer to the display device 2.

[0181] <Other application examples> Although the best mode for carrying out the present invention has been described above using examples, the present invention is not limited in any way to these examples, and various modifications and substitutions can be made without departing from the spirit of the present invention.

[0182] For example, the display method of this embodiment can be suitably applied to any information processing device having a touch panel. Furthermore, devices having similar functions to display devices are also referred to as electronic blackboards, electronic whiteboards, electronic information boards, interactive boards, etc. Examples of information processing devices equipped with a touch panel include projectors (PJ), output devices such as digital signage, head-up display (HUD) devices, industrial machinery, imaging devices, sound collection devices, medical equipment, networked home appliances, personal computers (notebook PCs), mobile phones, smartphones, tablet devices, game consoles, personal digital assistants (PDAs), digital cameras, wearable PCs, or desktop PCs.

[0183] Furthermore, in this embodiment, the server may perform some of the processing that the display device 2 would normally do. For example, the display device sends stroke information to the server, and the server retrieves and displays information to be displayed on the operation guide 500.

[0184] In this embodiment, the display device 2 detects the pen's coordinates by detecting the pen tip's coordinates via a touch panel, but the pen tip's coordinates may also be detected by ultrasound. The pen emits ultrasound along with light emission, and the display device 2 calculates the distance based on the arrival time of the ultrasound. The pen's position can be determined by its direction and distance. The projector draws (projects) the pen's trajectory as a stroke.

[0185] Furthermore, the configuration examples shown in Figure 5 and other figures are divided according to their main functions to facilitate understanding of the processing performed by the display device 2. The present invention is not limited by the way the processing units are divided or their names. The processing of the display device 2 can be further divided into many more processing units depending on the processing content. It can also be divided so that one processing unit includes even more processing.

[0186] Furthermore, each function of the embodiments described above can be realized by one or more processing circuits. Hereinafter, "processing circuit" as used herein includes processors programmed to execute each function by software, such as processors implemented by electronic circuits, as well as devices such as ASICs (Application Specific Integrated Circuits), DSPs (digital signal processors), FPGAs (field programmable gate arrays), and conventional circuit modules designed to execute each of the functions described above. [Explanation of Symbols]

[0187] 2 Display device 30 Terminal devices 100 Display Systems [Prior art documents] [Patent Documents]

[0188] [Patent Document 1] Special Publication No. 2018-505730

Claims

1. A display device that can communicate with a terminal device, A display control unit that displays a different first identification information each time a predetermined timing has elapsed, A communication unit that receives second identification information input to the terminal device from the terminal device, The system includes a location information receiving unit that acquires location information from the terminal device when the first identification information and the second identification information match. The communication unit communicates with the terminal device if the first identification information and the second identification information match, and restricts communication with the terminal device if they do not match. The location information received by the location information receiving unit is displayed by the display control unit. It has a character recognition unit that converts handwritten data entered by an input means into string candidates. The display device is characterized in that, when the character recognition unit converts the handwritten data into "current location," "place," "location information," or their hiragana or katakana equivalents, the display control unit displays the location information received by the location information receiving unit as a string candidate.

2. The device has a movement detection unit that detects the movement of the display device, The display device according to claim 1, characterized in that when the movement detection unit detects movement of the display device, the display control unit displays a message prompting the terminal device to transmit location information.

3. If the location information receiving unit has already acquired location information from the terminal device, and then acquires location information from another terminal device, The display device according to claim 1 or 2, characterized in that the display control unit displays a screen that accepts the selection between the stored location information and another location information obtained from an arbitrary terminal device.

4. If the previously stored location information and another location information obtained from any terminal device are the same, The display device according to claim 3, characterized in that the display control unit does not display the screen.

5. The display device according to any one of claims 1 to 4, characterized in that when saving the display data displayed by the display control unit, the display control unit displays a screen that accepts whether or not to associate the position information with the display data.

6. The display device according to any one of claims 1 to 5, characterized in that, if the location information is stored when the display device is started up, the display control unit causes the stored location information to be displayed.

7. A connection detection unit that detects connection with other display devices, When the connection detection unit detects a connection with the other display device, the inter-display device communication unit transmits the location information received by the location information receiving unit to the other display device. A display device according to any one of claims 1 to 6, characterized by having the following features.

8. The display device according to any one of claims 1 to 7, characterized in that the display control unit causes the display device to display different first identification information each time it is started up.

9. A display method performed by a display device that can communicate with a terminal device, The display control unit displays a different first identification information each time a predetermined timing has elapsed. The communication unit receives a second identification information input to the terminal device from the terminal device, If the first identification information and the second identification information match, the location information receiving unit takes the step of acquiring location information from the terminal device. The communication unit performs communication with the terminal device if the first identification information and the second identification information match, and restricts communication with the terminal device if they do not match. The steps include: the display control unit displays the location information received by the location information receiving unit, The character recognition unit performs the step of converting handwritten data input by the input means into string candidates, When the character recognition unit converts the handwritten data into "current location," "place," "location information," or their hiragana or katakana equivalents, the display control unit displays the location information received by the location information receiving unit as a string candidate. A display method characterized by having the following features.

10. A display device that can communicate with a terminal device, A display control unit that displays a different first identification information each time a predetermined timing has elapsed, A communication unit that receives second identification information input to the terminal device from the terminal device, If the first identification information and the second identification information match, the device will function as a location information receiving unit that acquires location information from the terminal device. The communication unit communicates with the terminal device if the first identification information and the second identification information match, and restricts communication with the terminal device if they do not match. The location information received by the location information receiving unit is displayed by the display control unit. The display device is further configured to function as a character recognition unit that converts handwritten data input by the input means into string candidates. The program is characterized in that when the character recognition unit converts the handwritten data into "current location," "place," "location information," or their corresponding hiragana or katakana characters, the display control unit displays the location information received by the location information receiving unit as a string candidate.

Images