Display device, display method, and program

Abstract

To provide a display device that can convert a character string to a converted language according to a display direction of a character string to display it.SOLUTION: A display device that displays a character string on a display, comprises: acquisition means that acquires a display direction of the character string; storage means that associates a converted language with the display direction of the character string to store them; conversion means that converts the character string displayed on the display to the converted language of the storage means corresponding to the display direction of the character string according to the display direction of the character string acquired by the acquisition means; and display control means that displays the character string converted to the converted language by the conversion means.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a display device, a display method, or a program. [Background technology]

[0002] There is a known display device that uses handwriting recognition technology to convert handwritten data into characters and display them on a display. Display devices equipped with relatively large touch panels are placed in conference rooms and public facilities and are used by multiple users as electronic whiteboards. Display devices are also sometimes used as communication tools by writing.

[0003] Also, a technique for translating handwritten data using handwriting recognition technology has been devised (see, for example, Patent Document 1). Patent Document 1 discloses a technique for performing character recognition on handwritten data to convert it into text data, and translating the text data into a different language. Summary of the Invention [Problem to be solved by the invention]

[0004] However, the conventional technology has a problem in that it is not possible to convert the language of a character string based on handwritten data and display the character string according to the display direction of the character string.

[0005] For example, Person A and Person B are facing each other across a display device. Person A writes Japanese characters by hand, and the display device recognizes the characters and displays them facing Person A. The display device can convert the characters into English, etc., but Person B finds it difficult to read because the characters are displayed in the opposite direction.

[0006] In view of the above-mentioned problems, an object of the present invention is to provide a display device that can convert a character string into a destination language depending on the display direction of the character string and display the converted language. [Means for solving the problem]

[0007] In view of the above problems, the present invention provides a display device for displaying a character string on a display, comprising: an acquisition means for acquiring a display direction of the character string; a storage means for storing the display direction of the character string in association with a conversion target language; a conversion means for converting the character string displayed on the display into the conversion target language of the storage means corresponding to the display direction of the character string according to the display direction of the character string acquired by the acquisition means; and a display control means for displaying the character string converted into the conversion target language by the conversion means. and character recognition means for converting handwritten data into the character string, the display control means having command processing means for displaying an operation command for accepting the display direction based on the character string converted by the character recognition means and accepting the display direction of the character string in response to selection of the operation command, the conversion means converting the character string displayed on the display into the conversion destination language of the storage means corresponding to the display direction accepted by the command processing means. . Effect of the Invention

[0008] It is possible to provide a display device that can convert a character string into a destination language and display the converted language depending on the display direction of the character string. [Brief description of the drawings]

[0009] [Figure 1] FIG. 13 is a diagram showing an example Japanese character string converted from Japanese handwritten data. [Diagram 2] 11A and 11B are diagrams illustrating an example of a character string converted by the display device of the present embodiment. [Diagram 3] 13 is a diagram showing an example of a character string converted and displayed on a display device. FIG. [Figure 4] FIG. 1 is a diagram illustrating an overall configuration of an example of a display device. [Diagram 5] FIG. 2 is a diagram illustrating a hardware configuration of an example of a display device. [Figure 6] FIG. 2 is a functional block diagram of an example for explaining functions of the display device by dividing them into blocks. [Figure 7] FIG. 13 is a diagram showing an operation guide and an example of selectable candidates displayed by the operation guide. [Figure 8] FIG. 13 is a diagram illustrating a display direction of an example of a character string. [Figure 9] FIG. 10 is a diagram illustrating a correspondence between a user's handwriting direction and a display direction. [Figure 10] FIG. 11 is a diagram illustrating an example of a method for inputting angle information. [Figure 11]11A and 11B are diagrams illustrating an example of a method in which a user associates a display direction with a conversion target language. [Figure 12] FIG. 13 is a diagram illustrating an example of conversion of a character string according to a display direction. [Figure 13] FIG. 13 is a diagram showing an example of conversion when multiple different languages ​​exist simultaneously. [Figure 14] 11A and 11B are diagrams illustrating an example of a rotation operation using an icon. [Figure 15] 11A and 11B are diagrams illustrating an example of a rotation operation performed by executing an operation command. [Figure 16] 11 is a flowchart illustrating an example of a procedure for the display device to convert a character string into a conversion target language according to a display direction in response to a user operation. [Figure 17] 13A and 13B are diagrams illustrating an example of conversion in which only character strings are rotated in the display direction without rotating an image, and conversion is performed according to the display direction. [Figure 18] 13A to 13C are diagrams illustrating an example of an operation method for rotating only a character string. [Figure 19] 11 is a flowchart illustrating an example of a procedure for converting only a character string into a conversion target language according to a display direction by a display device in response to a user operation. [Figure 20] 11A and 11B are diagrams illustrating an example of how a user specifies a display direction by tilting a display device. [Figure 21] 11A and 11B are diagrams illustrating an example of how a user specifies a display direction by tilting a display device. [Figure 22] 11 is a flowchart illustrating an example of a procedure for the display device to convert a character string into a conversion target language according to the display direction in accordance with the direction of gravity. [Figure 23] 11A and 11B are diagrams illustrating an example of conversion to a conversion target language and a font according to a display direction. [Figure 24] FIG. 13 is a diagram showing another configuration example of the display device. [Diagram 25] FIG. 13 is a diagram showing another configuration example of the display device. [Figure 26] FIG. 13 is a diagram showing another configuration example of the display device. [Figure 27] FIG. 13 is a diagram showing another configuration example of the display device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A display device and a display method performed by the display device will be described below as an example of an embodiment of the present invention with reference to the drawings. EXAMPLES

[0011] There are situations where display devices are used in workplaces and on-site where people with different languages ​​coexist. In such situations, when a person from one country wants to convey information by handwriting to a person from another country, if the characters displayed on the display are converted into a language that the person from the other country can understand, communication becomes easier. However, when these people communicate by surrounding the display device, the direction in which the characters are facing may differ from person to person.

[0012] <Comparative Example> First, a comparative example suitable for explaining the display device 2 of the present embodiment will be described with reference to Fig. 1. Fig. 1 shows a Japanese character string converted from handwritten Japanese data. One of the usage forms of the display device 2 is when it is used like writing communication in a workplace or on-site where speakers of different languages ​​coexist.

[0013] Person A displays a map on display device 2 and handwrites "Kyoto Station." With the comparative technology, it is also possible to display the conversion result so that it faces directly in the direction in which Person A uses display device 2. In other words, display device 2 can display "Kyoto Station" so that it faces Person A directly.

[0014] However, even if person B across from you can read the alphabet, as shown in Figure 1, it cannot be said that the unfamiliar string of characters "Kyoto Station" is easy to read from the other side.

[0015] <Outline of the display device according to this embodiment> Therefore, the display device 2 of this embodiment has the following configuration to display character strings in a language that the user can understand, in a direction facing the user. (i) The display device 2 accepts the setting of the destination language for each display direction of the character string. (ii) When the display device 2 rotates the character string in the display direction, it converts the character string into a conversion target language according to the display direction and displays the converted character string.

[0016] 2 shows an example of the display of a character string converted by the display device 2 of this embodiment. For example, in FIG. 2(a), Japanese is set in the 0° display direction, and English is set in the 180° display direction. If person A handwrites "Kyoto Station" 301 in Japanese, when the display direction is rotated by 180°, the display device 2 converts "Kyoto Station" 301 into English "Kyoto Station" 302, which is the conversion target language of 180°. Also, "Kyoto Station" 302 is displayed rotated by 180°. Therefore, person B can read "Kyoto Station" 302 in English from the front facing direction.

[0017] Conversely, in Fig. 3(a), "Toji temple" 303 is displayed based on handwritten data handwritten by person B from a display direction of 180°. As shown in Fig. 3(b), when person B rotates the display direction to 0°, the display device 2 converts "Toji temple" 303 into Japanese "Toji" 304, which is the conversion destination language of 0°. Also, "Toji" 304 is displayed rotated by 0°. Therefore, person A can read "Toji" 304 in Japanese from a direction facing directly at the screen.

[0018] In this way, in the display device 2 of the present embodiment, the display direction and the conversion target language are associated with each other, so when the user displays a character string in a desired display direction, the display device 2 can display the character string in a language that corresponds to the display direction. In other words, the user can always read the character string in a language that the user can understand from the direction facing the display device.

[0019] <Terminology> The input means may be any means capable of specifying coordinates on a touch panel and writing by hand, such as a pen, a human finger or hand, or a rod-shaped member.

[0020] A stroke refers to a series of operations in which a user presses an input means against a display, moves it continuously, and then releases it from the display. Stroke data is information displayed on the display based on a trajectory of coordinates input by the input means. Stroke data may be appropriately interpolated. Handwritten data is data having one or more stroke data. Handwritten input refers to handwritten data being input by a user.

[0021] An object is an object that is displayed on a display based on stroke data. Object means a target, but in this embodiment it means a display target. The character string converted from handwritten data through character recognition may include not only text data, but also data displayed based on user operations, such as fixed characters such as "Done," stamps displayed as marks, shapes such as circles and stars, and straight lines.

[0022] The confirmed data is data that has been converted into a character code (font) by character recognition of handwritten data and selected by the user, or handwritten data that has been confirmed not to be converted into a character code (font).

[0023] An operation command is a command prepared for operating the handwriting input device to instruct the execution of a specific process. In this embodiment, as an example, a case will be described in which the user instructs the display device 2 to rotate the entire image and to correspond the display direction to the converted character string. In addition, operation commands are also used in the editing system, modification system, input / output system, etc. of character strings.

[0024] A string is one or more characters that are handled by a computer. The actual entity of a string is a character code. Characters include numbers, alphabets, and symbols. Strings are also called text data.

[0025] Conversion means to change or replace. Converting a string of characters from one language to another is sometimes called translation.

[0026] The display direction is the direction in which the character string is displayed. In this embodiment, the display direction is any direction within 360° from the center of the display. The character string faces the user in this display direction. Facing the user directly means facing the object.

[0027] <Example of device configuration> The overall configuration of the display device 2 according to this embodiment will be described with reference to Fig. 4. Fig. 4 is a diagram showing the overall configuration of the display device 2. Fig. 4(a) shows, as an example of the display device 2, a display device 2 used as a horizontally long electronic whiteboard hung on a wall.

[0028] 4(a), a display 220 as an example of the display device 2 is provided on the upper part of the display device 2. A user U can use a pen 2500 to handwrite (input or draw) characters or the like on the display 220.

[0029] FIG. 4(b) shows a display device 2 used as a vertically long electronic whiteboard suspended on a wall.

[0030] 4(c) shows the display device 2 placed flat on a desk 230. Since the thickness of the display device 2 is about 1 cm, there is no need to adjust the height of the desk even if the display device 2 is placed flat on a normal desk. In addition, the user can easily move the display device 2.

[0031] The input method of the coordinates of the pen 2500 includes an electromagnetic induction method, an active electrostatic coupling method, etc. The pen 2500 may also have functions such as pen pressure detection, tilt detection, and a hover function (displaying the cursor before the pen touches the screen).

[0032] <Hardware configuration of the device> Next, the hardware configuration of the display device 2 will be described with reference to Fig. 5. As shown in the figure, the display device 2 has the configuration of an information processing device or a computer. Fig. 5 is an example of a hardware configuration diagram of the display device 2. As shown in Fig. 5, the display device 2 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, and an SSD (Solid State Drive) 204.

[0033] Of these, the CPU 201 controls the overall operation of the display device 2. The ROM 202 stores the CPU 201 and programs used to drive the CPU 201, such as an IPL (Initial Program Loader). The RAM 203 is used as a work area for the CPU 201.

[0034] The SSD 204 stores various data such as an OS and a program for a display device. This program may be an application program that runs on an information processing device equipped with a general-purpose OS (Windows (registered trademark), Mac OS (registered trademark), Android (registered trademark), iOS (registered trademark), etc.).

[0035] The display device 2 also includes a display controller 213, a touch sensor controller 215, a touch sensor 216, a display 220, a power switch 227, a tilt sensor 217, a serial interface 218, a speaker 219, a microphone 221, a wireless communication device 222, an infrared I / F 223, a power control circuit 224, an AC adapter 225, and a battery 226.

[0036] The display controller 213 controls and manages the screen display in order to output an output image to the display 220, etc. The touch sensor 216 detects that the pen 2500, the user's hand, etc. (the pen and the user's hand serve as input means) have touched the display 220. The touch sensor 216 also receives a pen ID.

[0037] The touch sensor controller 215 controls the processing of the touch sensor 216. The touch sensor 216 inputs and detects coordinates. For example, in the case of an optical type, the input of coordinates and the detection of coordinates are performed by two light receiving / emitting devices installed at both ends of the upper side of the display 220 emitting a plurality of infrared rays in parallel to the display 220, and receiving the light reflected by a reflecting member provided around the display 220 and returning along the same optical path as the optical path of the light emitted by the light receiving element. The touch sensor 216 outputs position information of the infrared rays emitted by the two light receiving / emitting devices that are blocked by an object to the touch sensor controller 215, and the touch sensor controller 215 specifies the coordinate position that is the contact position of the object. The touch sensor controller 215 also has a communication unit 215a and can wirelessly communicate with the pen 2500. For example, when communication is performed according to a standard such as Bluetooth (registered trademark), a commercially available pen can be used. If one or more pens 2500 are registered in advance in the communication unit 215a, the user can communicate with the display device 2 without having to perform connection settings to allow the pen 2500 to communicate with the display device 2.

[0038] The power switch 227 is a switch for switching ON / OFF the power of the display device 2. The tilt sensor 217 is a sensor for detecting the tilt angle of the display device 2. It is mainly used to detect whether the display device 2 is being used in the installation state of Fig. 4(a), Fig. 4(b), or Fig. 4(c), and can automatically change the thickness of characters, etc. according to the installation state.

[0039] The serial interface 218 is an external communication interface such as a USB. The serial interface 218 is used for inputting information from the outside. The speaker 219 is used for outputting audio, and the microphone 221 is used for inputting audio. The wireless communication device 222 communicates with a terminal carried by the user, and relays a connection to the Internet, for example. The wireless communication device 222 communicates using Wi-Fi, Bluetooth (registered trademark), or the like, but any communication standard may be used. The wireless communication device 222 forms an access point, and when the user sets an SSID (Service Set Identifier) ​​and password obtained by the user in the terminal carried by the user, the user can connect to the access point.

[0040] It is preferable that the wireless communication device 222 is provided with two access points. a. Access point → Internet b. Access point → Internal network → Internet Access point a is for users outside the company, and users cannot access the company network but can use the Internet. Access point b is for users inside the company, and users can use the company network and the Internet.

[0041] The infrared I / F 223 detects the display device 2 arranged adjacently. The infrared I / F 223 can detect only the display device 2 arranged adjacently by utilizing the linearity of infrared rays. It is preferable that one infrared I / F 223 is provided on each side, and it can detect in which direction of the display device 2 another display device 2 is arranged. This expands the screen, and it is possible to display handwritten information that was previously handwritten on the adjacent display device 2 (handwritten information on another page, with the area of ​​one display 220 being one page) and the like.

[0042] The power supply control circuit 224 controls an AC adapter 225 and a battery 226 which are power sources for the display device 2. The AC adapter 225 converts AC common to commercial power sources into DC.

[0043] If the display 220 is so-called electronic paper, it consumes little or no power to maintain the image display, and therefore can be driven by a battery 226. This makes it possible to use the display device 2 for purposes such as digital signage even in places where it is difficult to connect to a power source, such as outdoors.

[0044] The display device 2 further includes a bus line 210. The bus line 210 is an address bus, a data bus, or the like for electrically connecting the components such as the CPU 201 shown in FIG.

[0045] The touch sensor 216 is not limited to an optical type, and may be a capacitive touch panel that identifies the contact position by detecting a change in capacitance, a resistive film touch panel that identifies the contact position by a voltage change between two opposing resistive films, or an electromagnetic induction touch panel that identifies the contact position by detecting electromagnetic induction caused by a contact object touching the display unit. The touch sensor 216 may be of a type that does not require an electronic pen to detect the presence or absence of a touch with the tip of the pen. In this case, a fingertip or a pen-shaped stick can be used to perform a touch operation. The pen 2500 does not need to be a long, thin pen type.

[0046] <About the function> Next, the functions of the display device 2 will be described with reference to FIG. 6. FIG. 6 is an example of a functional block diagram for explaining the functions of the display device 2 in blocks. The display device 2 has a contact position detection unit 21, a drawing data generation unit 22, a character recognition unit 23, a display control unit 24, a data recording unit 25, a network communication unit 26, an operation reception unit 27, an operation command processing unit 28, a rotation processing unit 29, a language conversion unit 30, a tilt detection unit 31, and an input direction detection unit 32. Each function of the display device 2 is a function or means realized by any of the components shown in FIG. 5 operating according to an instruction from the CPU 201 in accordance with a program expanded from the SSD 204 onto the RAM 203.

[0047] The contact position detection unit 21 detects the coordinates of the position where the pen 2500 touches the touch sensor 216. The drawing data generation unit 22 acquires the coordinates where the tip of the pen 2500 touches from the contact position detection unit 21. The drawing data generation unit 22 generates stroke data by connecting the sequence of coordinate points by interpolating them.

[0048] The character recognition unit 23 performs character recognition processing on one or more stroke data (handwritten data) handwritten by the user, and converts it into a character code. In parallel with the user's pen operation, the character recognition unit 23 recognizes characters (not only Japanese but also multiple languages ​​such as English), numbers, symbols (%, $, &, etc.), shapes (lines, circles, triangles, etc.), etc. Various algorithms have been devised for the recognition method, but details will be omitted since known technology can be used in this embodiment.

[0049] The display control unit 24 displays the handwritten data, character strings converted from the handwritten data, and an operation menu for user operation on the display. The data recording unit 25 stores the handwritten data handwritten on the display device 2, the converted character strings, the PC screen, files, and the like in the storage unit 40. The network communication unit 26 connects to a network such as a LAN and transmits and receives data to and from other devices via the network.

[0050] The operation command processing unit 28 detects whether the character string recognized by the character recognition unit corresponds to an operation command, and if the user presses the operation command, executes the operation command.

[0051] The rotation processing unit 29 rotates the entire image or the character string in response to an operation command or a user operation. In this embodiment, it is possible to rotate only the character string, or to rotate the entire image including the character string. Hereinafter, when the rotation of the entire image is mentioned, it means that both the character string and the image are rotated by the same angle.

[0052] The language conversion unit 30 converts the language of the character string displayed on the screen according to the display direction of the character string when rotating the entire image or the character string. The language conversion unit 30 has a function of an acquisition unit that acquires a conversion target language associated with the display direction from the conversion language storage unit 41.

[0053] The tilt detection unit 31 uses the detection result of the tilt sensor to detect the direction of gravity acting on the display device 2. The direction of gravity is, for example, any one of the four sides of the display device 2.

[0054] The input direction detection unit 32 detects the display direction facing the user who inputs the handwritten data based on the handwritten data. Alternatively, the input direction detection unit 32 detects the display direction facing the user who writes by hand using the input means, according to the handwritten data handwritten by a predetermined method.

[0055] The display device 2 also has a memory unit 40 constructed in the SSD 204 or RAM 203 shown in Figure 5, and the memory unit 40 has a conversion language memory unit 41, an operation command definition data memory unit 42, an input data memory unit 43, and several conversion dictionaries 44 constructed therein.

[0056] [Table 1] Table 1 shows the correspondence between the display direction and the conversion destination language set in the conversion language storage unit 41. The conversion destination language corresponding to the display direction of the character string is registered in the conversion language storage unit 41 in association with the language. For example, 0° is Japanese, 90° is Chinese, 180° is English, and 270° is Korean, but the correspondence between the display direction and the conversion destination language can be set by the user. Also, depending on the display direction, the conversion destination language may not be registered. The display direction is preset as, for example, 90°, 180°, and 270° counterclockwise, with the reference display direction being 0°.

[0057] [Table 2] Table 2 shows a schematic diagram of the operation command definition data stored in the operation command definition data storage unit 42. The operation command definition data defines an operation command that the user instructs the display device 2 to input an operation command by using a recognized character string obtained by character recognition.

[0058] For example, if the character strings "Rotate", "90", "180", and "270" are recognized, the corresponding operation commands are "Rotate display 90 degrees", "Rotate display 180 degrees", and "Rotate display 270 degrees". The display device 2 displays these operation commands and accepts operations from the user. When an operation command is selected, the operation command processing unit 28 executes the content described in the processing item. For example, the operation command processing unit 28 instructs the rotation processing unit 29 to rotate the entire image, and instructs the language conversion unit 30 to convert the character string by specifying the display direction.

[0059] [Table 3] Table 3 shows a schematic of the contents of the input data storage unit 43. The input data is the attribute of data input by the user. The input data is recorded for each object (one stroke data, one character string, one image, etc.). · DataId is the identification information of the input data. Type is the type of input data, and can be Stroke, Text, or Image. The attributes held by the input data can differ depending on the Type, but Table 3 explains the case where Type="Text". Text represents a character string, and Image is an image. ·PenID is the identification information of the pen 2500 used to input this character string. ·Angle is the display direction of this string. · StartPoint is the coordinate of the upper left vertex of the bounding rectangle of the string. · StartTime is the time when the user started writing the string. · EndPoint is the coordinate of the lower right vertex of the bounding rectangle of the string. · EndTime is the time when the user finishes writing the string. · FontName is the font name as a string. · FontSize is the font size. ·Text is the entered text (character code). · Language is the language of the string.

[0060] <Example of selectable candidates> Next, referring to Fig. 7, an operation guide 500 displayed when converting handwritten data will be described. Fig. 7 shows an example of the operation guide 500 and selectable candidates 530 displayed by the operation guide. The user handwrites handwritten data 504, and the operation guide 500 is displayed. The operation guide 500 displays operation command candidates 510, handwritten recognition character string candidates 506, converted character string candidates 507, and character string / predictive conversion candidates 508. The selectable candidates 530 are the operation command candidates 510, the handwritten recognition character string candidates 506, the converted character string candidates 507, and the character string / predictive conversion candidates 508. The selectable candidates 530 excluding the operation command candidates 510 are referred to as character string candidates 539.

[0061] Handwritten data 504 is the character "gi" handwritten by the user. Handwritten data rectangular area display 503 is displayed surrounding handwritten data 504. In Fig. 7, operation guide 500 is displayed when one character is input, but the timing at which operation guide 500 is displayed is the timing at which the user stops handwriting. Therefore, the number of characters in handwritten data 504 is arbitrary.

[0062] The character string candidates are arranged in descending order of probability in handwriting recognition character string candidate 506, conversion character string candidate 507, and character string / predictive conversion candidate 508. "gi" in handwriting recognition character string candidate 506 is a candidate for the recognition result. In this example, character recognition unit 23 correctly recognizes "gi".

[0063] Conversion character string candidate 507 is a conversion character string candidate (e.g., a phrase containing "technique") converted from the result of kana-kanji conversion of "gi" (e.g., "technique"). In this example, "Giryoshi" is an abbreviation for "Technology Mass Production Trial." Character string / predictive conversion candidate 508 is a predicted character string candidate converted from conversion character string candidate 507. In this example, "Approve the giryoshi" and "Address to send the minutes of the meeting" are displayed.

[0064] The operation command candidates 510 are predefined operation command candidates (commands for file operations, character editing, etc.) that are displayed according to the recognized characters. In the example of Fig. 7, the first character of the line "》" 511 indicates that it is an operation command candidate. In Fig. 7, the character string candidate "meiji", which is a character string candidate for "gi", partially matches the definition data, so the operation command candidate 510 is displayed.

[0065] The operation command candidates 510 are displayed when operation command definition data including the converted character string is found, and are not necessarily displayed at all times. In this embodiment, the operation command candidates 510 related to the conversion are displayed.

[0066] The operation header 520 has buttons 501, 509, 502, and 505. Button 501 accepts an operation to switch between predictive conversion and kana conversion. Button 502 operates the page of candidate display. In the example of FIG. 7, there are three candidate display pages, and the first page is currently displayed. Button 505 accepts the deletion of the operation guide 500. When the user presses button 505, the operation acceptance unit 27 accepts it, and the display control unit 24 erases the display except for the handwritten data. Button 509 accepts the deletion of all displays. When the user presses button 509, the operation acceptance unit 27 accepts it, and the display control unit 24 erases all displays shown in FIG. 7, including the handwritten data, allowing the user to start over with handwriting.

[0067] <Registering display direction and conversion language> 8 is a diagram for explaining the display direction. In this embodiment, the direction of the perpendicular line from the center of the display to a predetermined side is set to 0°. The display directions facing the user on each side are set to 90°, 180°, and 270° counterclockwise.

[0068] There are several methods by which the display device 2 can determine which of the four sides the user who is writing handwriting is on. In one method, the input direction detection unit 32 can determine which of the four sides the user is on, based on the direction in which the user is writing handwriting.

[0069] Fig. 9 is a diagram showing the correspondence between the direction of handwriting by the user and the display direction. For example, if the coordinates of the stroke data move from left to right and from top to bottom (horizontal writing from left to right), the side that exists from top to bottom is the display direction. In Fig. 9, the start and end points of each character are shown with black circles, and it can be seen that the overall movement is from the top left to the bottom right.

[0070] Similarly, if the coordinates of the stroke data move from top to bottom and from right to left (vertical writing from top to bottom), the side that exists from top to bottom is the display direction. In this way, the input direction detection unit 32 can estimate which of the four sides the user is located in based on the handwritten data.

[0071] In addition, the correspondence between the coordinates of handwritten data and the display direction may be generated by the manufacturer of the display device through machine learning. For example, a person in charge inputs time-series handwritten data into a neural network and provides the display direction as training data, so that the input direction detection unit 32 is obtained as a learning model.

[0072] 8, the display directions are set to four angles, 0°, 90°, 180°, and 270°, but the display directions may be set more precisely. For example, the display directions may be set at intervals of 45° or 30°.

[0073] As another method, there is a method in which the display device 2 judges in which direction of the four sides the user is present by using the pen 2500. In this method, first, the pen 2500 is associated with a display direction.

[0074] Fig. 10 is an example of a diagram for explaining a method for inputting angle information. Fig. 10 explains a case where a user who is positioned at a 90° angle from the display device 2 inputs angle information. Characters handwritten from a 90° angle are correctly recognized when rotated 90° clockwise, so it is recommended that a display direction of 90 degrees be input.

[0075] 10(a) shows a state in which operation guide 500 is displayed because a user standing at an angle of 90 degrees from display device 2 has handwritten "ぎ". Since display device 2 performs character recognition of "ぎ" handwritten from an angle of 90 degrees while keeping the display direction at the initial value of 0 degrees, an unexpected selectable candidate 530 is displayed.

[0076] When inputting angle information, the user hand-draws a straight line in the operation guide 500 from the top to the bottom as seen by the user. Fig. 10(b) shows an example of this straight line 521. The angle α formed by the 0° direction and this straight line 521 in the counterclockwise direction is the display direction. In other words, the angle α formed by the straight line 522 drawn from the starting point S in the 0° direction and the straight line 521 input by the user in the counterclockwise direction is the display direction. Therefore, the display direction input by the user in Fig. 10(b) is 90°.

[0077] For detecting a straight line, for example, the coordinates from the start point S to the end point E are converted into a straight line by the least squares method, and the obtained correlation coefficient is compared with a threshold value to determine whether or not it is a straight line.

[0078] Immediately after the user starts drawing the straight line 521 (immediately after the pen 2500 touches the starting point S of the straight line 521), the display device 2 erases the operation guide 500. Also, immediately after the user finishes drawing the straight line 521 (immediately after the pen 2500 is released from the ending point E of the straight line 521), the display device 2 searches for the value of the angle α that is closest to 90°, 180°, 270°, and 0°, and determines this as the display direction. The angle α itself may be angle information. This display direction is associated with the pen 2500 that was used.

[0079] When the pen tip of the pen 2500 is pressed for handwriting or the like, the pen 2500 transmits a pen ID to the display device 2, so that the display device 2 can associate the pen 2500 with a display direction.

[0080] Fig. 10(c) shows the operation guide 500 immediately after the operation in Fig. 10(b). Since 90° is set as the display direction of the pen 2500, the handwritten data is internally rotated 90° clockwise for character recognition, and the operation guide 500 is displayed rotated 90° counterclockwise. Note that the user may manually input the angle information from a menu.

[0081] Fig. 11 is a diagram for explaining a method in which a user associates a display direction with a conversion destination language. In Fig. 11, users are present in a display direction of 0° and a display direction of 180°. As explained in Fig. 9, the display device 2 can determine on which of the four sides the user is present based on the handwritten data. Alternatively, a display direction is already associated with the pen 2500 used by each user.

[0082] A user with a display orientation of 0° handwrites "Japanese" to call up an operation command for setting the language. As a result, an operation command 310 "Set to Japanese" is displayed on the operation guide 500. When the user selects this operation command, the operation command processing unit 28 sets the conversion destination language "Japanese" to the display orientation of 0° detected by the input direction detection unit 32 for "Japanese". Alternatively, the operation command processing unit 28 sets the conversion destination language "Japanese" to the display orientation of 0° of the pen 2500 used by a user with a display orientation of 0°.

[0083] Similarly, a user with a display orientation of 180° handwrites "English" to call up an operation command for setting the language. As a result, an operation command 311 called "Set to English" is displayed on the operation guide 500. When the user selects this operation command, the operation command processing unit 28 sets the conversion destination language "English" to the display orientation of 180° detected by the input direction detection unit 32 for "English". Alternatively, the operation command processing unit 28 sets the conversion destination language "English" to the display orientation of 180° of the pen 2500 used by a user with a display orientation of 180°. With the above steps, a conversion language storage unit 41 as shown in Table 1 is generated.

[0084] The correspondence between the display direction and the conversion target language registered in the conversion language storage unit 41 can be cancelled by the user executing a predetermined operation command.

[0085] Furthermore, handwritten data by a user is character-recognized in the conversion language associated with the display orientation that the user is in. For example, "Hello" handwritten by a user with a 0° display orientation is recognized as "Hello" in Japanese, and "Hello" handwritten by a user with a 180° display orientation is recognized as "Hello" in the English alphabet.

[0086] <Example of conversion according to display direction> Fig. 12 is a diagram for explaining an example of character string conversion according to the display direction. In Fig. 12, it is assumed that a conversion target language is set for every 90°. Japanese is set for the 0° display direction, Chinese for the 90° display direction, English for the 180° display direction, and Korean for the 270° display direction.

[0087] As shown in Fig. 12(a), the user hand-writes "Kyoto Station" 320 in Japanese from a 0° direction. The attributes of the input data of the character string are as follows: ·Angle=0° Language=Japanese When the user inputs an operation to rotate the entire image by 90 degrees (details will be described later), the rotation processing unit 29 rotates the entire image by 90 degrees counterclockwise. Furthermore, the language conversion unit 30 acquires the conversion target language associated with the 90 degree display orientation from the conversion language storage unit 41, and converts "Kyoto Station" into Chinese 321 using a conversion dictionary 44 that converts Japanese into Chinese. Note that the processes of the rotation processing unit 29 and the language conversion unit 30 may be performed in parallel, or one of them may be performed first. As a result, as shown in FIG. 12(b), the image and "Kyoto Station" in Chinese 321 are displayed facing each other in the 90 degree display orientation. The attributes of the input data of the character string are as follows: ·Angle=90° Language=Chinese Furthermore, when the user inputs an operation to rotate the entire image by 90 degrees, the rotation processing unit 29 and the language conversion unit 30 perform similar processing. As a result, the image and "Kyoto Station" 322 converted into English are displayed facing each other at a 180 degree display direction, as shown in Fig. 12(c). The attributes of the input data for the character string are as follows: Angle=180° Language=English Furthermore, when the user inputs an operation to rotate the entire image by 90 degrees, the rotation processing unit 29 and the language conversion unit 30 perform similar processing. As a result, the image and "Kyoto Station" 323 converted into Korean are displayed facing the display direction of 270 degrees, as shown in Fig. 12(d). The attributes of the input data of the character string are as follows: ·Angle=270° Language=Korean Each user can handwrite a character string as desired, regardless of the rotation state of the entire image. For example, in the state of FIG. 12(d), if a user facing the 0° direction writes a character string in Japanese while facing the user directly, the Japanese is converted according to the display direction, so that each user can read the character string in a language that the user can understand as long as the user is facing the user directly. When each user writes a character string in his / her own language while facing the user directly, if the user rotates the entire image, the character string can be converted into a language that the user in each direction can read by the conversion to a conversion destination language according to the display direction of this embodiment.

[0088] Fig. 13 shows an example of conversion when multiple different languages ​​exist simultaneously. Fig. 13(a) is the same as Fig. 12(d). A user facing 180° has input "good" 324 in English. Therefore, Fig. 13(a) displays a character string 323 that corresponds to "Kyoto Station" in Korean and "good" 324 in English. The attributes of each character string in the input data are as follows: Korean Angle=270° Language=Korea ·English Angle=180° Language=English If the user rotates it by another 90 degrees, the display orientation and destination language will be as follows: Korean Angle=0°=270+90 Language=Japanese ·English Angle=270°=180+90 Language=Korea Therefore, as shown in Fig. 13(b), "Kyoto Station" 323 in Korean is converted to "Kyoto Station" 320 in Japanese, and "good" 324 in English is converted to a character string 325 that corresponds to "good" in Korean. Therefore, a plurality of different languages ​​are displayed in a language that can be read by a user facing the screen. In this way, there is no problem even if different languages ​​are simultaneously present on one screen.

[0089] <Rotation of entire image including text> Next, the operation of rotating the entire image by the user will be described with reference to Figures 14 and 15. The rotation operation can be performed by the user manipulating an icon or by executing an operation command. The rotation operation can be performed by any user, not just the user who hand-written the characters.

[0090] 14 is a diagram for explaining a rotation operation using an icon 330. The display device 2 displays a tool tray on the screen, so that the user can input a rotation operation by pressing an icon 330 in the tool tray.

[0091] When icon 330 is pressed, rotation angles of 90°, 180°, and 270° are displayed, and the user can select the desired rotation angle. Alternatively, icons corresponding to rotation angles of 90°, 180°, and 270° may be prepared. Note that the rotation angles of 90°, 180°, and 270° designated by the user are relative angles that further rotate the angle from the current state.

[0092] Fig. 15 is a diagram explaining a rotation operation by executing an operation command. When a user handwrites "kaiten", the character recognition unit 23 converts it to "rotate". Since "rotate" is registered in the operation command definition data, the operation command processing unit 28 detects the operation commands "rotate display 90°", "rotate display 180°", and "rotate display 270°". The display control unit 24 displays these operation commands on the operation guide 500. In Fig. 15, only "rotate display 90°" 341 and "rotate display 180°" 342 are shown.

[0093] In this way, the user can rotate the entire image by icon manipulation or handwritten data, and further convert the character string into a conversion target language according to the display direction.

[0094] <Operation procedure for rotating the entire image> 16 is a flowchart showing a procedure for converting a character string into a conversion destination language according to a display direction in response to a user operation by the display device 2. For convenience of explanation, it is assumed in FIG. 16 that one or more character strings are already displayed.

[0095] The operation reception unit 27 receives input of a rotation operation (S1). Either an icon or handwritten data may be used as the input method for the rotation operation. As a result, the language conversion unit 30 obtains the rotation angle from the operation command processing unit 28 or from the icon operation.

[0096] The language conversion unit 30 acquires the conversion target language associated with the display direction from the conversion language storage unit 41 (S2). Since the operation acceptance unit 27 accepts a rotation angle (a relative rotation angle from the current state), the display direction after rotation is the value obtained by adding the rotation angle to the display direction of the character string already displayed. The language conversion unit 30 acquires the conversion target language associated with the display direction after rotation from the conversion language storage unit 41. Note that the input data for each character string holds Angle and Language, so the language conversion unit 30 can identify the current display direction and current language.

[0097] Next, the language conversion unit 30 converts the character string using a conversion dictionary 44 corresponding to the source and destination languages ​​(S3). The source language is the language of the character string already displayed (the language of the input data), and the destination language is the conversion destination language associated with the display direction after rotation in the conversion language storage unit 41.

[0098] The language conversion unit 30 updates the Angle and Language of the input data of the character string.

[0099] The display control unit 24 deletes the character string that has already been displayed, and displays the converted character string (S4).

[0100] When multiple character strings (Type="Text") are displayed on the screen, steps S2 to S4 are carried out for each character string.

[0101] The rotation processing unit 29 rotates the entire image including the converted character string by the rotation angle accepted by the operation accepting unit 27 (S5). Note that the language conversion unit 30 may convert the language of the character string after the rotation processing unit 29 rotates the entire image.

[0102] <Rotating text only> For example, in Fig. 12, the rotation processing unit 29 rotates the entire image including the character string. However, the rotation processing unit 29 may rotate only the character string.

[0103] Fig. 17 is a diagram for explaining an example of conversion in which only the character string is rotated in the display direction without rotating the image, and conversion is performed according to the display direction. In Fig. 17, Japanese is set to 0°, Chinese to 90°, and English to 180°.

[0104] As shown in Fig. 17(a), a user in a 0° orientation has handwritten the Japanese character string "Confirm!" When a user (this user may be anyone) inputs an operation to rotate the character string "Confirm!" 350 by 90°, the language conversion unit 30 acquires a conversion target language associated with a display orientation of 90° (current angle is 0°) from the conversion language storage unit 41. The language conversion unit 30 converts "Confirm!" 350 into a Chinese character string 351 using a conversion dictionary 44 that converts Japanese into Chinese.

[0105] Then, the rotation processing unit 29 rotates the Chinese character string 351 counterclockwise by 90°. Note that the processes of the rotation processing unit 29 and the language conversion unit 30 may be performed in parallel, or one of them may be performed first. As a result, as shown in Fig. 17(b), the Chinese character string 351 is displayed facing the 90° display direction. Note that the Angle of the input data for the character string 351 is updated to 90°, the Language to Chinese, and the Text to "Confirm!" in Chinese.

[0106] Furthermore, when the user inputs an operation to rotate Chinese character string 351 by a further 90 degrees, rotation processing unit 29 and language conversion unit 30 perform similar processing. As a result, English character string 352 is displayed facing the display direction of 180 degrees as shown in Fig. 17(c). Note that the Angle of the input data for character string 352 is updated to 180 degrees, Language to English, and Text to "Confirm!" in English.

[0107] In this way, when the display device 2 rotates only the character strings without rotating the image, a complex image such as a map remains stationary, which has the advantage that the image is easy for each user to view.

[0108] 18 is a diagram for explaining an operation method for rotating only a character string. An example of rotating an object such as a character string will be explained.

[0109] The user selects a character string with the pen 2500 (FIG. 18(a)).

[0110] b. The display control unit 24 displays the text box.

[0111] c. The user presses the rotation bar of the text box with the pen 2500 to rotate it in a desired display direction (FIG. 18(b)). The operation acceptance unit 27 accepts the rotation angle.

[0112] In this way, by using different operating methods for rotating the entire image and for rotating only the text, the user can choose between rotating the entire image or just the text depending on whether it is easier to view.

[0113] Note that the operation command may be used to rotate only the character string.

[0114] <Operation procedure for rotating text only> 19 is a flow chart showing the procedure for converting only character strings into a conversion target language according to the display direction in response to a user operation by the display device 2. In the explanation of FIG. 19, differences from FIG. 16 will be mainly explained.

[0115] The operation receiving unit 27 receives an operation for rotating a character string as shown in Fig. 18 (S11). As a result, the language conversion unit 30 acquires from the operation receiving unit 27 the character string to be rotated and the rotation angle.

[0116] The language conversion unit 30 acquires the conversion target language associated with the display direction from the conversion language storage unit 41 (S12). This process may be the same as step S2 in FIG.

[0117] Next, the language conversion unit 30 converts the character string using the conversion dictionary 44 corresponding to the source and destination languages ​​(S13). This process may be the same as step S3 in FIG.

[0118] The display control unit 24 deletes the character string that has already been displayed, rotates the converted character string by the rotation angle accepted by the operation acceptance unit 27, and then displays the converted character string (S14).

[0119] <Specifying the display direction using the tilt sensor> The user can specify the display direction not only by inputting an operation command or using an icon, but also by tilting the display device 2.

[0120] Fig. 20 is a diagram for explaining the specification of the display direction by the user tilting the display device 2. Fig. 20(a) is a diagram showing the display device 2 placed on a horizontal plane from above. There are users 364, 365 at the display directions of 0° and 180°. The conversion destination language associated with the display direction of 0° is Japanese, and the conversion destination language associated with the display direction of 180° is English. The character string "Kyoto Station" 360 is displayed facing directly in the 0° direction.

[0121] As shown in Fig. 20(b), when a user 364 lifts the edge of the display device 2 on his / her side, the tilt detection unit 31 detects that the direction of gravity has changed to a display direction of 180°. The display device 2 converts the character string "Kyoto Station" 360 into the conversion target language associated with the display direction of 180° and displays it. In Fig. 20(c), the character string "Kyoto Station" has been converted into an English character string 361.

[0122] A user 365 with a display orientation of 180 degrees can also handwrite an English character string in a similar manner. Fig. 21(a) is a top view of the display device 2 placed on a horizontal plane. The English character string 361 "Toji" is displayed in the direction directly facing the user 365 with a display orientation of 180 degrees.

[0123] As shown in Fig. 21(b), when a user 365 lifts the edge of the display device 2 on his / her side, the tilt detection unit 31 detects that the direction of gravity has changed to a display direction of 0°. The display device 2 converts the English character string 361 into a conversion target language associated with the display direction of 0° and displays it. In Fig. 21(c), the character string "Toji" 363 is displayed.

[0124] In this way, by tilting the display device 2 in the direction of the other person, the user can convert the character string into a destination language that corresponds to the display direction and rotate the entire image.

[0125] In addition, to detect the direction of gravity, not only a tilt sensor but also an acceleration sensor or a gyro sensor may be used.

[0126] 22 is a flow chart showing the procedure for converting a character string into a conversion destination language according to the display direction in accordance with the gravity direction by the display device 2. In the explanation of FIG. 22, differences from FIG. 11 will be mainly explained.

[0127] The inclination detection unit 31 detects the display direction as one of the four sides on which gravity acts most strongly (S21). Note that the inclination detection unit 31 maintains the original display direction until the difference in gravity between the side on which gravity acts most strongly and the side on which gravity acts next strongest becomes equal to or greater than a certain value. This is to prevent hunting of the display direction. In this way, the language conversion unit 30 obtains the display direction from the inclination detection unit 31.

[0128] The language conversion unit 30 acquires the conversion target language associated with the display direction from the conversion language storage unit 41 (S22). Since the language conversion unit 30 acquires the display direction rather than the rotation angle, it is sufficient to acquire the conversion target language associated with this display direction from the conversion language storage unit 41.

[0129] The subsequent processing in steps S23 to S25 may be similar to that in steps S3 to S5 in FIG.

[0130] <Font settings> The user may be able to set a desired font for the language. The display device 2 can display character strings in a font corresponding to the display direction and language.

[0131] [Table 4] Table 4 shows an example of the conversion language storage unit 41 in which fonts are set. In Table 4, fonts are set in pairs with the conversion destination language. This is because different fonts exist for each language. Ming font is set for Japanese at 0°, and Song font is set for Chinese at 90°. Serif font is set for English at 180°, and Padanchae is set for Korean at 270°.

[0132] Fig. 23 is a diagram explaining conversion to a conversion destination language and font according to a display direction. In Fig. 23(a), "Kyoto Station" 370 and "Toji Temple" 371 are displayed in Ming font facing directly to a display direction of 0°. When the user rotates the entire image by 180°, as shown in Fig. 23(b), an English character string 372 corresponding to "Kyoto Station" and an English character string 373 corresponding to "Toji Temple" are displayed in English serif font facing directly to a display direction of 180°.

[0133] In this way, the user can display the font of each language in the font of their choice. In addition, the conversion destination language and the font can be associated with each other by the user handwriting "font" from each display direction to display the operation command and selecting the desired font. EXAMPLES

[0134] In the following embodiment, another configuration example of the display device 2 will be described.

[0135] <<Another configuration example 1 of the display device>> Although the display device 2 of the present embodiment has been described as having a large touch panel, the display device 2 is not limited to having a touch panel.

[0136] Fig. 24 is a diagram showing another example of the configuration of the display device 2. In Fig. 24, a projector 411 is installed on one side of a flat whiteboard 413. This projector 411 corresponds to the display device 2. The flat whiteboard 413 is not a flat panel display integrated with a touch panel, but a whiteboard on which a user directly writes by hand with a marker. Note that the whiteboard 413 may be a blackboard, and may be any flat surface large enough to project an image.

[0137] The projector 411 has an ultra-short focal length optical system and can project an image with little distortion from a distance of about 10 cm onto the whiteboard 413. This image may be transmitted from a PC connected wirelessly or via a wire, or may be stored in the projector 411.

[0138] A user writes handwriting on the whiteboard 413 using a dedicated electronic pen 2501. The electronic pen 2501 has a light-emitting part, for example at the tip, that is switched on and emits light when the user presses it against the whiteboard 413 to write. The wavelength of the light is near-infrared or infrared, so it is invisible to the user's eyes. The projector 411 has a camera that captures the light-emitting part, analyzes the image, and identifies the direction of the electronic pen 2501. The electronic pen 2501 also emits sound waves along with the light emission, and the projector 411 calculates the distance based on the arrival time of the sound waves. The projector 411 can identify the position of the electronic pen 2501 based on the direction and distance. Handwritten data is drawn (projected) at the position of the electronic pen 2501.

[0139] Since the projector 411 projects the menu 430, when the user presses a button with the electronic pen 2501, the projector 411 identifies the position of the electronic pen 2501 and the pressed button by the ON signal of the switch. For example, when the save button 431 is pressed, the handwritten data (coordinate point sequence) handwritten by the user is saved by the projector 411. The projector 411 saves the handwritten information in a predetermined server 412 or USB memory 2600 or the like. The handwritten information is saved for each page. Since the information is saved as coordinates rather than as image data, the user can re-edit it. However, in this embodiment, the menu 430 does not need to be displayed because the operation command can be called up by handwriting. EXAMPLES

[0140] <<Another configuration example 2 of the display device>> 25 is a diagram showing another example of the configuration of the display device 2. In the example of FIG.

[0141] The terminal device 600 is connected by wire to the image projection device 700A and the pen operation detection device 810. The image projection device 700A projects image data input by the terminal device 600 onto the screen 800.

[0142] The pen operation detection device 810 communicates with the electronic pen 820 and detects the operation of the electronic pen 820 in the vicinity of the flat screen 800. Specifically, the electronic pen 820 detects coordinate information indicating a point pointed to by the electronic pen 820 on the screen 800 (the detection method may be the same as that in FIG. 24 ), and transmits the coordinate information to the terminal device 600.

[0143] The terminal device 600 generates image data of handwritten data input by the electronic pen 820 based on the coordinate information received from the pen operation detection device 810, and causes the image projection device 700A to draw an image of the handwritten data on the screen 800.

[0144] Furthermore, the terminal device 600 generates superimposed image data indicating a superimposed image obtained by combining the background image projected by the image projection device 700A and the image of the handwritten data input by the electronic pen 820. EXAMPLES

[0145] <<Another configuration example 3 of the display device>> Fig. 26 is a diagram showing a configuration example of the display device 2. In the example of Fig. 26, the display device 2 has a terminal device 600, a flat-laying display 800A, and a pen motion detection device 810A.

[0146] The pen action detection device 810A is disposed near the display 800A, detects coordinate information indicating a point indicated by the electronic pen 820A on the display 800A (the detection method may be the same as that in FIG. 24), and transmits the coordinate information to the terminal device 600. In the example of FIG. 26, the electronic pen 820A may be charged by the terminal device 600 via a USB connector.

[0147] Based on the coordinate information received from the pen operation detection device 810, the terminal device 600 generates image data of the handwritten data input by the electronic pen 820A, and displays the image data on the display 800A. EXAMPLES

[0148] <<Another Configuration Example 4 of the Display Device>> Fig. 27 is a diagram showing a configuration example of the display device 2. In the example of Fig. 27, the display device 2 includes a terminal device 600 and an image projection device 700A.

[0149] The terminal device 600 performs wireless communication (Bluetooth (registered trademark) or the like) with the electronic pen 820B to receive coordinate information of a point indicated by the electronic pen 820B on the flat screen 800. The coordinate information may be obtained by the electronic pen 820B reading minute position information formed on the screen 800, or the coordinate information may be received from the screen 800.

[0150] Then, the terminal device 600 generates image data of the handwritten data input by the electronic pen 820B based on the received coordinate information, and causes the image projection device 700A to project an image of the handwritten data.

[0151] Furthermore, the terminal device 600 generates superimposed image data indicating a superimposed image obtained by combining the background image projected by the image projection device 700A and the image of the handwritten data input by the electronic pen 820B.

[0152] As described above, each of the above-described embodiments can be applied to various system configurations.

[0153] <Other application examples> The above describes the best mode for carrying out the present invention using examples, but the present invention is not limited to these examples in any way, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention.

[0154] The character string is stored as character codes, and the handwritten data is stored as coordinate point data in the display device 2. The data can also be stored in various storage media or in a storage device on a network, and later downloaded from the display device 2 for reuse. The display device 2 to be reused may be any display device, or may be a general information processing device. Therefore, the user can reproduce the handwritten content on a different display device 2 and continue a meeting, etc.

[0155] For example, in the present embodiment, an electronic whiteboard has been described as an example, but the electronic whiteboard may be called an electronic whiteboard, an electronic information board, or the like. In addition, the present embodiment can be suitably applied to any information processing device having a touch panel. The information processing device equipped with a touch panel may be, for example, a PJ (Projector), an output device such as digital signage, a HUD (Head Up Display) device, an industrial machine, an imaging device, a sound collecting device, a medical device, a network home appliance, a notebook PC (Personal Computer), a mobile phone, a smartphone, a tablet terminal, a game machine, a PDA (Personal Digital Assistant), a digital camera, a wearable PC, or a desktop PC.

[0156] In this embodiment, the coordinates of the pen are detected by detecting the coordinates of the pen tip with a touch panel, but the coordinates of the pen tip may be detected by ultrasonic waves. The pen emits light and also emits ultrasonic waves, and the display device 2 calculates the distance based on the arrival time of the ultrasonic waves. The position of the pen can be identified based on the direction and distance. The projector draws (projects) the trajectory of the pen as stroke data.

[0157] Moreover, the configuration examples in Fig. 6 and the like are divided according to main functions in order to facilitate understanding of the processing by the display device 2. The present invention is not limited by the manner in which the processing units are divided or the names of the processing units. The processing by the display device 2 can be divided into more processing units according to the processing contents. Also, it can be divided so that one processing unit includes more processes.

[0158] Furthermore, part of the processing performed by the display device 2 may be performed by a server connected to the display device 2 via a network.

[0159] Each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, and a device such as an ASIC (Application Specific Integrated Circuit), a DSP (digital signal processor), an FPGA (field programmable gate array), or a conventional circuit module designed to execute each function described above.

[0160] The language conversion unit (acquisition unit) 30 is an example of an acquisition means and a conversion means. The display control unit 24 is an example of a display control means. The character recognition unit 23 is an example of a character recognition means. The operation command processing unit 28 is an example of a command processing means. The tilt detection unit 31 is an example of a display direction detection means. The contact position detection unit 21 is an example of a handwritten data acceptance means. The operation acceptance unit 27 is an example of an operation acceptance means. The input direction detection unit 32 is an example of an input direction detection means. The conversion language memory unit 41 is an example of a memory means. [Explanation of symbols]

[0161] 2 Display device [Prior art documents] [Patent documents]

[0162] [Patent Document 1] JP 2003-162527 A

Claims

1. A display device that displays a character string on a display, An acquisition means for acquiring a display direction of the character string; a storage means for storing the display direction of the character string and a conversion target language in association with each other; a conversion means for converting the character string displayed on the display into the conversion target language of the storage means corresponding to the display direction of the character string according to the display direction of the character string acquired by the acquisition means; a display control means for displaying the character string converted into the conversion target language by the conversion means; character recognition means for converting handwritten data into said character string; the display control means displays an operation command for accepting the display direction based on the character string converted by the character recognition means; a command processing means for receiving a display direction of the character string in response to a selection of the operation command; the conversion means converts the character string displayed on the display into the conversion destination language of the storage means corresponding to the display direction accepted by the command processing means; Display device.

2. the display control means displays an icon for accepting a display direction of the character string; an operation receiving means for receiving a display direction of the character string in response to pressing of the icon, 2. The display device according to claim 1, wherein the conversion means converts the character string displayed on the display into the conversion target language of the storage means that corresponds to the display direction accepted by the operation acceptance means.

3. a display direction detection means for detecting a display direction of the character string based on a direction of gravity acting on the display device, 3. The display device according to claim 1, wherein the conversion means converts the character string displayed on the display into the conversion target language of the storage means that corresponds to the display direction detected by the display direction detection means.

4. 4. The display device according to claim 1, wherein the display control means displays the image displayed on the display in the same display direction as the character string.

5. 4. The display device according to claim 1, wherein the display control means displays only the character string displayed on the display in a manner facing directly in the display direction.

6. a handwritten data receiving means for receiving input of handwritten data; an input direction detection means for detecting a display direction facing a user inputting the handwritten data based on the handwritten data received by the handwritten data receiving means, 2 . The display device according to claim 1 , wherein the command processing means registers in the storage means a correspondence between the display direction detected by the input direction detection means and the conversion target language in response to a selection of the operation command related to the display direction.

7. receiving, from the input means, an identification of the input means used to input the handwritten data; an input direction detection means for detecting a display direction facing a user who is writing by hand using the input means in accordance with the handwritten data that is handwritten in a predetermined manner; 2 . The display device according to claim 1 , wherein the command processing means registers in the storage means a correspondence between the display direction detected by the input direction detection means and the conversion target language in response to a selection of the operation command related to the display direction.

8. A current display direction is recorded for each of the character strings; 4. The display device according to claim 1, wherein the conversion means converts the character string displayed on the display into the conversion target language of the storage means corresponding to the new display direction, by adding the received relative rotation angle to the current display direction of the character string as a new display direction.

9. The storage means in which the display direction of the character string is associated with a conversion target language is associated with a font of the conversion target language, The conversion means converts the character string displayed on the display into the conversion target language of the storage means corresponding to the display direction, 9. The display device according to claim 1, wherein the display control means displays the character string converted into the conversion target language by the conversion means in a font associated with the conversion target language.

10. 2 . The display device according to claim 1 , wherein the display control means displays the character string converted into the conversion target language by the conversion means in a manner facing the display direction.

11. A display method performed by a display device that displays a character string on a display, comprising the steps of: An acquisition step of acquiring a display direction of the character string; a conversion means for referring to a storage means for storing a display direction of the character string and a conversion target language in association with each other, and converting the character string displayed on the display into the conversion target language of the storage means corresponding to the display direction of the character string according to the display direction of the character string acquired by the acquisition means; a step of displaying the character string converted into the conversion target language by the conversion means by a display control means; A character recognition means converts handwritten data into said character string; a step of the display control means displaying an operation command for accepting the display direction based on the character string converted by the character recognition means; a step of a command processing means receiving a display direction of the character string in response to a selection of the operation command; a step of converting the character string displayed on the display into the conversion target language of the storage means corresponding to the display direction accepted by the command processing means by the conversion means; A display method having the following structure:

12. A display device that displays character strings on a display. An acquisition means for acquiring a display direction of the character string; a storage means for storing the display direction of the character string and a conversion target language in association with each other; a conversion means for converting the character string displayed on the display into the conversion target language of the storage means corresponding to the display direction of the character string according to the display direction of the character string acquired by the acquisition means; a display control means for displaying the character string converted into the conversion target language by the conversion means; a character recognition means for converting handwritten data into said character string; the display control means displays an operation command for accepting the display direction based on the character string converted by the character recognition means; causing the display device to function as a command processing means for receiving a display direction of the character string in response to a selection of the operation command; the conversion means converts the character string displayed on the display into the conversion destination language of the storage means corresponding to the display direction accepted by the command processing means; program.

Images