Display device, display method, and program
The display device allows editing of objects displayed in an associated, editable second input area when they exceed a threshold in the first input area, addressing the limitation of existing technologies.
Patent Information
- Application Number
- JP2024040809
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-03-15
- Publication Date
- 2025-09-29
AI Technical Summary
Existing display devices with handwriting recognition technology cannot edit objects displayed in a pop-up or separate area.
A display device that includes an input accepting unit and a display control unit, allowing objects exceeding a threshold in a first input area to be displayed in an associated, editable second input area.
Enables editing of objects displayed on the display component when they exceed a predetermined amount, enhancing usability and flexibility.
Smart Images

Figure 2025141065000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a display device, a display method, and a program. [Background technology]
[0002] There is known a display device that uses handwriting recognition technology to convert handwritten data into objects such as characters and display them on a display. Patent Document 1 discloses a display device that displays objects that exceed the number of characters that can be displayed in a display component separate from the input area. Summary of the Invention [Problem to be solved by the invention]
[0003] However, in the display device of Patent Document 1, although an object that is not displayed in the input area is displayed by a pop-up or the like, it is not possible to edit the object displayed by the pop-up or the like.
[0004] In order to solve the above problem, the present invention aims to provide a display device that allows editing of objects displayed on a display component when objects exceeding a predetermined amount are displayed on a display component separate from the input area. [Means for solving the problem]
[0005] A display device according to one embodiment of the present invention includes an input accepting unit that accepts input of stroke data into a first input area, and a display control unit that displays an object corresponding to the stroke data in the first input area, and, if the amount of objects input into the first input area is equal to or exceeds a threshold, displays at least a portion of the object in an editable manner in a second input area that is displayed in association with the first input area. [Effects of the Invention]
[0006] According to the present invention, when objects exceeding a predetermined amount are displayed on a display component separate from the input area, the objects displayed on the display component can be edited. [Brief explanation of the drawings]
[0007] [Figure 1] 1 is a configuration diagram of a display system according to an embodiment of the present invention. [Figure 2] 1 is a diagram showing an example of the arrangement of a display device according to an embodiment of the present invention; [Figure 3] 1 is a diagram showing a configuration of a display device according to an embodiment of the present invention; [Figure 4] 4 is a diagram showing an example of first input area information stored in a first input area information storage unit in the display device according to the embodiment of the present invention. FIG. [Figure 5] FIG. 4 is a diagram showing an example of second input area information stored in a second input area information storage unit in the display device according to one embodiment of the present invention. [Figure 6] FIG. 1 is a hardware configuration diagram of a display device according to an embodiment of the present invention. [Figure 7] FIG. 2 is a hardware configuration diagram of a mobile terminal used in a display system according to an embodiment of the present invention. [Figure 8] FIG. 2 is a hardware configuration diagram of a terminal device used in a display system according to an embodiment of the present invention. [Figure 9] 1 is a block diagram showing a functional configuration of a display device according to an embodiment of the present invention; [Figure 10] 10 shows an example of a first input area and a second input area 62 in a display device according to one embodiment of the present invention. [Figure 11] 4A and 4B are diagrams illustrating the size of an object and the length of a first input area in the input direction in a display device according to one embodiment of the present invention. [Figure 12] FIG. 10 is a flowchart of a process for automatically displaying a second input area in a display device according to an embodiment of the present invention. [Figure 13]FIG. 10 is a diagram showing an example of changing the size of a second input area in the display device according to one embodiment of the present invention. [Figure 14] FIG. 10 is a diagram for explaining a process for manually displaying a second input area in the display device according to one embodiment of the present invention. [Figure 15] FIG. 10 is a flowchart of a process for manually displaying a second input area in a display device according to an embodiment of the present invention. [Figure 16] 10 is an example of identification information associated with an object displayed in a first input area when the object is displayed in a second input area in the display device according to one embodiment of the present invention. [Figure 17] 4A and 4B are diagrams showing examples of identification information for a first input area and a second input area in a display device according to one embodiment of the present invention. [Figure 18] FIG. 4 is a flowchart of processing for associating a first input area with a second input area in a display device according to an embodiment of the present invention. [Figure 19] 10A and 10B are diagrams for explaining a method for suppressing erroneous input in a display device according to an embodiment of the present invention. [Figure 20] 1 is a configuration diagram of an information sharing system using a display device according to an embodiment of the present invention. [Figure 21] FIG. 2 is a functional block diagram of an information management server used in the display system according to the embodiment of the present invention. [Figure 22] FIG. 10 is a configuration diagram showing another example of a display system according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION
[0008] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following describes the preferred embodiments of the present invention with reference to the accompanying drawings. In the drawings, the same components are designated by the same reference numerals, and redundant explanations may be omitted.
[0009] <Display system configuration> FIG. 1 is a configuration diagram of a display system 1 according to an embodiment of the present invention. The display system 1 according to this embodiment is configured by a display device 100, a mobile terminal 200, and a terminal device 300. The display device 100 may be an electronic whiteboard. The mobile terminal 200 is, for example, a terminal device such as a smartphone. The terminal device 300 is, for example, a PC (Personal Computer) or a video conference terminal, and is capable of communicating with the display device 100 via a communication network N such as the Internet.
[0010] <Example of arrangement of display device 100> An example of the arrangement of the display device 100 according to this embodiment will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the arrangement of the display device 100 according to one embodiment of the present invention. Fig. 2(a) shows, as an example of the display device 100, a display device 100 used as a horizontally long electronic whiteboard hung on a wall.
[0011] As shown in Fig. 2(a), a display 60 as an example of the display device 100 is installed on the upper part of the display device 100. A user can use an input means 50 to handwrite (input or draw) characters or the like on the display 60.
[0012] FIG. 2(b) shows the display device 100 used as a vertically long electronic whiteboard hung on a wall.
[0013] 2(c) shows the display device 100 placed flat on a desk 70. The display device 100 is about 1 cm thick, so there is no need to adjust the height of the desk even when it is placed flat on a regular desk. In addition, the user can easily move the display device 100.
[0014] The input method of the coordinates of the input means 50 includes an electromagnetic induction method, an active electrostatic coupling method, etc. The input means 50 may also have functions such as pen pressure detection, tilt detection, and a hover function (displaying the cursor before the pen touches the screen).
[0015] <Terminology> The input means 50 may be any means that allows handwriting by specifying coordinates on a touch panel, such as a pen, a human finger or hand, or a rod-shaped member.
[0016] A stroke is a series of operations in which the user presses the input tool against the display 60, moves it continuously, and then lifts it from the display. A stroke includes tracking the user's movement without touching the display 60.
[0017] In this case, the user may initiate a stroke, for example, using a mouse or pointing device, with a user gesture, pressing a button with the user's hand or foot, or in other ways, and the user may terminate the stroke with the same or a different gesture, releasing the button, or using the mouse or pointing device.
[0018] Stroke data is information displayed on the display 60 based on the locus of coordinates input by the input means 50. The stroke data may be interpolated as appropriate. Handwritten data is data having one or more stroke data.
[0019] Handwriting input refers to handwritten data being input by a user. Handwriting input may be performed using a touch interface, a tactile object such as a pen or stylus, or the user's body. Handwriting input may also be performed via other types of input, such as gesture-based input, hand tracking input, or other touch-free input by the user. Although embodiments of the present invention refer to handwritten input and handwritten input data, other forms of handwriting input may be used.
[0020] An object is a display object that is displayed on the display 60 based on stroke data. Object means a target, but in this embodiment, it refers to a display target. Objects converted from handwritten stroke data include characters. Characters include kanji, hiragana, katakana, Roman letters, the alphabet, numbers, emojis, emoticons, ancient Egyptian characters, and hieroglyphics. Objects may also include character strings consisting of one or more characters, stamps displayed as fixed characters such as "done," shapes such as circles, stars, and arrows, straight lines, mathematical symbols, and the like.
[0021] A string object is an object that contains a string of characters (text). Although the description of the embodiment describes a case where a character string is handwritten, the handwritten content is not limited to a character string. The handwritten content may include not only characters but also arrows and the like, such as "Move 10 people from shelter A to shelter B," and at least a portion of these may be displayed within the display component. Circles, stars, arrowheads, mathematical symbols, and the like may also be handwritten, and at least a portion of these may be displayed within the display component.
[0022] An input area is an area prepared for inputting text, handwritten data, etc. A displayable object amount may be set for the input area. The input area is, for example, surrounded by a rectangular frame, but it may simply be underlined or may have only top and bottom lines. Furthermore, the input area is not limited to being a single independent area, but may be adjacent to at least one of the vertical and horizontal directions like table cells. The first input area is an input area that is permanently displayed and has a fixed size. The second input area is an input area that is displayed in association with the first input area and is temporarily displayed when a condition is met.
[0023] A pop-up is a display component such as a window that is temporarily displayed on a computer's operation screen. A pop-up does not necessarily have to have the shape of a speech bubble; it can have any shape.
[0024] Display components are various components that are components of a screen. One example of a display component is a pop-up. A pop-up displays content or text (character strings) handwritten by the user. Note that a mark may be used to indicate that there is content that cannot be displayed (when it acts as an indicator). The mark does not display handwritten content or text.
[0025] <Configuration of display device 100> 3 is a diagram showing the configuration of a display device 100 according to one embodiment of the present invention. The display device 100 includes an input receiving unit 11, a drawing data generating unit 12, a converting unit 13, a data recording unit 14, a network communication unit 15, an operation receiving unit 16, a display control unit 20, a first input area display unit 21, a second input area display unit 22, a mark display unit 23, and a determining unit 24. Each function of the display device 100 is realized by one of the components shown in FIG. 3 operating in response to an instruction from the CPU in accordance with a program loaded from the SSD onto the RAM.
[0026] The input acceptance unit 11 accepts input of stroke data into the first input area. The input acceptance unit 11 also accepts a predetermined operation into the first input area. Furthermore, the input acceptance unit 11 may not accept input of stroke data into the corresponding first input area while the second input area is displayed. The second area is displayed in association with the first area. Note that, hereinafter, when there is no need to distinguish between the first input area and the second input area, they will simply be referred to as input areas.
[0027] The input receiving unit 11 receives input of stroke data, that is, a sequence of coordinate points, by detecting the coordinates of the position where the input means 50 touches the touch sensor. The drawing data generating unit 12 acquires the coordinates where the input means 50 touches from the input receiving unit 11. The drawing data generating unit 12 generates stroke data by connecting the sequence of coordinate points through interpolation.
[0028] The conversion unit 13 performs character recognition processing on one or more stroke data (handwritten data) handwritten by the user and converts it into text. The substance of the text is character code. In parallel with the user's pen operation, the conversion unit 13 recognizes characters (not only Japanese but also multiple languages such as English), numbers, symbols (%, $, &, etc.), shapes (lines, circles, triangles, etc.), etc. Various algorithms have been devised for the recognition method, but this embodiment uses known technology and will not be described in detail.
[0029] The data recording unit 14 stores handwritten data written on the display device 100, converted character strings, PC (Personal Computer) screens, files, etc. in the storage unit 30. The network communication unit 15 connects to a network such as a LAN and transmits and receives data to and from other devices via the network.
[0030] The operation acceptance unit 16 accepts the selection of any character from a plurality of conversion candidates that have been character-recognized based on the coordinates touched by the input means 50, or accepts the pressing of a menu.
[0031] The display control unit 20 includes a first input area display unit 21, a second input area display unit 22, a mark display unit 23, and a determination unit 24. The display control unit 20 causes the display 60 to display handwritten data, character strings converted from the handwritten data, operation menus for user operation, and the like.
[0032] The display control unit 20 displays the second input area when the amount of objects input into the first input area exceeds a threshold and a predetermined operation on the first input area is received. The predetermined operation may be an operation in which the input unit 50 touches the first input area for a time period equal to or longer than a time period indicating a long press criterion. Alternatively, the predetermined operation may be an operation in which the input unit 50 touches a predetermined figure displayed in the first input area.
[0033] The display control unit 20 displays an object corresponding to the stroke data in the first input area. Furthermore, when the amount of objects input in the first input area exceeds a threshold, the display control unit 20 displays at least a part of the object in an editable manner in the second input area.
[0034] The threshold value is the number of objects that can be displayed in the first input area. The threshold value may be a value determined based on the length of the first input area in the input direction and the size of the objects. In other words, the threshold value may be a value based on the first input area information.
[0035] The first input area display unit 21 displays the first input area and displays objects input into the input area within the range of the displayable number of characters set for the first input area. If the amount of input objects exceeds the displayable number of characters, objects input later in the input order that exceed the displayable number of characters are not displayed. Furthermore, the first input area display unit 21 may hide objects input earlier in the input order from the first input area in order to maintain a margin in the input area. The first input area is an input area that is constantly displayed and has a fixed size. The first input area may be part of a format displayed on a display device.
[0036] When there are objects that cannot be displayed in the first input area, the second input area display unit 22 displays a second input area, and displays all or part of the objects, including at least the objects that could not be displayed in the first input area, as the second input area. The second input area is an input area displayed in association with the first input area, and is an input area that is temporarily displayed when a condition is satisfied. The second input area may be displayed as a pop-up.
[0037] The first input area has identification information, and the second input area is associated with the identification information of the corresponding first input area when displayed in response to a predetermined operation. The length of the second input area can be changed at least in the input direction.
[0038] When there are objects that cannot be displayed in the first input area, the mark display unit 23 displays a predetermined graphic inside or around the first input area. Furthermore, when the input of correction content in the second input area is completed, the mark display unit 23 may display a completion graphic in the second input area to reflect that fact.
[0039] The determination unit 24 determines whether the condition for displaying the second input area is met. Specifically, it determines whether the amount of objects input into the first input area exceeds a threshold and whether a predetermined operation on the first input area has been accepted. The predetermined operation may be an operation in which the input means 50 touches the first input area for a time period equal to or longer than a time period indicating a long press criterion. Alternatively, the predetermined operation may be an operation in which the input means 50 touches a predetermined figure displayed in the first input area.
[0040] The display control unit 20 displays the text converted from the stroke data in the first input area and the second input area, and also controls the display of part of the text in a display component related to the text when the text cannot be displayed.
[0041] The display device 100 also has a memory unit 30 constructed in the SSD 104 or RAM 103 shown in FIG. 6, and the memory unit 30 has a first input area information memory unit 31 and a second input area information memory unit 32 constructed therein.
[0042] 4 is a diagram showing an example of first input area information stored in the first input area information storage unit 31 in the display device 100 according to one embodiment of the present invention. The first input area information is information set in the first input area.
[0043] In the figure, "identification ID" is identification information for the first input area. "Coordinates" indicate the X and Y coordinates of the top left vertex of the first input area on the display 60 of the display device 100. "Size" is the vertical and horizontal lengths of the first input area. The vertical and horizontal lengths of the first input area are an example of the length of the first input area in the input direction. "Font" specifies the font of the object entered in the first input area. "Font size" specifies the font size of the object entered in the first input area. "Font size" is an example of the size of the object displayed in the first input area.
[0044] "Font color" specifies the color of the object entered in the first input area. "Font alignment" specifies the alignment of the object entered in the first input area horizontally (left, center, right) and vertically (top, center, bottom). "Input area margin" specifies the margin from the object to the frame of the first input area as large, medium, or small.
[0045] The "designated dictionary" specifies a conversion dictionary to be used to convert strokes input in the first input area. The display device 100 can improve recognition accuracy by registering a dictionary for each first input area. Also, a setting may be made to hide the operation guide for the first input area.
[0046] The "number of displayable characters" is the maximum number of characters that the first input area can display. The "number of displayable characters" is an example of the amount of objects that can be displayed. The "input text" is an object as text entered into the first input area. The "importance" indicates the importance of the object relative to the first input area as low, medium, or high. The second input area display unit 22 can change the display duration of the second input area depending on the importance. When the importance is high, the display device 100 may continue to display the second input area. In addition, the mark display unit 23 can change the color, brightness, and other aspects of the mark depending on the importance.
[0047] 5 is a diagram showing an example of second input area information stored in the second input area information storage unit 32 in the display device 100 according to one embodiment of the present invention. The second input area information is information set in the second input area.
[0048] In the figure, "identification ID" is identification information for the second input area. "Coordinates" indicate the X and Y coordinates of the top left vertex of the first input area on the display 60 of the display device 100. "Size" is the vertical and horizontal lengths of the first input area. "Input text" is an object as text input into the first input area.
[0049] <Device hardware configuration> The hardware configuration of the display device 100 will be described with reference to Fig. 6. As shown in the figure, the display device 100 has the configuration of an information processing device or a computer. Fig. 6 is a hardware configuration diagram of the display device 100 according to one embodiment of the present invention. As shown in Fig. 6, the display device 100 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, and an SSD (Solid State Drive) 104.
[0050] Of these, the CPU 101 controls the overall operation of the display device 100. The ROM 102 stores the CPU 101 and programs used to drive the CPU 101, such as an IPL (Initial Program Loader). The RAM 103 is used as a work area for the CPU 101.
[0051] The SSD 104 stores various data such as an OS and programs for the display device 100. This program may be an application program that runs on an information processing device equipped with a general-purpose OS (Windows (registered trademark), Mac OS (registered trademark), Android (registered trademark), iOS (registered trademark), etc.). In this case, the device is normally used as a general-purpose information processing device, but when a user executes the application program, the user can write by hand, just like on a dedicated device for the display device 100.
[0052] The display device 100 also includes a display controller 113, a touch sensor controller 115, a touch sensor 116, a display 60, a power switch 127, a tilt sensor 117, a serial interface 118, a speaker 119, a microphone 121, a wireless communication device 122, an infrared I / F 123, a power control circuit 124, an AC adapter 125, and a battery 126.
[0053] The display controller 113 controls and manages the screen display in order to output an output image to the display 60, etc. The touch sensor 116 detects that the input means 50 has touched the display 60. When an electronic pen is used as the input means 50, the touch sensor 116 receives the pen ID of the electronic pen.
[0054] The touch sensor controller 115 controls the processing of the touch sensor 116. The touch sensor 116 inputs and detects coordinates. The method for inputting and detecting coordinates will be described below. For example, in the case of an optical type, two light receiving and emitting devices installed at both ends of the upper side of the display 60 emit a plurality of infrared rays parallel to the display 60. This method receives light that is reflected by a reflecting member installed around the display 60 and returns along the same optical path as the light emitted by the light receiving element.
[0055] The touch sensor 116 outputs position information of the infrared rays radiated by the two light receiving and emitting devices that are blocked by the object to the touch sensor controller 115, and the touch sensor controller 115 identifies the coordinate position that is the contact position of the object. The touch sensor controller 115 also has a communication unit 115a, and can communicate with the input means 50 wirelessly.
[0056] If the display device 100 is capable of communication using a standard such as Bluetooth (registered trademark), a commercially available pen can be used as the input means 50. If one or more input means 50 are registered in advance in the communication unit 115a, the user can communicate with the display device 100 without having to perform connection settings to allow the input means 50 to communicate with the display device 100.
[0057] The power switch 127 is a switch for switching ON / OFF the power of the display device 100. The tilt sensor 117 is a sensor for detecting the tilt angle of the display device 100. It is mainly used to detect whether the display device 100 is being used in the installation state shown in FIG. 2(a), FIG. 2(b), or FIG. 2(c), and can automatically change the thickness of characters and the like depending on the installation state.
[0058] The serial interface 118 is an external communication interface such as a USB. The serial interface 118 is used for inputting information from the outside. The speaker 119 is used for audio output, and the microphone 121 is used for audio input. The wireless communication device 122 communicates with a terminal carried by the user, and relays a connection to the Internet, for example. The wireless communication device 122 communicates using Wi-Fi, Bluetooth (registered trademark), or the like, but any communication standard is acceptable. The wireless communication device 122 forms an access point, and when the user sets the SSID (Service Set Identifier) and password they have obtained in the terminal they carry, they can connect to the access point.
[0059] Preferably, the wireless communication device 122 is provided with two access points. a. Access point → Internet b. Access point → Internal network → Internet Access point a is for users outside the company, and users cannot access the company network but can use the Internet. Access point b is for users inside the company, and users can use the company network and the Internet.
[0060] The infrared I / F 123 detects the display device 100 arranged adjacently. The infrared I / F 123 can detect only the display device 100 arranged adjacently by utilizing the linearity of infrared rays. It is preferable to provide one infrared I / F 123 on each side, and it can detect in which direction of the display device 100 another display device 100 is arranged. This expands the screen, and it is possible to display handwritten information that was previously handwritten on the adjacent display device 100 (handwritten information on another page, with the area of one display 60 being one page), etc.
[0061] The power supply control circuit 124 controls an AC adapter 125 and a battery 126, which are power sources for the display device 100. The AC adapter 125 converts AC common to commercial power sources into DC.
[0062] If the display 60 is so-called electronic paper, it consumes little or no power to maintain the image display, and therefore can be driven by a battery 126. This makes it possible to use the display device 100 for purposes such as digital signage even in places where it is difficult to connect to a power source, such as outdoors.
[0063] The display device 100 further includes a bus line 110. The bus line 110 is an address bus, a data bus, or the like for electrically connecting the components such as the CPU 101 shown in FIG.
[0064] The touch sensor 116 is not limited to an optical type, and may be a capacitive touch panel that identifies the contact position by detecting changes in capacitance. The touch sensor 116 may also be a resistive film touch panel that identifies the contact position by detecting voltage changes across two opposing resistive films. The touch sensor 116 may also be an electromagnetic induction touch panel that identifies the contact position by detecting electromagnetic induction caused by an object touching the display unit, and various other detection means may be used. The touch sensor 116 may be of a type that does not require an electronic pen to detect whether or not a pen tip is touching. In this case, a fingertip or a pen-shaped stick can be used to perform a touch operation. The input means 50 does not have to be a long, thin pen-shaped panel.
[0065] 7 is a hardware configuration diagram of a mobile terminal 200 used in a display system 1 according to an embodiment of the present invention. For example, a smartphone is used as the mobile terminal 200. The mobile terminal 200 includes a CPU 201, a ROM 202, a RAM 203, an EEPROM 204, a CMOS sensor 205, an image sensor I / F 206, an acceleration / direction sensor 207, a media I / F 209, and a GPS receiver 211.
[0066] Of these, the CPU 201 controls the overall operation of the mobile terminal 200. The ROM 202 stores the CPU 201 and programs used to drive the CPU 201, such as the IPL. The RAM 203 is used as a work area for the CPU 201. The EEPROM 204 reads and writes various data, such as smartphone programs, under the control of the CPU 201.
[0067] The CMOS (Complementary Metal Oxide Semiconductor) sensor 205 is a type of built-in imaging means that captures an image of a subject (mainly a self-portrait) and obtains image data under the control of the CPU 201. Note that instead of a CMOS sensor, an imaging means such as a CCD (Charge Coupled Device) sensor may also be used.
[0068] The imaging element I / F 206 is a circuit that controls the driving of the CMOS sensor 205. The acceleration / azimuth sensor 207 is a variety of sensors, such as an electronic magnetic compass that detects geomagnetism, a gyrocompass, and an acceleration sensor. The media I / F 209 controls the reading and writing (storage) of data from and to a recording medium 208, such as a flash memory. The GPS receiver 211 receives GPS signals from GPS satellites.
[0069] The mobile terminal 200 also includes a long-distance communication circuit 212, a CMOS sensor 213, an image sensor I / F 214, a microphone 215, a speaker 216, an audio input / output I / F 217, a display 218, an external device connection I / F (Interface) 219, a short-distance communication circuit 220, an antenna 220a of the short-distance communication circuit 220, and a touch panel 221.
[0070] Of these, the long-distance communication circuit 212 is a circuit that communicates with other devices via the communication network N. The CMOS sensor 213 is a type of built-in imaging means that captures an image of a subject and obtains image data under the control of the CPU 201. The imaging element I / F 214 is a circuit that controls the driving of the CMOS sensor 213.
[0071] The microphone 215 is a built-in circuit that converts sound into an electrical signal. The speaker 216 is a built-in circuit that converts the electrical signal into physical vibrations to produce sound such as music or voice. The sound input / output I / F 217 is a circuit that processes the input and output of sound signals between the microphone 215 and the speaker 216 under the control of the CPU 201.
[0072] The display 218 is a type of display means such as a liquid crystal display or organic electroluminescence (EL) display that displays an image of a subject, various icons, etc. The external device connection I / F 219 is an interface for connecting various external devices.
[0073] The short-range communication circuit 220 is a communication circuit such as NFC (Near Field Communication), Bluetooth (registered trademark), etc. The touch panel 221 is a type of input means that allows the user to operate the mobile terminal 200 by pressing the display 218.
[0074] 7. The mobile terminal 200 also includes a bus line 210. The bus line 210 is an address bus, a data bus, or the like for electrically connecting the components such as the CPU 201 shown in FIG.
[0075] 8 is a diagram showing the hardware configuration of the terminal device 300 used in the display system 1 according to one embodiment of the present invention. Here, the hardware configuration of the terminal device 300 will be described.
[0076] As shown in FIG. 8, the terminal device 300 is constructed by a computer, and as shown in FIG. 8, it is equipped with a CPU 301, a ROM 302, a RAM 303, an HD 304, an HDD (Hard Disk Drive) controller 305, a display 306, an external device connection I / F (Interface) 308, a network I / F 309, a bus line 310, a keyboard 311, a pointing device 312, a DVD-RW (Digital Versatile Disk Rewritable) drive 314, and a media I / F 316.
[0077] Of these, the CPU 301 controls the overall operation of the terminal device 300. The ROM 302 stores programs such as IPL used to drive the CPU 301. The RAM 303 is used as a work area for the CPU 301. The HD 304 stores various data such as programs.
[0078] The HDD controller 305 controls reading and writing of various data from and to the HD 304 under the control of the CPU 301. The display 306 displays various information such as a cursor, menu, window, text, or image. The external device connection I / F 308 is an interface for connecting various external devices.
[0079] In this case, the external device is, for example, a USB (Universal Serial Bus) memory, a printer, etc. The network I / F 309 is an interface for performing data communication using the communication network N. The bus line 310 is an address bus, a data bus, etc. for electrically connecting the components such as the CPU 301 shown in FIG.
[0080] The keyboard 311 is a type of input means having multiple keys for inputting characters, numbers, various instructions, etc. The pointing device 312 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, etc. The DVD-RW drive 314 controls reading and writing of various data from a DVD-RW 313, which is an example of a removable recording medium. Note that this is not limited to a DVD-RW, and may be a DVD-R, etc. The media I / F 316 controls reading and writing (storing) of data from a recording medium 315, such as a flash memory.
[0081] <Device Functional Configuration> 9 is a block diagram showing the functional configuration of a display device 100 according to one embodiment of the present invention. The display device 100 includes an input receiving unit 11 and a display control unit 20.
[0082] The input acceptance unit 11 accepts input of stroke data into the first input area and the second input area by the input means 50. The input acceptance unit 11 also accepts a predetermined operation into the first input area. Furthermore, the input acceptance unit 11 may not accept input of stroke data into the corresponding first input area while the second input area is displayed.
[0083] The display control unit 20 displays the second input area when the amount of objects input into the first input area exceeds a threshold and a predetermined operation on the first input area is received. The predetermined operation may be an operation in which the input unit 50 touches the first input area for a time period equal to or longer than a time period indicating a long press criterion. Alternatively, the predetermined operation may be an operation in which the input unit 50 touches a predetermined figure displayed in the first input area.
[0084] The display control unit 20 displays an object corresponding to the stroke data in the first input area. Furthermore, when the amount of objects input in the first input area exceeds a threshold, the display control unit 20 displays at least a part of the object in an editable manner in the second input area.
[0085] The threshold value is the number of objects that can be displayed in the first input area. The threshold value may be a value determined based on the length of the first input area in the input direction and the size of the objects. In other words, the threshold value may be a value based on the first input area information.
[0086] <Correction of objects exceeding the displayable character limit> 10 shows an example of a first input area 61 and a second input area 62 in a display device 100 according to an embodiment of the present invention. The second input area 62 is displayed in association with the first input area 61. In FIG. 10, an example of a procedure for correcting text input into the first input area 61 is shown in the order of (a) to (d).
[0087] The display device of this embodiment displays objects in the second input area 62 during text input when the number of characters as the object amount is greater than the number of characters that can be displayed in the first input area 61 (hereinafter referred to as the displayable character number). An outline will be given below.
[0088] 10(a) shows an example of inputting text into the first input area 61. The number of characters that can be displayed in the first input area 61 and the input text as an object are as follows: Number of characters that can be displayed: 10 characters Input text: Request for water truck deployment to shelters A and B
[0089] Because the number of characters in the input text, which is the amount of objects, is greater than the number of characters that can be displayed, some of the objects that are entered later are not displayed, and only part of the object, "Water truck to shelter A and shelter B," is displayed in the first input area 61. Therefore, as shown in FIG. 10(b), when an amount of objects greater than the number of characters that can be displayed is input, the display device 100 displays a second input area 62 that includes the objects around the first input area 61. The user can check the objects that cannot be displayed in the first input area 61 by using the second input area 62.
[0090] In the following, displaying the second input area 62 will also be simply referred to as a “pop-up display.” Furthermore, when the number of objects is greater than the number of characters that can be displayed, it may be said that not all objects can be displayed.
[0091] Furthermore, when the number of objects is greater than the number of characters that can be displayed, inputting an object amount greater than the number of characters that can be displayed triggers the display device 100 of this embodiment to display a predetermined graphic 61a as shown in the figure in or around the first input area 61. Furthermore, when input of correction details in the second input area 62 is completed, a completion graphic 62a may be displayed in the second input area 62 to reflect that fact.
[0092] Fig. 10(c) shows an example in which the text "Request deployment of water tankers to evacuation shelters A and B" displayed in the second input area 62 has been corrected to "Request deployment of water tankers to evacuation shelters C and B." The corrected text in the second input area 62 is reflected in the first input area 61 as shown in Fig. 10(d).
[0093] In this way, the display device 100 according to this embodiment displays, in the second input area 62, at least the objects that cannot be displayed in the first input area 61 in an editable manner. The user can then input corrections in the second input area 62, where the entire text is displayed, making it easy to edit the objects.
[0094] <Automatic display of second input area 62> The following describes a process for automatically displaying the second input area 62. The first input area display unit 21 displays the first input area 61, and the input accepting unit 11 accepts input of stroke data into the first input area 61 by detecting the coordinates of the position where the input means 50 contacts the touch sensor. The converting unit 13 performs character recognition processing on one or more stroke data (handwritten data) handwritten by the user and converts them into objects. The first input area display unit 21 displays the objects input into the first input area 61 within the range of the number of characters that can be displayed in the first input area 61. If the amount of objects input into the first input area 61 exceeds a threshold, the display control unit 20 displays the second input area 62 and displays at least a portion of the object in the second input area 62 so that it can be edited. The threshold, which is a condition for displaying the second input area 62, may be the amount of objects that can be displayed in the first input area 61, or may be a value determined based on the length of the first input area 61 in the input direction and the size of the object. In other words, the threshold may be a value based on the first input area information.
[0095] 11 is a diagram illustrating the size of an object and the length of the first input area 61 in the input direction in the display device 100 according to one embodiment of the present invention. In the diagram, a indicates the size of the object input into the first input area 61, and b indicates the length of the first input area 61 in the input direction.
[0096] The threshold value that is a condition for displaying the second input area 62 may be a value (b / a) obtained by dividing the length of the first input area 61 in the input direction by the size of the object input in the first input area 61. For example, when the length in the input direction is a=20 cm and the size of the object is b=2 cm, the threshold value that is a condition for displaying the second input area 62 is 10 characters, and therefore the threshold value may be a condition for displaying the second input area 62 when 10 or more characters are input in the first input area 61. The length of the first input area 61 in the input direction and the size of the object input in the first input area 61 may be determined by referring to the "size" and "font size" of the first input area information.
[0097] 12 is a flow diagram of a process for automatically displaying the second input area 62 in the display device 100 according to one embodiment of the present invention. If the threshold value that is the condition for displaying the second input area 62 is set to the amount of objects that can be displayed in the first input area 61 (Yes in step S101), the determination unit 24 compares the amount of objects input in the first input area 61 with the threshold value (step S102).
[0098] If the amount of objects input in the first input area 61 is equal to or greater than the threshold (Yes in step S103), the display control unit 20 displays the second input area 62 (step S104). If the amount of objects input in the first input area 61 is less than the threshold (No in step S103), the display control unit 20 does not display the second input area 62 (step S105).
[0099] If the threshold value, which is the condition for displaying the second input area 62, is not set to the amount of objects that can be displayed in the first input area 61 (No in step S101), the judgment unit 24 compares the amount of objects input in the first input area 61 with the value (b / a) obtained by dividing the length of the first input area 61 in the input direction by the size of the object input in the first input area 61 (step S106).
[0100] If the amount of objects input in the first input area 61 is equal to or greater than the threshold (Yes in step S103), the display control unit 20 displays the second input area 62 (step S104). If the amount of objects input in the first input area 61 is less than the threshold (No in step S103), the display control unit 20 does not display the second input area 62 (step S105).
[0101] 13 is a diagram showing an example of changing the size of the second input area 62 in the display device 100 according to one embodiment of the present invention. In FIG. 13, (a) shows the state before the length of the input direction of the second input area 62 is changed, and (b) shows the state after the length of the input direction is changed. The input direction is the direction of the arrow in FIG. 13(a).
[0102] The length of the second input area 62 in at least the input direction can be changed, and the height can also be changed. When changing the length of the second input area 62 in the input direction, the input means 50 may be moved to the desired length while pressing and holding an end of the second input area 62, as shown in FIG. 13(a). After moving the end of the second input area 62 using the input means 50, the length of the second input area 62 in the input direction is changed, as shown in FIG. 13(b). The height of the second input area 62 may also be changed using a similar method.
[0103] <Manual display of the second input area> The display control unit 20 displays the second input area 62 when the amount of objects input into the first input area 61 exceeds a threshold and a predetermined operation on the first input area 61 is received. The predetermined operation may be an operation in which the input means 50 touches the first input area 61 for a time period equal to or longer than a time period indicating a long press criterion, or an operation in which the input means 50 touches a predetermined graphic 61a displayed in the first input area 61. The following describes processing in the case where the second input area 62 is manually displayed in this manner.
[0104] 14A and 14B are diagrams illustrating a process for manually displaying the second input area 62 in the display device 100 according to one embodiment of the present invention. In Fig. 14A, (a) shows a case where the input means 50 is pressed and held on the first input area 61, and (b) shows a case where the input means 50 touches a predetermined figure 61a displayed in the first input area 61.
[0105] 14(a), when a user wishes to display an object displayed in the first input area 61 in the second input area 62, the user may press and hold the first input area 61 using the input means 50. The second input area 62 may be displayed not only by a press and hold operation, but also by an operation such as circling the first input area 61.
[0106] 14(b), a predetermined figure is displayed in the first input area 61. In this case, the user can display the second input area 62 by touching the input means 50 to the predetermined figure 61a displayed in the first input area 61. In this way, the display device 100 according to one embodiment of the present invention allows the user to arbitrarily display the second input area 62.
[0107] 15 is a flow diagram of a process for manually displaying the second input area 62 in the display device 100 according to one embodiment of the present invention. If the threshold value, which is a condition for displaying the second input area 62, is the amount of objects that can be displayed in the first input area 61 (Yes in step S201), the determination unit 24 compares the amount of objects input in the first input area 61 with the threshold value (step S202).
[0108] If the amount of objects input into the first input area 61 is equal to or greater than the threshold (Yes in step S203) and if a predetermined operation by the input means into the first input area 61 has been received (Yes in step S204), the display control unit 20 displays the second input area 62 (step S205). If the amount of objects input into the first input area 61 is less than the threshold (No in step S203), the display control unit 20 does not display the second input area 62 (step S206).
[0109] If the threshold value, which is a condition for displaying the second input area 62, is not the object amount that can be displayed in the first input area 61 (No in step S201), the determination unit 24 compares the object amount input in the first input area 61 with a value (b / a) obtained by dividing the length of the first input area 61 in the input direction by the size of the object input in the first input area 61 (step S207). Then, the display control unit 20 processes the display of the second input area 62 based on the processes in steps S203 to S206.
[0110] As described above, when the amount of objects displayed in the first input area 61 exceeds the threshold and a predetermined operation is received in the first input area 61, the second input area 62 is displayed, so that the second input area 62 can be displayed at any timing when the user wants to edit the objects. This allows the user to display the second input area 62 at any timing and edit the objects.
[0111] <Associating the first and second input areas> The first input area 61 has identification information, and when the second input area 62 is displayed in response to a predetermined operation, it is associated with the identification information of the corresponding first input area 61. The association between the first input area 61 and the second input area 62 will be described below.
[0112] 16 shows an example of identification information associated with an object displayed in the first input area 61 when the object is displayed in the second input area 62 in the display device 100 according to one embodiment of the present invention. In FIG. 16, an example of the procedure for correcting the text input in the first input area 61 is shown in the order of (a) to (c). The input text as an object and the number of characters that can be displayed are the same as those in FIG. 10, and redundant explanations will be omitted.
[0113] 16(a), the first input area 61 has "0001" as identification information. When a predetermined operation is received on the first input area 61, the displayed second input area 62 is assigned "0001" as identification information and is associated with the first input area. In this case, the identification information assigned to the second input area 62 does not have to be "0001", the same as the identification information assigned to the first input area 61, as long as the identification information is assigned so that the second input area 62 is associated with the corresponding first input area 61.
[0114] 16(b) shows an example in which the text "Request deployment of water tankers to shelters A and B" displayed in the second input area 62 has been corrected to "Request deployment of water tankers to shelters C and B." The object corrected in the second input area 62 is added to the second input area 62 and is reflected in the first input area 61 with associated identification information, as shown in FIG. 16(c).
[0115] When the input of the correction content in the second input area 62 is completed, a completion symbol 62a to reflect that fact may be displayed in the second input area 62. The completion symbol may be a button-shaped symbol with the word "Confirm" displayed as shown in the figure, but is not limited to this.
[0116] When the input means 50 touches the completion graphic 62a, the correction content input in the second input area 62 may be reflected in the first input area 61. The correction content may be reflected in the first input area 61 not by the input means 50 touching the completion graphic 62a, but by the absence of the input means 50 touching the second input area 62 for a predetermined time, such as five seconds. Furthermore, in order to avoid unexpected duplicate corrections, when the input means 50 touches the completion graphic 62a, the completion graphic 62a may be erased.
[0117] In this way, the display device 100 according to this embodiment can correct the display of the associated first input area 61 even when, for example, multiple second input areas 62 are displayed at the same time. Therefore, the correction content in the second input area 62 is accurately reflected in the corresponding first input area 61.
[0118] 17 is a diagram showing examples of identification information for the first input area 61 and the second input area 62 in the display device 100 according to one embodiment of the present invention. The first input area 61 is provided with identification information as shown in advance. When the second input area 62 is displayed in response to a predetermined operation on the first input area 61, it is assigned identification information associated with the identification information of the corresponding first input area 61.
[0119] The second input area information storage unit 32 may store in advance, as shown in the figure, identification information to be assigned to the second input area 62. For example, if the identification information of the first input area 61 is "T0001", "P0001" may be assigned to the second input area 62. Alternatively, "P0003" may be assigned to the second input area 62.
[0120] 18 is a flow diagram of a process for associating the first input area 61 with the second input area 62 in the display device 100 according to one embodiment of the present invention. When the second input area 62 is displayed (step S301), the display control unit 20 assigns to the second input area 62 identification information associated with the identification information included in the corresponding first input area 61 (step S302).
[0121] The display control unit 20 inputs the correction content into the second input area 62 (Yes in step S303), and when the correction content is confirmed (Yes in step S304), searches for the corresponding first input area 61 based on the identification information assigned to the second input area 62 (step S305). Then, the display control unit 20 reflects the correction content in the first input area 61 (step S306). The correction content in the second input area 62 may be confirmed by, but is not limited to, contacting the input tool with a completion figure included in the second input area.
[0122] If no corrections are entered into the second input area 62 (No in step S303), if the corrections are not confirmed (No in step S304), or if the first input area 61 corresponding to the second input area 62 cannot be found ("Cannot be searched" in step S305), the display control unit 20 will not reflect the corrections in the first input area 61 (step S307).
[0123] <Preventing input errors> 19 is a diagram for explaining a method for suppressing erroneous input in the display device 100 according to one embodiment of the present invention. The illustrated example shows a case where the text "Request for deployment of water tankers to evacuation shelters A and B" entered in the first input area 61 is corrected to "Request for deployment of water tankers to evacuation shelters C and B" in the second input area 62.
[0124] The input receiving unit 11 may be configured to not accept input of stroke data into the corresponding first input area 61 while the second input area 62 is displayed. As shown in the figure, the display control unit 20 may make the user aware that input is not possible by displaying a mark in the first input area 61 that reads, for example, "Pop-up entry in progress." Alternatively, the display control unit 20 may gray out the first input area 61.
[0125] The display device 100 according to this embodiment can prevent erroneous input of text by not accepting input of stroke data into the corresponding first input area 61 while the second input area 62 is displayed.
[0126] <Information sharing system> 20 is a configuration diagram of an information sharing system 400 using a display device 100 according to one embodiment of the present invention. The information sharing system 400 has a display device 100A at the site and a display device 100X at headquarters, and may further have an information management server 3. The display device 100A and the display device 100X are connected to each other so that they can communicate with each other over a wide area network such as the Internet.
[0127] The display device 100A and the display device 100X are connected to the same session (for example, a conference related to the same disaster) by connecting to a URL issued by the information management server 3. The information management server 3 shares display data such as handwritten data among the multiple display devices 100 connected to the same session.
[0128] Note that data may be transmitted and received between the display devices 100A and 100X without going through the information management server 3, using a communication method such as WebRTC (Web Real Time Communication).
[0129] Display devices 100B to 100D at other sites may also be connected to the main body, and the display device 100X at headquarters can share triage information with the display devices 100B to 100D at a plurality of sites in parallel.
[0130] 21 is a functional block diagram of the information management server 3 used in the display system 1 according to one embodiment of the present invention. The hardware block diagram of the information management server 3 may be similar to that of a general-purpose computer. The information management server 3 has a communication unit 401, a sharing unit 402, and a display data storage unit 403. The communication unit 401 communicates with the display devices 100A to 100D on-site, and transmits metadata and display data (described later) from one display device 100 to the other display device 100.
[0131] The sharing unit 402 manages the display devices 100 connected to the same session, and performs processing to share metadata and display data between the display devices 100 connected to the same session.
[0132] The display data storage unit 403 stores display data such as handwritten data and text together with position information on the display 60. The display data is associated with a session ID. The session ID is identification information for a session in which the display data is shared.
[0133] <Application to server-client systems> Fig. 22 is a configuration diagram showing another example of a display system 1 according to an embodiment of the present invention. The functions of the display device 100 can also be realized in the form of a server-client system as shown in Fig. 22. The display device 100 and a server device 500 are connected via a network such as the Internet.
[0134] In such a display system 1, the display device 100 includes an input receiving unit 11, a drawing data generating unit 12, a network communication unit 15, an operation receiving unit 16, a display control unit 20, a first input area display unit 21, a second input area display unit 22, and a mark display unit 23, as shown in FIG. 3.
[0135] On the other hand, the server device 500 has a conversion unit 13, a data recording unit 14, and a network communication unit 15. The server device 500 may also have a first input area display unit 21, a second input area display unit 22, and a mark display unit 23, and transmit screen data for displaying the second input area, etc., on the display to the display device 100.
[0136] The network communication unit 15 of the display device 100 transmits the stroke data to the server device 500. The server device 500 transmits the recognition result of the handwritten data to the display device 100.
[0137] As described above, according to another example of the display system 1 according to an embodiment of the present invention, the display device 100 and the server device 500 can interactively display text data. Furthermore, since the object data is stored in the server device 500, the display device 100 in a remote location can connect to the server device 500 and share the object data in real time.
[0138] <Other application examples> The best mode for carrying out the present invention has been described above using examples, but the present invention is not limited to these examples in any way, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention.
[0139] For example, in the present embodiment, the case where the text is written horizontally has been described, but if the input area is vertically long, the text may also be written vertically.
[0140] Furthermore, the display device 100 according to this embodiment is configured to display the second input area 62 when the amount of objects input is greater than the number of characters that can be displayed, but the second input area 62 may also be displayed when the amount of objects input is equal to or less than the number of characters that can be displayed.
[0141] In addition, in the present embodiment, the display device 100 has been described as an electronic whiteboard by way of example, but the electronic whiteboard may also be called an electronic whiteboard, an electronic information board, or the like. Furthermore, the present embodiment can be suitably applied to any information processing device having a touch panel. Examples of information processing devices equipped with a touch panel include output devices such as PJs (Projectors), digital signage, HUDs (Head Up Display) devices, industrial machinery, imaging devices, sound collection devices, medical equipment, network appliances, notebook PCs, mobile phones, smartphones, tablet terminals, game consoles, PDAs (Personal Digital Assistants), digital cameras, wearable PCs, and desktop PCs.
[0142] Furthermore, although the display device 100 of this embodiment detects the coordinates by detecting the coordinates of the position on the display 60 where the input means 50 touches, the coordinates of the input means 50 may also be detected by ultrasonic waves. Furthermore, when an electronic pen is used as the input means 50, the electronic pen emits light and also emits ultrasonic waves, and the display device 100 calculates the distance based on the arrival time of the ultrasonic waves. The display device 100 can identify the position of the electronic pen based on the direction and distance, and the projector draws (projects) the trajectory of the electronic pen as stroke data.
[0143] In addition, the configuration examples shown in Fig. 3 and the like are divided according to main functions to facilitate understanding of the processing by the display device 100. The present invention is not limited by the manner in which the processing units are divided or the names of the processing units. The processing by the display device 100 can also be divided into more processing units depending on the processing content. Furthermore, it can also be divided so that one processing unit includes more processes.
[0144] Furthermore, each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, as well as devices such as an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), and conventional circuit modules designed to execute each of the above-described functions.
[0145] <Action and effect> The display system 1 according to this embodiment displays an object corresponding to stroke data in the first input area 61. Furthermore, when the amount of objects input into the first input area 61 exceeds a threshold, the display system 1 displays at least a portion of the objects in an editable manner in the second input area 62. Therefore, according to the display system 1, when an object exceeding a predetermined amount is displayed in a display component other than the input area, it becomes possible to edit the object displayed in the display component.
[0146] For example, aspects of the present invention are as follows. <1> an input receiving unit that receives input of stroke data into a first input area; a display control unit that displays an object corresponding to the stroke data in the first input area, and, when an amount of objects input in the first input area is equal to or exceeds a threshold, displays at least a part of the object in an editable manner in a second input area that is displayed in association with the first input area; A display device comprising: <2> the threshold value is the amount of the object that can be displayed in the first input area; The aforementioned <1> The display device according to claim 1. <3> the threshold value is a value determined based on the length of the first input area in the input direction and the size of the object. The aforementioned <1> or the above <2> The display device according to claim 1. <4> the input receiving unit receives a predetermined operation in the first input area; The display control unit When the amount of objects displayed in the first input area exceeds the threshold and a predetermined operation to the first input area is received, the second input area is displayed. The aforementioned <1> From the above <3> 10. The display device according to claim 9, wherein: <5> The predetermined operation on the first input area is an operation in which the time during which the input means contacts the first input area is equal to or longer than a time indicating a criterion for long press. The aforementioned <4> The display device according to claim 1. <6> the predetermined operation on the first input area is an operation of touching a predetermined figure displayed in the first input area with an input means; The aforementioned <4> The display device according to claim 1. <7> the first input area includes identification information; When the second input area is displayed in response to receiving a predetermined operation on the first input area, the second input area is associated with the identification information of the corresponding first input area. The aforementioned <1> From the above <3> 10. The display device according to claim 9, wherein: <8> The second input area can change its length at least in the input direction. The aforementioned <1> From the above <3> 10. The display device according to claim 9, wherein: <9> the input acceptance unit does not accept input of the stroke data into the corresponding first input area while the second input area is being displayed; The aforementioned <1> From the above <3> 10. The display device according to claim 9, wherein: <10> A display method executed by a display device, receiving input of stroke data into a first input area; displaying an object corresponding to the stroke data in the first input area, and, when an amount of the object input in the first input area is equal to or exceeds a threshold, displaying at least a part of the object in an editable manner in a second input area displayed in association with the first input area; Display methods including. <11> The computer equipped with the display device A process of receiving input of stroke data into a first input area; a process of displaying an object corresponding to the stroke data in the first input area, and, when an amount of the object input in the first input area is equal to or exceeds a threshold, displaying at least a part of the object in an editable manner in a second input area displayed in association with the first input area; A program to execute. [Explanation of symbols]
[0147] 1 Display System 11 Input reception section 20 Display control unit 50 Input Method 60 displays 61 First input area 62 Second input area 100 display device [Prior art documents] [Patent documents]
[0148] [Patent Document 1] Japanese Patent Application Publication No. 2023-140704
Claims
1. an input receiving unit that receives input of stroke data into a first input area; a display control unit that displays an object corresponding to the stroke data in the first input area, and, when an amount of the object input in the first input area is equal to or exceeds a threshold, displays at least a part of the object in an editable manner in a second input area that is displayed in association with the first input area; A display device comprising:
2. the threshold value is the amount of the object that can be displayed in the first input area; The display device according to claim 1 .
3. the threshold value is a value determined based on the length of the first input area in the input direction and the size of the object. The display device according to claim 1 .
4. the input receiving unit receives a predetermined operation in the first input area; The display control unit When the amount of objects displayed in the first input area exceeds the threshold and a predetermined operation to the first input area is received, the second input area is displayed. The display device according to claim 1 .
5. The predetermined operation on the first input area is an operation in which the time during which the input means contacts the first input area is equal to or longer than a time indicating a long press criterion. The display device according to claim 4 .
6. the predetermined operation on the first input area is an operation of touching a predetermined figure displayed in the first input area with an input means; The display device according to claim 4 .
7. the first input area comprises identification information; When the second input area is displayed in response to receiving a predetermined operation on the first input area, the second input area is associated with the identification information of the corresponding first input area. The display device according to claim 1 .
8. The length of the second input area can be changed at least in the input direction. The display device according to claim 1 .
9. the input acceptance unit does not accept input of the stroke data into the corresponding first input area while the second input area is being displayed; The display device according to claim 1 .
10. A display method executed by a display device, receiving input of stroke data into a first input area; displaying an object corresponding to the stroke data in the first input area, and, when an amount of the object input in the first input area is equal to or exceeds a threshold, displaying at least a part of the object in an editable manner in a second input area displayed in association with the first input area; Display methods including.
11. The computer equipped with the display device A process of receiving input of stroke data into a first input area; a process of displaying an object corresponding to the stroke data in the first input area, and, when an amount of the object input in the first input area is equal to or exceeds a threshold, displaying at least a part of the object in an editable manner in a second input area displayed in association with the first input area; A program to execute.
Citation Information
Patent Citations
Display device, display method, program, and information sharing system
JP2023140704A