Interactive information processing device and method

Abstract

The present invention relates to an interactive information processing device and method. The interactive information processing method according to this embodiment includes the steps of outputting interactive information compatible with an information output device that outputs tactile information through upward or downward driving of at least one information output unit to a first area divided into a plurality of grid cells that constitute a user interface screen, detecting coordinate information of the grid cell corresponding to the interactive information output to the first area, detecting coordinate information of an information output cell that matches one-to-one with the coordinate information of the grid cell, and generating a drive signal for the information output unit that corresponds to the coordinate information of the information output cell and transmitting it to the information output device.

Description

[Technical Field]

[0001] The present invention relates to an interactive information processing device and method. [Background technology]

[0002] Users can perceive information in a variety of ways. For this purpose, various types of information output devices are used, such as visual information output devices using printed matter, auditory information output devices using voice, and tactile information output devices using Braille.

[0003] In particular, in the case of tactile information output devices using Braille, the information that can be output is limited, so there is a demand for information processing devices that can process various graphic information such as graphs, diagrams, and equations and transmit it to the information output device.

[0004] The above-mentioned background art is technical information that the inventor possessed for the purpose of deriving the present invention or that he acquired in the process of deriving the present invention, and is not necessarily publicly known art that was made public to the general public prior to the filing of the present invention. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Korean Patent Publication No. 10-2012-0020641 (Published March 8, 2012) Summary of the Invention [Problem to be solved by the invention]

[0006] An object of the present invention is to provide an interactive information processing device and method for processing graphic information and transmitting the processed graphic information to a tactile information output device so that the graphic information can be confirmed on the tactile information output device.

[0007] The problems to be solved by the present invention are not limited to those described above, and other problems and advantages of the present invention not mentioned above can be understood from the following description and will be more clearly understood in the embodiments of the present invention. Furthermore, it will be understood that the problems to be solved and advantages of the present invention can be realized by the means and combinations thereof set forth in the claims. [Means for solving the problem]

[0008] The interactive information processing method according to this embodiment is an interactive information processing method executed by a processor of an interactive information processing device, and includes the steps of outputting interactive information compatible with an information output device that outputs tactile information through upward or downward driving of at least one or more information output units to a first area divided into a plurality of grid cells that constitute a user interface screen, detecting coordinate information of the grid cell corresponding to the interactive information output to the first area, detecting coordinate information of an information output cell that matches one-to-one with the coordinate information of the grid cell, and generating a drive signal for the information output unit corresponding to the coordinate information of the information output cell and transmitting it to the information output device.

[0009] An interactive information processing device according to this embodiment is an interactive information processing device that includes a processor and a memory operably connected to the processor and storing at least one code that is executed by the processor. The memory can store code that, when executed through the processor, causes the processor to output interactive information compatible with an information output device that outputs tactile information through upward or downward driving of at least one information output unit to a first area divided into a plurality of grid cells that constitute a user interface screen, detect coordinate information of the grid cell corresponding to the interactive information output to the first area, detect coordinate information of the information output cell that matches one-to-one with the coordinate information of the grid cell, generate a drive signal for the information output unit that corresponds to the coordinate information of the information output cell, and transmit the drive signal to the information output device.

[0010] In addition, other methods, other systems for implementing the present invention, and computer readable recording media storing computer programs for carrying out the methods can also be provided.

[0011] Other aspects, features, and advantages, in addition to those described above, will become apparent from the following drawings, claims, and detailed description of the invention. [Effects of the Invention]

[0012] According to the present invention, an interactive information processing device and method can be provided that processes graphic information and transmits it to a tactile information output device so that the graphic information can be confirmed on the tactile information output device.

[0013] The effects of the present invention are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is an exemplary diagram of an interactive information processing environment according to an embodiment of the present invention; [Figure 2] 1 is a block diagram showing an outline of the configuration of an interactive information processing apparatus according to an embodiment of the present invention; [Figure 3] 3 is a view showing an example of a user interface screen displayed on the interactive information processing device of FIG. 2. FIG. [Figure 4] 3 is a view showing an example of a user interface screen displayed on the interactive information processing device of FIG. 2. FIG. [Figure 5] 3 is a view showing an example of a user interface screen displayed on the interactive information processing device of FIG. 2. FIG. [Figure 6] 3 is a view showing an example of a user interface screen displayed on the interactive information processing device of FIG. 2. FIG. [Figure 7] 3 is a view showing an example of a user interface screen displayed on the interactive information processing device of FIG. 2. FIG. [Figure 8]1 is a diagram illustrating an example of an information output device included in an interactive information processing environment according to an embodiment of the present invention. [Figure 9] 1 is a diagram illustrating an example of an information output device included in an interactive information processing environment according to an embodiment of the present invention. [Figure 10] 1 is a diagram illustrating an example of an information output device included in an interactive information processing environment according to an embodiment of the present invention. [Figure 11] 1 is a flowchart illustrating an interactive information processing method according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0015] A WPS generation method according to one embodiment of the present invention is a method for automatically generating a WPS (welding procedure specification) using a machine learning algorithm, executed by a processor of a WPS generation device. The method transmits the WPS along with welding-related information, including the welding material and thickness of the welding material, related to the welding object. The advantages and features of the present invention, as well as methods for achieving the same, will become apparent with reference to the following detailed description of the embodiments, accompanied by the accompanying drawings. However, the present invention is not limited to the following embodiments, and may be embodied in different forms. It should be understood that the present invention encompasses all modifications, equivalents, and alternatives within the spirit and scope of the present invention. The following embodiments are provided to fully disclose the present invention and fully convey the scope of the invention to those skilled in the art. In describing the present invention, if it is determined that a detailed description of related known technology may obscure the gist of the present invention, such a detailed description will be omitted.

[0016] The terms used in this application are merely used to describe particular embodiments and are not intended to limit the present invention. The singular includes the plural unless the context clearly dictates otherwise. In this application, terms such as "comprise" or "have" specify the presence of features, numbers, steps, operations, components, parts, or combinations thereof described herein, but should be understood not to preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof. Terms such as "first," "second," and "second" can be used to describe various components, but the components should not be limited by these terms. These terms are used solely to distinguish one component from another.

[0017] Furthermore, in this application, a "module" may be a hardware component such as a processor or circuitry, and / or a software component executed by a hardware component such as a processor.

[0018] Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. In the description with reference to the accompanying drawings, the same or corresponding components will be given the same drawing numbers, and duplicate descriptions will be omitted.

[0019] In the following embodiments, terms such as first and second are not used in a limiting sense but are used to distinguish one component from another.

[0020] In the following embodiments, singular expressions include plural expressions unless the context clearly indicates otherwise.

[0021] In the following embodiments, terms such as "comprise" or "have" mean the presence of the features or components described in this specification, but do not preclude the possibility that one or more other features or components may be added.

[0022] Certain process sequences may be performed out of the order described when an embodiment is otherwise operable, for example, two processes described as successive may be performed substantially simultaneously or may be performed in the reverse order from that described.

[0023] 1 is a diagram illustrating an example of an interactive information processing environment according to an embodiment of the present invention. Referring to FIG. 1, the interactive information processing environment 1 may include an interactive information processing device 100, an information output device 200, and a network 300.

[0024] The interactive information processing device 100 can generate interactive information and transmit it to the information output device 200. In this embodiment, the information output device 200 can include an electronic device that outputs tactile information through an upward or downward drive of at least one information output unit (240 in FIG. 10).

[0025] The interactive information processing device 100 is information compatible with the information output device 200. Here, information compatibility may mean that the interactive information processing device 100 stores specification information and drive information of the information output device 200, the interactive information processing device 100 can generate interactive information based on the specification information and drive information of the information output device 200 and transmit it to the information output device 200, and the information output device 200 can output interactive information received from the interactive information processing device 100 without any special settings. In any embodiment, information compatibility may mean that haptic information output to the information output device 200 can be transmitted to the interactive information processing device 100 and output as visual information from the interactive information processing device 100.

[0026] In this embodiment, the interactive information may include one of a series of information sets that are processed to output visual information to the interactive information processing device 100 as tactile information to the information output device 200. In this embodiment, the visual information that is output to the interactive information processing device 100 may also be included in the interactive information.

[0027] In this embodiment, the interaction information may specifically include one or more files previously stored in the memory (130 in FIG. 2), such as a file previously generated in the first area and stored in the memory, a file captured in the first area and stored in the memory, etc. The interaction information may also include a file received through communication with an external device (e.g., a server, a user terminal, etc.).

[0028] Furthermore, the interactive information may include touch inputs generated by real-time touching of the first region (181 in FIG. 4). Furthermore, the interactive information may include a collection of touch inputs generated by touching of the first region until a touch signal of a print button (183a in FIG. 4) mounted in a third region (183 in FIG. 4) at a different position from the first region is received. Such interactive information may include one or more of graphic information and text information.

[0029] In this embodiment, the specification information of the information output device 200 may include, for example, the number and size of information output areas, the number of information output units included in the information output areas, the configuration and description of user interface buttons, etc. Furthermore, the driving information of the information output device 200 may include, for example, an operating power source, a signal required for raising or lowering the information output units, and a communication method with the interactive information processing device 100. In any embodiment, the interactive information processing device 100 may receive the specification information and driving information of the information output device 200 via communication with the information output device 200 and store the information in memory.

[0030] In one embodiment, the interactive information processing device 100 can determine from the specification information and driving information of the information output device 200 that the information output device 200 is configured with a first information output area (210-1 in FIG. 9) and a second information output area (210-2 in FIG. 9) configured at a position different from the first information output area from the first information output area from the specification information and driving information of the information output device 200. The interactive information processing device 100 can generate a driving signal for an information output unit to output graphic information in the first information output area, and can generate a driving signal for an information output unit to output text information in the second information output area and transmit the driving signal to the information output device 200.

[0031] In this embodiment, the interactive information processing device 100 may exist independently in the form of a server, or the interactive information processing device 100 may have its information processing functions implemented in the form of an application or software and installed in a user terminal (not shown).

[0032] Here, the user terminal may include a communication terminal capable of performing the functions of a computing device (not shown), and may be, but is not limited to, a desktop computer, smartphone, or laptop operated by a user, as well as a tablet PC, smart TV, mobile phone, personal digital assistant (PDA), media player, microserver, global positioning system (GPS) device, e-book reader, digital broadcasting terminal, navigation system, kiosk, MP3 player, digital camera, home appliance, and other mobile or non-mobile computing device. Such user terminals are not limited to those described above, and any terminal capable of web browsing may be used without limitation.

[0033] The information output device 200 may receive a drive signal for an information output unit from the interactive information processing device 100 and output predetermined information to an information output area. That is, the information output device 200 may be an electronic device capable of outputting information in Braille for visually impaired users. For example, the information output device 200 may include a Braille watch, a Braille pad, etc.

[0034] The network 300 can serve to connect the interactive information processing device 100 and the information output device 200. Such a network 300 can include, for example, wired networks such as a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), or an integrated service digital network (ISDN), as well as wireless networks such as a wireless LAN (WLAN), code-division multiple access (CDMA), or satellite communications, but the scope of the present invention is not limited thereto. Furthermore, the network 300 can transmit and receive information using short-range and / or long-range communications. Here, short-range communication can include Bluetooth, RFID (radio frequency identification), IrDA (infrared data association), UWB (ultra-wideband), ZigBee, and Wi-Fi technologies, and long-range communication can include CDMA (code-division multiple access), FDMA (frequency-division multiple access), TDMA (time-division multiple access), OFDMA (orthogonal frequency-division multiple access), and SC-FDMA (single carrier frequency-division multiple access) technologies.

[0035] Network 300 may include a connection of network elements such as hubs, bridges, routers, switches, etc. Network 300 may include one or more connected networks, e.g., a multi-network environment, including a public network such as the Internet and a private network such as a secure corporate private network. Access to network 300 may be provided via one or more wired or wireless access networks.

[0036] Additionally, network 300 may support CAN (controller area network) communication, V2I (vehicle to infrastructure) communication, V2X (vehicle to everything) communication, WAVE (wireless access in vehicular environment) communication technologies, IoT (Internet of Things) networks that exchange and process information between distributed components such as things, and / or 5G communication.

[0037] 2 is a block diagram showing an outline of the configuration of an interactive information processing device according to this embodiment. In the following description, parts that overlap with the description of FIG. 1 will be omitted. Referring to FIG. 2, the interactive information processing device 100 may include a communication unit 110, a display unit 120, a memory 130, and a processor 140.

[0038] The communication unit 110 may provide a communication interface necessary for providing transmission / reception signals to / from the information output device 200 in the form of packet data in cooperation with the network 300. Furthermore, the communication unit 110 may serve to receive a predetermined information request signal from the information output device 200 and to transmit information processed by the processor 140 to the information output device 200. Here, the communication interface refers to a medium that serves to connect the interactive information processing device 100 and the information output device 200, and may include a path that provides a connection path so that information can be transmitted and received after the information output device 200 is connected to the interactive information processing device 100. Furthermore, the communication unit 110 may be a device including hardware and software necessary for transmitting and receiving signals such as control signals and data signals to and from other network devices via wired or wireless connections.

[0039] The display unit 120 can output visual information related to the operation of the interactive information processing device 100, and can be implemented as a touch screen (not shown) by forming a mutual layer structure with a touch sensor or by forming the display unit 120 integrally with a touch sensor. Such a touch screen can function as a user input unit that provides an input interface to a user.

[0040] The display unit 120 may refer to a control panel capable of inputting and outputting information related to the interactive information processing device 100, and may be configured to allow not only inputting information related to the interactive information processing device 100 but also viewing information related to the interactive information processing device 100. The display unit 120 may be a predetermined display member such as a touch-sensitive organic light emitting display (OLED), a liquid crystal display (LCD), or a light emitting display (LED).

[0041] In this embodiment, a microphone (not shown) capable of inputting a voice signal may be further included as an input interface provided to the user. The microphone is one embodiment, and its location and mounting method are not limited, and any input means for inputting a voice signal may be used. Also, in one embodiment, the touch screen is also one embodiment, and its location and mounting method are not limited, and any input means for inputting a user request signal may be used.

[0042] Meanwhile, in this embodiment, the output interface may further include a speaker (not shown). The speaker may output information related to the operation of the interactive information processing device 100 as auditory information. That is, the speaker may output information related to the operation of the interactive information processing device 100 as audio information, and may also output notification messages such as warning sounds, notification sounds, and error states, as well as information corresponding to user voice commands, processing results corresponding to user voice commands, and the like, as audio under the control of the processor 140. In one embodiment, the speaker may include any output means for outputting audio signals, and its location and actual implementation method are not limited.

[0043] The memory 130 is connected to the processor 140 and can store code that, when executed by the processor 140, enables the processor 140 to support various functions of the interactive information processing device 100. That is, the memory 130 can store a plurality of application programs (or applications) run by the interactive information processing device 100, as well as information and instructions for the operation of the interactive information processing device 100. At least some of these application programs can be downloaded from an external server via wireless communication. The memory 130 can also store information on one or more users who wish to interact with the interactive information processing device 100. Such user information can include authentication information (e.g., facial information, body type information, voice information, etc.) that can be used to identify the recognized user.

[0044] The memory 130 can also store information about tasks to be performed by the interactive information processing device 100 in response to user voice commands (such as commands for controlling the interactive information processing device 100).

[0045] In this embodiment, the memory 130 may temporarily or permanently store data processed by the processor 140. The memory 130 may include a magnetic storage medium or a flash memory, although the scope of the present invention is not limited thereto. The memory 130 may include an internal memory and / or an external memory, and may include a volatile memory such as a DRAM, an SRAM, or an SDRAM; a non-volatile memory such as a one-time programmable ROM (OTPROM), a PROM, an EPROM, an EEPROM, a mask ROM, a flash ROM, a NAND flash memory, or a NOR flash memory; a flash drive such as an SSD, a compact flash (CF) card, an SD card, a Micro-SD card, a Mini-SD card, an XD card, or a memory stick; or a storage device such as an HDD.

[0046] The processor 140, as a type of central processing unit, can drive control software stored in the memory 130 to control the overall operation of the interactive information processing device 100. The processor 140 may refer to, for example, a data processing device implemented in hardware having a physically structured circuit for executing functions expressed by code or instructions included in a program. Examples of such data processing devices implemented in hardware include a microprocessor, a central processing unit (CPU), a processor core, a multiprocessor, an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc., but the scope of the present invention is not limited thereto.

[0047] The processor 140 can output a user interface screen (150 in FIG. 3) to the display unit 120. The processor 140 can generate and output response information corresponding to a user's touch on the user interface screen.

[0048] The processor 140 can output interactive information compatible with the information output device 200 to a first region (181 in FIG. 4) divided into a plurality of grid cells that make up the user interface screen.

[0049] The processor 140 may detect coordinate information of grid cells corresponding to the interactive information output to the first region. Coordinate information, for example, (1,1) to (N,M), may be preset for each of the plurality of grid cells constituting the first region, and the preset coordinate information may be stored in the memory 130.

[0050] When interactive information is output to the first region, the grid cells can be classified into grid cells displaying meaningful information (e.g., 181-1 in FIG. 6) and grid cells displaying meaningless information (e.g., 181-2 in FIG. 6). The processor 140 can detect coordinate information of grid cells displaying meaningful information and coordinate information of grid cells displaying meaningless information.

[0051] The processor 140 can detect coordinate information of an information output cell (230 in FIG. 10) that matches one-to-one with the coordinate information of the grid cell. Here, one-to-one matching can include the number of grid cells that make up the first area (181 in FIG. 4) being the same as the number of information output cells that make up the information output area (210-1 and 210-2 in FIG. 8) included in the information output device 200. That is, the coordinate information of the grid cell and the coordinate information of the information output cell may be the same.

[0052] However, the coordinate information of the grid cell and the coordinate information of the information output cell are not necessarily the same, and there are cases where the coordinate information of the grid cell and the coordinate information of the information output cell are different. When the coordinate information of the grid cell and the coordinate information of the information output cell are different, the coordinate information of the grid cell and the coordinate information of the information output cell that matches the coordinate information of the grid cell can be tabulated and stored in memory 130.

[0053] Processor 140 may detect coordinate information of an information output cell that matches coordinate information of a grid cell in which meaningful information is displayed. Processor 140 may also detect coordinate information of an information output cell that matches coordinate information of a grid cell in which meaningless information is displayed. Here, the coordinate information of the information output cell that matches coordinate information of a grid cell in which meaningful information is displayed is assumed to be first coordinate information of the information output cell, and the coordinate information of the information output cell that matches coordinate information of a grid cell in which meaningless information is displayed is assumed to be second coordinate information of the information output cell.

[0054] The processor 140 can generate drive signals for the information output units corresponding to the coordinate information of the information output cells and transmit them to the information output device 200. The processor 140 can generate an up drive signal for the information output unit corresponding to the first coordinate information of the information output cell, and generate a down drive signal for the information output unit corresponding to the second coordinate information of the information output cell. The processor 140 can transmit the up drive signal or the down drive signal together with the first coordinate information or the second coordinate information corresponding to the up or down drive signal, respectively, to the information output device 200.

[0055] In one embodiment, before outputting interactive information to the first region, processor 140 can receive a touch on a grid cell display menu (182a in FIG. 4) implemented in a second region (182 in FIG. 4) that is located differently from the first region constituting the user interface screen. Processor 140 can display a plurality of grid cells in the first region by receiving a first touch signal for the grid cell display menu, and can terminate display of the plurality of grid cells from the first region by receiving a second touch signal for the grid cell display menu.

[0056] In one embodiment, the processor 140 can activate a page description screen by receiving a touch signal on a page description screen (183b in FIG. 4) implemented in a third area (183 in FIG. 4) that is located differently from the first area constituting the user interface screen. The processor 140 can receive input of explanatory text of interactive information to be output from the page description screen to the first area. The processor 140 can determine completion of reception of the explanatory text and convert the explanatory text into Braille by receiving a touch signal on a Braille conversion menu (183c in FIG. 4) implemented in a location different from the page description screen in the third area. The processor 140 can display the result of converting the explanatory text into Braille on a Braille output screen (183d in FIG. 4) implemented in a location different from the Braille conversion menu in the third area. The processor 140 can transmit the result of conversion into Braille displayed on the Braille output screen to the information output device 200.

[0057] In this embodiment, the processor 140 can generate a drive signal for the information output unit and transmit it to the information output device 200 so that the result of the conversion into Braille is output to a second information output area (210-2 in FIG. 9) of the information output device 200. In another embodiment, the processor 140 can generate a drive signal for the information output unit and transmit it to the information output device 200 so that graphic information is output to a first information output area (210-1 in FIG. 9) and the result of the conversion into Braille is output to a second information output area. In yet another embodiment, the processor 140 can output graphic information to the first information output area, and when a preset time (e.g., 10 seconds) has elapsed, the processor 140 can generate a drive signal for the information output unit and transmit it to the information output device 200 so that the output of the graphic information from the first information output area is terminated and the result of the conversion into Braille is output.

[0058] Figures 3 to 5 are exemplary views of user interface screens displayed on the interactive information processing device of Figure 2. In the following description, parts that overlap with the description of Figures 1 and 2 will be omitted. With reference to Figures 3 to 7, processor 140 can generate and control response information corresponding to a user's touch on the user interface screen.

[0059] The user interface screen 150 shown in FIGS. 3 to 5 may include a first user interface area 160, a second user interface area 170, and a third user interface area 180.

[0060] The first user interface area 160 may include a 1-1 UI menu 160a to a 1-3 UI menu 160c. When the processor 140 receives a touch signal on the 1-1 UI menu 160a, it can move the user interface screen currently displayed on the display unit 120 to a canvas page. When the processor 140 receives a touch signal on the 1-2 UI menu 160b, it can move the user interface screen currently displayed on the display unit 120 to a drive page. When the processor 140 receives a touch signal on the 1-3 UI menu 160c, it can change the language of the user interface screen currently displayed on the display unit 120 to English or Korean.

[0061] The second user interface area 170 may include a 2-1 UI menu 170a to a 2-7 UI menu 170g. When the processor 140 receives a touch signal for the 2-1 UI menu 170a (New), it can generate a new DTMS document. Here, DTMS may include an extension name of a document file generated in the interactive information processing device 100. When the processor 140 receives a touch signal for the 2-2 UI menu 170b (Open), it can open a conventional DTMS document. When the processor 140 receives a touch signal for the 2-3 UI menu 170c (Import), it can insert a DTMS document. When the processor 140 receives a touch signal for the 2-4 UI menu 170d (Export), it can save a DTMS file to a specified local location, for example, a specified location on a device (not shown) in which the interactive information processing device 100 is implemented, or a specified location on an external device (not shown) connected to the interactive information processing device 100. The processor 140 can save a DTMS document when it receives a touch signal on the 2-5 UI menu 170e (Save). The processor 140 can generate a braille engine language when it receives a touch signal on the 2-6 UI menu 170f (Settings). The processor 140 can input a file name when it receives a touch signal on the 2-7 UI menu 170g (Filename).

[0062] The third user interface area 180 may again include a first area 181, a second area 182, and a third area 183. The interactive information described above may be output to the first area 181. The processor 140 may output graphic information and / or text information in response to a touch on the first area 181. The processor 140 may open a file in the first area 181 and output graphic information and / or text information contained in the file.

[0063] 4, a plurality of grid cells are displayed in first region 181, and the plurality of grid cells may be displayed or the display may be terminated in response to a touch on grid cell display menu 182a provided in second region 182. When processor 140 receives a first touch signal on grid cell display menu 182a, it can display the plurality of grid cells in first region 181 as shown in FIG. 4. When processor 140 receives a second touch signal on grid cell display menu 182a, it can terminate the display of the plurality of grid cells from first region 181 as shown in FIG. 5.

[0064] A plurality of menus 182a to 182v are provided in the second area 182, and a touch on any of the menus may change the interactive information output in the first area 181. When the processor 140 receives a touch signal on the grid cell display menu 182a, the processor 140 may display a plurality of grid cells in the first area 181 or terminate the display of a plurality of grid cells from the first area 181.

[0065] When processor 140 receives a touch signal of page navigation menu 182b, it can move a file by thumbnail (page). When processor 140 receives a touch signal of an up arrow, it can move a file up. When processor 140 receives a touch signal of a down arrow, it can move a file down.

[0066] When the processor 140 receives a touch signal of the add page menu 182c, it can add a new page to the previously saved pages.

[0067] When processor 140 receives a touch signal of undo / redo menu 182d, it can undo the touch input in first region 181 or perform an undo.

[0068] When processor 140 receives a touch signal of thickness setting menu 182e, it can set various thicknesses of information to be displayed by touch on first region 181. When the leftmost thickness setting menu is touched, the thickness of information to be displayed by touch on first region 181 can be the thinnest, and when the rightmost thickness setting menu is touched, the thickness of information to be displayed by touch on first region 181 can be the thickest. Here, the thinnest thickness may include, but is not limited to, displaying information equivalent to 1 / 2 grid cell with one touch on first region 181. Furthermore, the thickest thickness may include, but is not limited to, displaying information equivalent to three grid cells with one touch on first region 181.

[0069] When the processor 140 receives a touch signal of the pen menu 182f, it can activate the pen and cause it to display information that the user inputs through receiving clicks and drags on the first area 181.

[0070] When the processor 140 receives a touch signal of the symmetrically drawn menu 182g, it can activate the corresponding menu and symmetrically display the information input by the user through receiving a click and drag on the first region 181.

[0071] When the processor 140 receives a touch signal of the screen movement menu 182h, it can activate the corresponding menu and move the screen by receiving a click and drag on the first region 181.

[0072] When the processor 140 receives a touch signal of the fill menu 182i, it can activate the corresponding menu and fill the clicked grid cell with a set color through receiving a click on the first region 181.

[0073] When the processor 140 receives a touch signal of the eraser menu 182j, it can activate the corresponding menu and erase the information displayed through receiving a click and drag on the first region 181.

[0074] When the processor 140 receives a touch signal of the clear all menu 182k, it can activate the corresponding menu and clear all the information displayed through receiving a click on the first area 181.

[0075] When the processor 140 receives a touch signal of the line drawing menu 182l, it can activate the corresponding menu and draw a line in the selected grid cell through receiving a click and drag on the first region 181.

[0076] When the processor 140 receives a touch signal of the rectangle drawing menu 182m, it can activate the corresponding menu and draw a rectangle in the grid cell selected through receiving a click and drag on the first region 181.

[0077] When the processor 140 receives a touch signal of the circle drawing menu 182n, it can activate the corresponding menu and draw a circle in the grid cell selected through receiving a click and drag on the first region 181.

[0078] When the processor 140 receives a touch signal of the triangle drawing menu 182o, it can activate the corresponding menu and draw a triangle in the grid cell selected through receiving a click and drag on the first region 181.

[0079] When processor 140 receives a touch signal from text input menu 182p, it activates the corresponding menu and displays a text insertion screen on first area 181. When text is entered into the text insertion screen, the text can be converted into Braille in real time and displayed.

[0080] When the processor 140 receives a touch signal of the table drawing menu 182q, it can activate the corresponding menu and draw a table on the first region 181 through receiving a click and drag.

[0081] When processor 140 receives a touch signal of text insertion menu 182r, it can display a screen for opening a text file on first area 181 and convert the selected file into Braille in real time and display it in first area 181.

[0082] When the processor 140 receives a touch signal of the image insertion menu 182s, it can display an image insertion screen on the first area 181 and output the selected image to the first area 181.

[0083] When the processor 140 receives a touch signal of the square selection menu 182t, it can activate the corresponding menu and select a square through receiving a click and drag on the first region 181.

[0084] When the processor 140 receives a touch signal of the free selection menu 182u, it activates the corresponding menu, and allows the user to freely select a grid cell on the first region 181 through receiving a click and drag.

[0085] When the processor 140 receives a touch signal of the color menu 182v, it can display the color that is set upon left-click or right-click for the grid cell in which meaningful information is displayed that is output to the first area 181.

[0086] When the processor 140 receives a touch signal of the palette menu 182w, it can set the touched color to be used.

[0087] A plurality of menus 183a to 183d may be provided in the third area 183. When the processor 140 receives a touch signal on the print menu 183a, it can transmit the interactive information output in the first area 181 to the information output device 200.

[0088] When the processor 140 receives a touch signal of the page description screen menu 183b, it can activate the page description screen and input explanatory text of the interactive information to be output in the first area 181.

[0089] When the processor 140 receives a touch signal of the Braille conversion menu 183c, it can convert the description text entered on the page description screen into Braille and display the Braille conversion result in the page description-Braille area 183d.

[0090] 6 and 7 are exemplary views of interactive information output to the third user interface area 180. In the following description, portions that overlap with the description of FIGS. 1 to 5 will be omitted. Referring to FIGS. 6 and 7, the processor 140 can generate and control response information corresponding to a user's touch on the third user interface area 180.

[0091] 6 shows interactive information output to the first area 181 in response to a result of moving a file by thumbnail (page) when the processor 140 receives a touch signal from the page move menu 182b. In this embodiment, the interactive information may include hanbok graphic information. The hanbok in the first area 181 may be displayed in grid cell 181-1, where meaningful information is displayed, and grid cell 181-2, where meaningless information is displayed.

[0092] 6 shows interactive information output in the first area 181 by moving a file up when the processor 140 receives a touch signal of an up arrow in the page navigation menu 182b. The interactive information in this embodiment may include Taegeukgi (Taegukgi) graphic information. In this embodiment, the page explanation screen displays explanatory text of the interactive information output in the first area 181, for example, "This is the Taegeukgi." The page explanation-Braille area 183d shows an example in which the Braille conversion result of the explanatory text is output.

[0093] 8 to 10 are diagrams illustrating an information output device included in an interactive information processing environment according to this embodiment. Referring to Fig. 8 to 10, the information output device 200 may include a first information output area 210-1, a second information output area 210-2, and a plurality of user interfaces 220.

[0094] The first information output area 210-1 and the second information output area 210-2 are configured with a plurality of information output units 240 and can output interactive information in Braille format, including one or more of graphic information and text information. In this embodiment, the size of the first information output area 210-1 may be larger than that of the second information output area 210-2.

[0095] In this embodiment, graphic information may be output to the first information output area 210-1 and text information may be output to the second information output area 210-2, but this is not limited to this, and either graphic information or text information may be output to either the first information output area 210-1 or the second information output area 210-2.

[0096] The plurality of user interfaces 220 may include an operation unit for operating the information output device 200. Such an operation unit may be configured with a sensor, button, or switch structure that can recognize a touch or press operation by a user.

[0097] 10 is a diagram illustrating the operation of the information output cells 230 included in the first information output area 210-1 and the second information output area 210-2 of FIG. 1. Referring to FIG. 10, the first information output area 210-1 and the second information output area 210-2 may include a plurality of information output cells 230. Braille information output to the first information output area 210-1 and the second information output area 210-2 may be output in units of information output cells 230 including information output units 240 arranged in four rows and two columns, and when applied to this embodiment, the information output cell 230 may include eight information output units 240.

[0098] In this embodiment, one information output cell 230 is limited to including eight information output units 240, but this is not limited thereto, and one information output cell 230 can include two or more information output units 240, up to eight information output units 240, and in some cases can include even more information output units 240.

[0099] The information output unit 240 according to this embodiment receives a driving signal for the information output unit from the interactive information processing device 100, and can output information through an upward driving or downward driving.

[0100] 11 is a flowchart for explaining the interactive information processing method according to this embodiment. In the following explanation, parts that overlap with the explanations of FIGS. 1 to 10 will be omitted. The interactive information processing method according to this embodiment will be explained assuming that the interactive information processing device 100 executes the method using the processor 140 with the help of peripheral components.

[0101] Referring to FIG. 11 , in step S1110, the processor 140 may output interactive information compatible with the information output device 200 to a first region divided into a plurality of grid cells constituting a user interface screen. In this embodiment, the interactive information may specifically include one or more files previously stored in the memory 130, such as a file previously generated in the first region and stored in memory, and a file captured in the first region and stored in memory. The interactive information may also include a file received through communication with an external device (e.g., a server, a user terminal, etc.). The interactive information may also include a touch input generated by a real-time touch on the first region. The interactive information may also include a collection of touch inputs generated by a touch on the first region until a touch signal of a print button implemented in a third region different from the first region is received. Such interactive information may include one or more of graphic information and text information.

[0102] In step S1120, the processor 140 may detect coordinate information of the grid cell corresponding to the interactive information output in the first region.

[0103] In step S1130, the processor 140 can find coordinate information of the information output cell that has a one-to-one match with the coordinate information of the grid cell.

[0104] In step S1140, the processor 140 can generate and send to the information output device 200 a driving signal for the information output unit corresponding to the coordinate information of the information output cell.

[0105] In this embodiment, before outputting the interactive information, processor 140 can receive a touch on a grid cell display menu implemented in a second region that is located differently from the first region constituting the user interface screen. Processor 140 can display the plurality of grid cells in the first region by receiving a first touch signal for the grid cell display menu, and can end the display of the plurality of grid cells from the first region by receiving a second touch signal for the grid cell display menu.

[0106] In this embodiment, before transmitting a drive signal to the information output device 200, the processor 140 can activate a page description screen by receiving a touch signal of a page description screen implemented in a third area, which is different from the first area constituting the user interface screen. The processor 140 can receive input of explanatory text of interactive information to be output to the first area from the page description screen. When the processor 140 receives a touch signal of a Braille translation button implemented in the third area, the processor 140 can determine completion of reception of the explanatory text and convert the explanatory text into Braille. The processor 140 can display the result of converting the explanatory text into Braille on a Braille output screen implemented in the second area. The processor 140 can transmit the result of conversion into Braille displayed on the Braille output screen to the information output device. The processor 140 can generate a drive signal for an information output unit corresponding to the result of conversion into Braille and transmit the drive signal to the information output device 200.

[0107] In this embodiment, the processor 140 may receive specification information and driving information of the information output device from the information output device before transmitting a driving signal to the information output device 200. Here, the specification information and driving information related to the driving of the information output device 200 may include information related to a first information output area and a second information output area configured in a position different from the first information output area. The processor 140 may generate a driving signal for the information output unit so that graphic information is output in the first information output area, and may generate a driving signal for the information output unit so that text information is output in the second information output area, and transmit the driving signal to the information output device 200.

[0108] The above-described embodiments of the present invention may be implemented in the form of a computer program executable by various components on a computer, and such a computer program may be recorded on a computer-readable medium, which may include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, etc.

[0109] Meanwhile, the computer program may be specially designed and constructed for the present invention, or may be one that is well known and available to those skilled in the art of computer software. Examples of the computer program include not only machine language code such as that produced by a compiler, but also high-level language code that can be executed by a computer using an interpreter, etc.

[0110] The use of the term "said" and similar indicators in the present specification (particularly in the claims) can correspond to both the singular and the plural. Furthermore, when a range is stated in the present invention, it is considered to include inventions to which individual values ​​belonging to said range are applied (unless otherwise specified), and is the same as if each individual value constituting said range were stated in the detailed description of the invention.

[0111] Unless otherwise expressly stated or contrary to the order of steps constituting the method of the present invention, the steps may be performed in any suitable order. The present invention is not necessarily limited to the order of the steps described above. The use of all examples or exemplary terms (e.g., etc.) in the present invention is merely for the purpose of explaining the present invention in detail, and the scope of the present invention is not limited by such examples or exemplary terms unless otherwise limited by the claims. Furthermore, those skilled in the art will understand that various modifications, combinations, and variations may be made depending on design conditions and factors within the scope of the appended claims or their equivalents.

[0112] Therefore, the concept of the present invention should not be limited to the above-described embodiments, and all scopes equivalent to or modified equivalently from the scope of the claims, as well as the scope of the claims described below, can be said to fall within the scope of the concept of the present invention. [Explanation of symbols]

[0113] 100: Interactive information processing device 200: Information output device 300: Network

Claims

1. 1. An interactive information processing method executed by a processor of an interactive information processing device, comprising: outputting interactive information compatible with an information output device that outputs tactile information through upward or downward movement of at least one information output unit in a first region divided into a plurality of grid cells that constitute a user interface screen; detecting coordinate information of a grid cell corresponding to the interactive information output to the first area; detecting coordinate information of an information output cell that matches one-to-one with the coordinate information of the grid cell; generating a driving signal for an information output unit corresponding to the coordinate information of the information output cell and transmitting the driving signal to the information output device; Interactive information processing methods.

2. before the step of outputting the interactive information, receiving a touch on a grid cell display menu implemented in a second area of ​​the user interface screen that is different from the first area; displaying the plurality of grid cells in the first area by receiving a first touch signal for the grid cell display menu, and ending display of the plurality of grid cells from the first area by receiving a second touch signal for the grid cell display menu.

2. The interactive information processing method according to claim 1.

3. The step of outputting interactive information includes: and opening one of a selected file from one or more pre-stored files and a file received through communication with an external device in the first area and outputting the interactive information, The one or more pre-stored files are the file includes one or more of a file previously generated in the first area and stored in memory and a file previously captured in the first area and stored in memory; 2. The interactive information processing method according to claim 1.

4. The step of outputting interactive information includes: outputting one of a set of touch inputs generated by a real-time touch on the first area and a set of touch inputs generated by a touch on the first area as interactive information until a touch signal of a print button mounted on a third area at a position different from the first area is received; 2. The interactive information processing method according to claim 1.

5. The step of outputting interactive information includes: outputting interactive information including one or more of the first region, graphic information, and text information; 5. The interactive information processing method according to claim 3 or 4.

6. before the step of transmitting to the information output device, When a touch signal of a page explanation screen implemented in a third area that is different from the first area constituting the user interface screen is received, the page explanation screen is activated; receiving an input of explanatory text of the interactive information output to the first area from the page explanation screen; When receiving a touch signal of a Braille conversion menu implemented at a position different from the page description screen in the third area, determining completion of reception of the description text and converting the description text into Braille; a step of displaying a result of converting the explanatory text into Braille on a Braille output screen mounted at a position different from the Braille conversion menu in the third area; a step of transmitting the Braille conversion result displayed on the Braille output screen to the information output device; 2. The interactive information processing method according to claim 1.

7. The step of transmitting to the information output device includes: generating a drive signal for the information output unit corresponding to the result of conversion into Braille and transmitting the drive signal to the information output device; 7. The interactive information processing method according to claim 6.

8. before the step of transmitting to the information output device, further comprising receiving specification information and driving information of the information output device from the information output device; Specification information and driving information relating to driving of the information output device, The information includes information about a first information output area and a second information output area configured at a position different from the first information output area, The interactive information includes: including one or more of graphical information and textual information; The step of transmitting to the information output device includes: generating a driving signal for the information output unit so that the graphic information is output in the first information output area, and generating a driving signal for the information output unit so that the text information is output in the second information output area, and transmitting the driving signal to the information output device; 2. The interactive information processing method according to claim 1.

9. A computer-readable recording medium storing a computer program for executing the method according to any one of claims 1 to 8 using a computer.

10. As an interactive information processing device, a processor; a memory operatively connected to the processor and storing at least one code to be executed by the processor; When the memory is executed via the processor, the processor outputs interactive information compatible with an information output device that outputs tactile information through upward or downward drive of at least one information output unit to a first region divided into a plurality of grid cells that constitute a user interface screen; Detecting coordinate information of a grid cell corresponding to the interactive information output to the first area; Detecting coordinate information of an information output cell that matches one-to-one with the coordinate information of the grid cell; storing a code for generating a driving signal for an information output unit corresponding to the coordinate information of the information output cell and transmitting the driving signal to the information output device; Interactive information processing device.

Images