Interactive information processing device and method

Abstract

The present invention relates to an interactive information processing device and method. The interactive information processing method according to this embodiment includes the steps of outputting interactive information compatible with an information output device that outputs tactile information through upward or downward driving of at least one information output unit to a first area divided into a plurality of grid cells that constitute a user interface screen, detecting coordinate information of the grid cell corresponding to the interactive information output to the first area, detecting coordinate information of an information output cell that matches one-to-one with the coordinate information of the grid cell, and generating a drive signal for the information output unit that corresponds to the coordinate information of the information output cell and transmitting it to the information output device.

Description

[Technical Field]

[0001] The present invention relates to an interactive information processing apparatus and method. [Background Art]

[0002] Users can recognize information through various methods. For this reason, various types of information output apparatuses are used. For example, visual information output apparatuses using printed materials, auditory information output apparatuses using audio, tactile information output apparatuses using Braille, and the like are used.

[0003] Particularly in the case of a tactile information output apparatus using Braille, the amount of outputtable information is limited, and thus there is a need for an information processing apparatus capable of processing various types of graphic information such as graphs, diagrams, and equations and transmitting the processed information to the information output apparatus.

[0004] The above-mentioned background art is technical information that the inventor possessed for the derivation of the present invention or acquired during the process of deriving the present invention, and is not necessarily a publicly known art that has been disclosed to the general public before the filing of the present application. [Prior Art Documents] [Patent Documents]

[0005] [Patent Document 1] Korean Unexamined Patent Publication No. 10-2012-0020641 (published March 08, 2012) [Summary of the Invention] [Problem to be Solved by the Invention]

[0006] One object of the present invention is to provide an interactive information processing apparatus and method that process graphic information and transmit the processed graphic information to a tactile information output apparatus so that the graphic information can be confirmed on the tactile information output apparatus.

[0007] The problems that this invention aims to solve are not limited to those described above, and other problems and advantages of this invention that are not mentioned can be understood from the following description and will be more clearly understood in the embodiments of this invention. Furthermore, it will be understood that the problems and advantages that this invention aims to solve can be achieved by the means and combinations thereof shown in the claims. [Means for solving the problem]

[0008] The interactive information processing method according to this embodiment is an interactive information processing method executed by the processor of an interactive information processing device, and may include the steps of: outputting interactive information compatible with an information output device that outputs tactile information through upward or downward driving of at least one information output unit to a first region divided into a plurality of grid cells constituting a user interface screen; detecting coordinate information of a grid cell corresponding to the interactive information output to the first region; detecting coordinate information of an information output cell that is one-to-one matched with the coordinate information of the grid cell; and generating a drive signal for an information output unit corresponding to the coordinate information of the information output cell and transmitting it to the information output device.

[0009] The interactive information processing device according to this embodiment is an interactive information processing device that includes a processor and a memory operably connected to the processor and storing at least one code executed by the processor, wherein the memory can store code that, when executed via the processor, outputs interactive information compatible with an information output device that outputs haptic information through upward or downward driving to at least one information output unit to a first region divided into a plurality of grid cells constituting a user interface screen, detects the coordinate information of a grid cell corresponding to the interactive information output to the first region, detects the coordinate information of an information output cell that matches the coordinate information of the grid cell one-to-one, and generates a drive signal for an information output unit corresponding to the coordinate information of the information output cell and transmits it to the information output device.

[0010] In addition, other methods, other systems, and computer-readable recording media storing computer programs for performing the present invention can be further provided.

[0011] Other aspects, features, and advantages not mentioned above will become clear from the following drawings, claims, and detailed description of the invention. [Effects of the Invention]

[0012] According to the present invention, an interactive information processing device and method can be provided that processes graphic information and transmits it to a haptic information output device so that the graphic information can be viewed on the haptic information output device.

[0013] The effects of the present invention are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description. [Brief explanation of the drawing]

[0014] [Figure 1] This is an illustrative diagram of an interactive information processing environment according to this embodiment. [Figure 2] This block diagram is shown to provide a schematic explanation of the configuration of the interactive information processing device according to this embodiment. [Figure 3] Figure 2 is an example diagram of the user interface screen displayed on the interactive information processing device. [Figure 4] Figure 2 is an example diagram of the user interface screen displayed on the interactive information processing device. [Figure 5] Figure 2 is an example diagram of the user interface screen displayed on the interactive information processing device. [Figure 6] Figure 2 is an example diagram of the user interface screen displayed on the interactive information processing device. [Figure 7] Figure 2 is an example diagram of the user interface screen displayed on the interactive information processing device. [Figure 8]It is an illustrative diagram of an information output device included in an interactive information processing system according to the present embodiment. [Figure 9] It is an illustrative diagram of an information output device included in an interactive information processing system according to the present embodiment. [Figure 10] It is an illustrative diagram of an information output device included in an interactive information processing system according to the present embodiment. [Figure 11] It is a flowchart for explaining an interactive information processing method according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0015] A WPS generation method according to an embodiment of the present invention is executed by a processor of a WPS (welding procedure specification) generation apparatus, and is a method for automatically generating a WPS using a machine learning algorithm. The WPS is transmitted together with welding-related information including a welding material for an object to be welded and the thickness of the welding material. In addition, the advantages and features of the present invention, and methods for achieving them, will become apparent by referring to the embodiments described in detail with the accompanying drawings. However, the present invention is not limited to the embodiments presented below, and can be implemented in different forms. It should be understood that the present invention includes all modifications, equivalents or alternatives falling within the spirit and technical scope of the present invention. The embodiments presented below are provided to complete the disclosure of the present invention and to fully inform those skilled in the art to which the present invention pertains of the scope of the present invention. In the description of the present invention, if it is determined that a specific description of related known technologies may obscure the gist of the present invention, the detailed description thereof will be omitted.

[0016] The terms used in the present application are merely used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, terms such as "comprising" or "having" are used to specify that the features, numbers, steps, operations, components, parts, or combinations thereof described in the present specification exist, and it should be understood that this does not preclude in advance the existence or possibility of adding one or more other features, numbers, steps, operations, components, parts, or combinations thereof. Terms such as first and second may be used to describe various components, but the components are not to be limited by said terms. Said terms are only used for the purpose of distinguishing one component from another.

[0017] Furthermore, in the present application, a "unit" may be a hardware component such as a processor or a circuit, and / or a software component executed by a hardware component such as a processor.

[0018] Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. In the description with reference to the accompanying drawings, the same or corresponding components are assigned the same reference numerals, and overlapping descriptions are omitted.

[0019] In the following embodiments, terms such as first and second are used not in a limiting sense, but for the purpose of distinguishing one component from another.

[0020] In the following embodiments, singular expressions include plural expressions unless the context clearly dictates otherwise.

[0021] In the following embodiments, terms such as "comprising" or "having" mean that the features or components described in the present specification exist, and do not preclude in advance the possibility of adding one or more other features or components.

[0022] Where other embodiments are possible, a particular process sequence may be performed in a different manner than described. For example, two processes described consecutively may be performed substantially simultaneously, or they may proceed in the reverse order of the described sequence.

[0023] Figure 1 is an illustrative diagram of an interactive information processing environment according to this embodiment. Referring to Figure 1, the interactive information processing environment 1 may include an interactive information processing device 100, an information output device 200, and a network 300.

[0024] The interactive information processing device 100 can generate interactive information and transmit it to the information output device 200. In this embodiment, the information output device 200 may include an electronic device that outputs tactile information through upward or downward driving to at least one or more information output units (240 in Figure 10).

[0025] The interactive information processing device 100 is information-compatible with the information output device 200. Here, information compatibility means that the interactive information processing device 100 stores the specification information and drive information of the information output device 200, the interactive information processing device 100 can generate interactive information based on the specification information and drive information of the information output device 200 and transmit it to the information output device 200, and the information output device 200 can output the interactive information received from the interactive information processing device 100 without any special settings. In any embodiment, information compatibility means that tactile information output to the information output device 200 can be transmitted to the interactive information processing device 100 and output as visual information from the interactive information processing device 100.

[0026] In this embodiment, interactive information may include one of a series of information sets processed to output visual information output to the interactive information processing device 100 as tactile information to the information output device 200. In this embodiment, visual information output to the interactive information processing device 100 may also be included in the interactive information.

[0027] In this embodiment, the interactive information may specifically include one or more files pre-stored in memory (130 in Figure 2), such as files previously generated in the first area and stored in memory, and files captured in the first area and stored in memory. The interactive information may also include files received through communication with external devices (e.g., servers, user terminals, etc.).

[0028] Furthermore, interactive information may include touch input generated by real-time touch in the first region (181 in Figure 4). Additionally, interactive information may include a set of touch inputs generated by touch in the first region until a touch signal is received from a print button (183a in Figure 4) implemented in a third region (183 in Figure 4) located at a different position from the first region. Such interactive information may include one or more of graphic and textual information.

[0029] In this embodiment, the specification information of the information output device 200 may include, for example, the number and size of each information output area, the number of information output units included in the information output area, and the configuration and description of user interface buttons. The drive information of the information output device 200 may include, for example, the operating power supply, the signals necessary for the upward or downward movement of the information output unit, and the communication method with the interactive information processing device 100. In any embodiment, the interactive information processing device 100 may receive the specification information and drive information of the information output device 200 via communication and store them in memory.

[0030] In one embodiment, the interactive information processing device 100 can determine from the specification information and drive information of the information output device 200 that the information output device 200 is composed of a first information output area (210-1 in Figure 9) and a second information output area (210-2 in Figure 9) configured at a different location from the first information output area. The interactive information processing device 100 can generate a drive signal for the information output unit so that graphic information is output to the first information output area, and generate a drive signal for the information output unit so that text information is output to the second information output area, and transmit these signals to the information output device 200.

[0031] In this embodiment, the interactive information processing device 100 may exist independently in server form, or the interactive information processing device 100 may implement information processing functions in application form or software form and be mounted on a user terminal (not shown).

[0032] Here, a user terminal may include a communication terminal capable of performing the functions of a computing device (not shown), and may be, but not limited to, a desktop computer, smartphone, or laptop computer operated by the user, as well as a tablet PC, smart TV, mobile phone, PDA (personal digital assistant), media player, microserver, GPS (global positioning system) device, e-book reader, terminal for digital broadcasting, navigation system, kiosk, MP3 player, digital camera, home appliance, and other mobile or non-mobile computing device. Such user terminals are not limited to those described above, and any terminal capable of browsing the web can be used without restriction.

[0033] The information output device 200 can receive a drive signal for the information output unit from the interactive information processing device 100 and output predetermined information to the information output area. In other words, the information output device 200 may be an electronic device capable of outputting information in braille for visually impaired users. For example, the information output device 200 may include a braille watch, a braille pad, etc.

[0034] The network 300 can serve to connect the interactive information processing device 100 and the information output device 200. Such a network 300 can encompass wired networks such as LAN (local area network), WAN (wide area network), MAN (metropolitan area network), and ISDN (integrated service digital network), as well as wireless networks such as WLAN (wireless LAN), CDMA (code-division multiple access), and satellite communications, but the scope of the present invention is not limited to these. Furthermore, the network 300 can send and receive information using short-range and / or long-range communications. Here, short-range communication can include Bluetooth, RFID (radio frequency identification), IrDA (infrared data association), UWB (ultra-wideband), ZigBee, and Wi-Fi technologies, while long-range communication can include CDMA (code-division multiple access), FDMA (frequency-division multiple access), TDMA (time-division multiple access), OFDMA (orthogonal frequency-division multiple access), and SC-FDMA (single carrier frequency-division multiple access) technologies.

[0035] Network 300 may include connections to network elements such as hubs, bridges, routers, and switches. Network 300 may include one or more connected networks, such as a multi-network environment, including public networks like the internet and private networks like secure corporate private networks. Access to Network 300 may be provided via one or more wired or wireless access networks.

[0036] Furthermore, Network 300 can support CAN (controller area network) communication, V2I (vehicle to infrastructure) communication, V2X (vehicle to everything) communication, WAVE (wireless access in vehicular environment) communication technologies, as well as IoT (Internet of Things) networks and / or 5G communication that exchange and process information between distributed components such as objects.

[0037] Figure 2 is a block diagram illustrating the configuration of the interactive information processing device according to this embodiment. In the following description, any parts that overlap with the description of Figure 1 will be omitted. Referring to Figure 2, the interactive information processing device 100 may include a communication unit 110, a display unit 120, a memory 130, and a processor 140.

[0038] The communication unit 110 can provide a communication interface necessary to provide transmission and reception signals between the network 300 and the information output device 200 in the form of packet data. Furthermore, the communication unit 110 can play a role in receiving a predetermined information request signal from the information output device 200 and transmitting the information processed by the processor 140 to the information output device 200. Here, the communication interface can include a path that provides a connection path so that the information output device 200 can send and receive information after connecting to the interactive information processing device 100, as a medium that connects the interactive information processing device 100 and the information output device 200. In addition, the communication unit 110 may be a device that includes hardware and software necessary to send and receive signals such as control signals and data signals via wired or wireless connections with other network devices.

[0039] The display unit 120 can output information related to the operation of the interactive information processing device 100 as visual information, and can be implemented as a touchscreen (not shown) by forming an interlayer structure with the touch sensor or by integrating it. Such a touchscreen can function as a user input unit that provides an input interface to the user.

[0040] The display unit 120 can be defined as a control panel capable of inputting and outputting information related to the interactive information processing device 100, and also capable of confirming information related to the interactive information processing device 100. The display unit 120 may be a predetermined display element such as a touch-recognizable OLED (organic light emitting display), LCD (liquid crystal display), or LED (light emitting display).

[0041] In this embodiment, the input interface provided to the user may further include a microphone (not shown) capable of receiving audio signals. The microphone is one embodiment, and its position and implementation method are not limited, and the input means for receiving audio signals can be used without restriction. Similarly, in one embodiment, the touchscreen's position and implementation method are not limited, and the input means for receiving user request signals can be used without restriction.

[0042] On the other hand, in this embodiment, the output interface may further include a speaker (not shown). The speaker can output information regarding the operation of the interactive information processing device 100 as auditory information. That is, the speaker can output information regarding the operation of the interactive information processing device 100 as audio information, and can also output warning sounds, notification sounds, notification messages such as error states, information corresponding to user voice commands, and processing results corresponding to user voice commands as audio, in accordance with the control of the processor 140. In one embodiment, the speaker's position and implementation method are not limited, and it may include all output means for outputting audio signals.

[0043] Memory 130 is connected to the processor 140 and can store code that, when executed by the processor 140, enables the processor 140 to support various functions of the interactive information processing device 100. Specifically, memory 130 can store multiple application programs (or applications) driven by the interactive information processing device 100, information for the operation of the interactive information processing device 100, and instructions. At least some of such application programs can be downloaded from an external server via wireless communication. Memory 130 can also store information for one or more users attempting to interact with the interactive information processing device 100. Such user information may include authorization information (e.g., facial and body shape information, voice information, etc.) that can be used to identify who the recognized user is.

[0044] Furthermore, the memory 130 can store information about tasks that the interactive information processing device 100 should perform in response to user voice commands (for example, commands to control the interactive information processing device 100).

[0045] In this embodiment, the memory 130 can perform the function of temporarily or permanently storing data processed by the processor 140. Here, the memory 130 may include a magnetic storage media or flash storage media, but the scope of the present invention is not limited thereto. Such memory 130 may include internal memory and / or external memory and may include volatile memory such as DRAM, SRAM, or SDRAM; non-volatile memory such as OTPROM (one-time programmable ROM), PROM, EPROM, EEPROM, mask ROM, flash ROM, NAND flash memory, or NOR flash memory; flash drives such as SSDs, CF (compact flash) cards, SD cards, Micro-SD cards, Mini-SD cards, Xd cards, or memory sticks; or storage devices such as HDDs.

[0046] The processor 140, acting as a kind of central processing unit, can control the operation of the entire interactive information processing unit 100 by driving control software installed in the memory 130. The processor 140 can mean, for example, a hardware-integrated data processing unit having physically structured circuits to execute functions expressed by code or instructions contained in a program. Examples of such hardware-integrated data processing units include microprocessors, central processing units (CPUs), processor cores, multiprocessors, ASICs (application-specific integrated) and FPGAs (field programmable gate arrays), but the scope of the present invention is not limited thereto.

[0047] The processor 140 can output a user interface screen (150 in Figure 3) to the display unit 120. The processor 140 can generate and output response information corresponding to user touches on the user interface screen.

[0048] The processor 140 can output interactive information compatible with the information output device 200 to a first region (181 in Figure 4) which is divided into multiple grid cells that constitute the user interface screen.

[0049] The processor 140 can detect the coordinate information of the grid cells corresponding to the interactive information output to the first region. Each of the multiple grid cells constituting the first region is pre-configured with coordinate information, for example, (1,1) to (N,M), and this pre-configured coordinate information can be stored in the memory 130.

[0050] When interactive information is output to the first region, it can be classified into grid cells that display meaningful information (e.g., 181-1 in Figure 6) and grid cells that display meaningless information (e.g., 181-2 in Figure 6). The processor 140 can detect the coordinate information of the grid cells that display meaningful information and the coordinate information of the grid cells that display meaningless information.

[0051] The processor 140 can detect the coordinate information of an information output cell (230 in Figure 10) that has a one-to-one match with the coordinate information of a grid cell. Here, a one-to-one match can include the fact that the number of grid cells constituting the first region (181 in Figure 4) and the number of information output cells constituting the information output regions (210-1 and 210-2 in Figure 8) included in the information output device 200 are the same. In other words, the coordinate information of the grid cell and the coordinate information of the information output cell may be the same.

[0052] However, the coordinate information of grid cells and the coordinate information of information output cells are not always the same, and there may be cases where the coordinate information of grid cells and information output cells are different. When the coordinate information of grid cells and the coordinate information of information output cells are different, the coordinate information of grid cells and the coordinate information of information output cells that match the coordinate information of grid cells can be put into a table and stored in memory 130.

[0053] The processor 140 can detect coordinate information of an information output cell that matches the coordinate information of a grid cell where meaningful information is displayed. The processor 140 can also detect coordinate information of an information output cell that matches the coordinate information of a grid cell where meaningless information is displayed. Here, we assume that the coordinate information of an information output cell that matches the coordinate information of a grid cell where meaningful information is displayed is the first coordinate information of the information output cell, and that the coordinate information of an information output cell that matches the coordinate information of a grid cell where meaningless information is displayed is the second coordinate information of the information output cell.

[0054] The processor 140 can generate drive signals for information output units corresponding to the coordinate information of information output cells and transmit them to the information output device 200. The processor 140 can generate an upward drive signal for an information output unit corresponding to the first coordinate information of an information output cell, and a downward drive signal for an information output unit corresponding to the second coordinate information of an information output cell. The processor 140 can transmit the upward drive signal or the downward drive signal, along with the first coordinate information or the second coordinate information corresponding to the upward or downward drive signal, to the information output device 200 together.

[0055] In one embodiment, the processor 140 can receive a touch on a grid cell display menu (182a in Figure 4) implemented in a second area (182 in Figure 4) located at a different position from the first area constituting the user interface screen, before outputting interactive information to the first area. The processor 140 can display multiple grid cells in the first area by receiving a first touch signal for the grid cell display menu, and can terminate the display of the multiple grid cells from the first area by receiving a second touch signal for the grid cell display menu.

[0056] In one embodiment, the processor 140 can activate the page explanation screen by receiving a touch signal from the page explanation screen (183b in Figure 4) which is implemented in a third area (183 in Figure 4) at a different location from the first area constituting the user interface screen. The processor 140 can receive input of explanatory text for interactive information output from the page explanation screen to the first area. The processor 140 can determine that it has finished receiving the explanatory text and convert the explanatory text into Braille by receiving a touch signal from the Braille conversion menu (183c in Figure 4) which is implemented at a different location from the page explanation screen in the third area. The processor 140 can display the result of converting the explanatory text into Braille on the Braille output screen (183d in Figure 4), which is implemented at a different location from the Braille conversion menu in the third area. The processor 140 can transmit the Braille conversion result displayed on the Braille output screen to the information output device 200.

[0057] In this embodiment, the processor 140 can generate a drive signal for the information output unit and transmit it to the information output device 200 so that the result of converting to Braille is output to the second information output area (210-2 in Figure 9) of the information output device 200. In another embodiment, the processor 140 can generate a drive signal for the information output unit and transmit it to the information output device 200 so that graphic information is output to the first information output area (210-1 in Figure 9) and the result of converting to Braille is output to the second information output area. In yet another embodiment, the processor 140 can output graphic information to the first information output area, and after a preset time (for example, 10 seconds) has elapsed, it can terminate the output of graphic information from the first information output area and generate a drive signal for the information output unit and transmit it to the information output device 200 so that the result of converting to Braille is output.

[0058] Figures 3 to 5 are illustrative diagrams of the user interface screens displayed in the interactive information processing device shown in Figure 2. In the following description, any parts that overlap with the descriptions of Figures 1 and 2 will be omitted. Referring to Figures 3 to 7, the processor 140 can generate and control response information corresponding to user touches on the user interface screen.

[0059] The user interface screen 150 shown in Figures 3 to 5 may include a first user interface area 160, a second user interface area 170, and a third user interface area 180.

[0060] The first user interface area 160 may include the first-1st UI menu 160a to the first-3rd UI menu 160c. When the processor 140 receives a touch signal for the first-1st UI menu 160a, it can move the user interface screen currently displayed on the display unit 120 to the canvas page. When the processor 140 receives a touch signal for the first-2nd UI menu 160b, it can move the user interface screen currently displayed on the display unit 120 to the drive page. When the processor 140 receives a touch signal for the first-3rd UI menu 160c, it can change the language of the user interface screen currently displayed on the display unit 120 to English or Korean.

[0061] The second user interface area 170 may contain the second-first UI menus 170a to the second-seventh UI menus 170g. When the processor 140 receives a touch signal for the second-first UI menu 170a (New), it can generate a new DTMS document. Here, DTMS may include the file extension name of the document file generated in the interactive information processing device 100. When the processor 140 receives a touch signal for the second-second UI menu 170b (Open), it can open a conventional DTMS document. When the processor 140 receives a touch signal for the second-third UI menu 170c (Import), it can insert a DTMS document. When the processor 140 receives a touch signal for the second-fourth UI menu 170d (Export), it can save the DTMS file to a specified local location, for example, a specified location on the device (not shown) on which the interactive information processing device 100 is implemented, or a specified location on an external device (not shown) connected to the interactive information processing device 100. When processor 140 receives a touch signal for UI menu 170e (Save) of the second to fifth, it can save the DTMS document. When processor 140 receives a touch signal for UI menu 170f (Settings) of the second to sixth, it can generate the braille translation engine language. When processor 140 receives a touch signal for UI menu 170g (File name) of the second to seventh, it can input a file name.

[0062] The third user interface area 180 may again include the first area 181, the second area 182, and the third area 183. The first area 181 can output the interactive information described above. The processor 140 can output graphic information and / or text information on the first area 181 by touch. The processor 140 can open a file on the first area 181 and output the graphic information and / or text information contained in the file.

[0063] Referring to Figure 4, multiple grid cells are displayed in the first area 181. Multiple grid cells may be displayed or terminated depending on the touch of the grid cell display menu 182a provided in the second area 182. When the processor 140 receives a first touch signal for the grid cell display menu 182a, it can display multiple grid cells in the first area 181, as shown in Figure 4. When the processor 140 receives a second touch signal for the grid cell display menu 182a, it can terminate the display of multiple grid cells from the first area 181, as shown in Figure 5.

[0064] The second area 182 is provided with multiple menus 182a to 182v, and touching any of these menus can change the interactive information output to the first area 181. When the processor 140 receives a touch signal for the grid cell display menu 182a, it can either display multiple grid cells in the first area 181 or terminate the display of multiple grid cells from the first area 181.

[0065] When processor 140 receives a touch signal from page navigation menu 182b, it can move files in thumbnail (page) units. When processor 140 receives an up arrow touch signal, it can move files upwards. When processor 140 receives a down arrow touch signal, it can move files downwards.

[0066] When the processor 140 receives a touch signal from the page addition menu 182c, it can add a new page to a previously saved page.

[0067] When the processor 140 receives a touch signal for the undo / redo menu 182d, it can either undo the touch input in the first area 181 or cancel the undo operation.

[0068] When the processor 140 receives a touch signal from the thickness setting menu 182e, it can set various thicknesses of the information displayed by touch on the first area 181. When the leftmost thickness setting menu is touched, the thickness of the information displayed by touch on the first area 181 can be set to the thinnest, and when the rightmost thickness setting menu is touched, the thickness of the information displayed by touch on the first area 181 can be set to the thickest. Here, the thinnest thickness may include, but is not limited to, the display of information equivalent to 1 / 2 grid cell with a single touch on the first area 181. Furthermore, the thickest thickness may include, but is not limited to, the display of information equivalent to 3 grid cells with a single touch on the first area 181.

[0069] When the processor 140 receives a touch signal from the pen menu 182f, it can activate the pen and display information entered by the user through the reception of clicks and drags on the first area 181.

[0070] When the processor 140 receives a touch signal for a symmetrically drawn menu 182g, it can launch the corresponding menu and symmetrically display the information entered by the user through the reception of clicks and drags on the first area 181.

[0071] When the processor 140 receives a touch signal for the screen movement menu 182h, it can launch the corresponding menu and move the screen through the reception of clicks and drags on the first area 181.

[0072] When the processor 140 receives a touch signal for the fill menu 182i, it can launch the corresponding menu and, through receiving a click on the first area 181, fill the clicked grid cell with the set color.

[0073] When the processor 140 receives a touch signal for the eraser menu 182j, it can launch the corresponding menu and erase the displayed information through the reception of clicks and drags on the first area 181.

[0074] When the processor 140 receives a touch signal for the all-clear menu 182k, it can activate the corresponding menu and erase all the displayed information by receiving a click on the first area 181.

[0075] When the processor 140 receives a touch signal for the line drawing menu 182l, it can launch the corresponding menu and draw lines on the selected grid cells via clicks and drags on the first area 181.

[0076] When the processor 140 receives a touch signal for the rectangle drawing menu 182m, it can launch the corresponding menu and draw a rectangle in the selected grid cell through the reception of clicks and drags on the first area 181.

[0077] When the processor 140 receives a touch signal for the circle drawing menu 182n, it can launch the corresponding menu and draw a circle on the selected grid cell through the reception of clicks and drags on the first region 181.

[0078] When the processor 140 receives a touch signal for the triangle drawing menu 182o, it can launch the corresponding menu and draw a triangle on the selected grid cell via click and drag reception on the first area 181.

[0079] When the processor 140 receives a touch signal from the text input menu 182p, it activates the corresponding menu, displays a text insertion screen on the first area 181, and when text is entered into the text insertion screen, it can convert the text into Braille in real time and display it.

[0080] When the processor 140 receives a touch signal for the table drawing menu 182q, it can launch the corresponding menu and draw the table on the first area 181 through the reception of clicks and drags.

[0081] When the processor 140 receives a touch signal from the text insertion menu 182r, it can display a screen for opening a text file on the first area 181, and convert the selected file into Braille in real time and display it on the first area 181.

[0082] When the processor 140 receives a touch signal for the image insertion menu 182s, it can display the image insertion screen on the first area 181 and output the selected image to the first area 181.

[0083] When the processor 140 receives a touch signal for the square selection menu 182t, it launches the corresponding menu and can select a square by receiving clicks and drags on the first area 181.

[0084] When the processor 140 receives a touch signal from the free selection menu 182u, it launches the corresponding menu and allows the user to freely select grid cells on the first area 181 through clicks and drags.

[0085] When the processor 140 receives a touch signal from the color menu 182v, it can display the color set during a left-click or right-click for the grid cell that displays meaningful information output to the first area 181.

[0086] When the processor 140 receives a touch signal from the palette menu 182w, it can be configured to use the touched color.

[0087] Multiple menus 183a to 183d may be provided in the third area 183. When the processor 140 receives a touch signal for the print menu 183a, it can transmit the interactive information output to the first area 181 to the information output device 200.

[0088] When the processor 140 receives a touch signal from the page description screen menu 183b, it can launch the page description screen and input explanatory text for the interactive information to be output to the first area 181.

[0089] When the processor 140 receives a touch signal from the braille conversion menu 183c, it can convert the explanatory text entered on the page explanation screen into braille and display the braille result in the page explanation-braille area 183d.

[0090] Figures 6 and 7 are illustrative diagrams of interactive information output to the third user interface area 180. In the following description, any parts that overlap with the descriptions of Figures 1 to 5 will be omitted. Referring to Figures 6 and 7, the processor 140 can generate and control response information corresponding to user touch on the third user interface area 180.

[0091] Figure 6 shows interactive information output to the first area 181 corresponding to the result of moving the file in thumbnail (page) units when the processor 140 receives a touch signal for the page navigation menu 182b. The interactive information in this embodiment may include Hanbok (Korean traditional clothing) graphic information. The Hanbok on the first area 181 may be displayed in grid cells 181-1 where meaningful information is displayed and grid cells 181-2 where meaningless information is displayed.

[0092] Figure 6 shows interactive information output to the first area 181 when the processor 140 receives an up arrow touch signal from the page navigation menu 182b and moves the file upward. The interactive information in this embodiment may include Taegukgi (Korean flag) graphic information. In this embodiment, the page description screen displays explanatory text for the interactive information output to the first area 181, for example, "This is the Taegukgi," and the page description-braille area 183d shows an example where the braille conversion result for the explanatory text is output.

[0093] Figures 8 to 10 are illustrative diagrams of an information output device included in the interactive information processing environment according to this embodiment. Referring to Figures 8 to 10, the information output device 200 can include a first information output area 210-1, a second information output area 210-2, and a plurality of user interfaces 220.

[0094] The first information output area 210-1 and the second information output area 210-2 are composed of a plurality of information output units 240 and can output interactive information including one or more of graphic information and text information in Braille format. In this embodiment, the size of the first information output area 210-1 may be larger than that of the second information output area 210-2.

[0095] In this embodiment, graphic information may be output to the first information output area 210-1 and text information may be output to the second information output area 210-2, but it is not limited to this, and either graphic information or text information may be output to either the first information output area 210-1 or the second information output area 210-2.

[0096] Multiple user interfaces 220 may include operating units for operating the information output device 200. Such operating units may consist of sensors, buttons, or switch structures that can recognize user touch or press operations.

[0097] Figure 10 is a diagram illustrating the operation of the information output cells 230 included in the first information output area 210-1 and the second information output area 210-2 of Figure 1. Referring to Figure 10, the first information output area 210-1 and the second information output area 210-2 can contain multiple information output cells 230. The braille information output to the first information output area 210-1 and the second information output area 210-2 can be output in units of information output cells 230, each containing an information output unit 240 arranged in a 4x2 grid. In this embodiment, an information output cell 230 can contain eight information output units 240.

[0098] In this embodiment, one information output cell 230 is limited to containing eight information output units 240, but it is not limited to this, and one information output cell 230 can contain two to eight information output units 240, and in some cases even more information output units 240.

[0099] The information output unit 240 according to this embodiment can receive a drive signal for the information output unit from the interactive information processing device 100 and output information through upward drive or downward drive.

[0100] Figure 11 is a flowchart illustrating the interactive information processing method according to this embodiment. In the following description, any parts that overlap with the descriptions of Figures 1 to 10 will be omitted. The interactive information processing method according to this embodiment will be described assuming that the interactive information processing device 100 is executed by the processor 140 with the help of peripheral components.

[0101] Referring to Figure 11, in step S1110, the processor 140 can output interactive information compatible with the information output device 200 to a first region divided into a plurality of grid cells constituting a user interface screen. In this embodiment, the interactive information specifically includes one or more files pre-stored in the memory 130, such as files previously generated in the first region and stored in memory, and files captured in the first region and stored in memory. The interactive information may also include files received through communication with an external device (e.g., a server, a user terminal, etc.). Furthermore, the interactive information may include touch inputs generated by real-time touch in the first region. The interactive information may also include a set of touch inputs generated by touch in the first region until a touch signal from a print button implemented in a third region at a different location from the first region is received. Such interactive information may include one or more of graphic information and text information.

[0102] In step S1120, the processor 140 can detect the coordinate information of the grid cell corresponding to the interactive information output to the first region.

[0103] In step S1130, the processor 140 can detect the coordinate information of an information output cell that has a one-to-one match with the coordinate information of a grid cell.

[0104] In step S1140, the processor 140 can generate a drive signal for the information output unit corresponding to the coordinate information of the information output cell and transmit it to the information output device 200.

[0105] In this embodiment, the processor 140 can receive a touch on a grid cell display menu implemented in a second area located at a different position from the first area constituting the user interface screen, before outputting interactive information. The processor 140 can display multiple grid cells in the first area upon receiving a first touch signal for the grid cell display menu, and can terminate the display of the multiple grid cells from the first area upon receiving a second touch signal for the grid cell display menu.

[0106] In this embodiment, the processor 140 can activate the page explanation screen by receiving a touch signal from the page explanation screen, which is implemented in a third area located at a different position from the first area constituting the user interface screen, before transmitting a drive signal to the information output device 200. The processor 140 can receive input of explanatory text for interactive information output from the page explanation screen to the first area. When the processor 140 receives a touch signal from the braille translation button implemented in the third area, it determines that it has finished receiving the explanatory text and can convert the explanatory text into braille. The processor 140 can display the result of converting the explanatory text into braille on the braille output screen implemented in the second area. The processor 140 can transmit the braille conversion result displayed on the braille output screen to the information output device. The processor 140 can generate a drive signal for the information output unit corresponding to the braille conversion result and transmit it to the information output device 200.

[0107] In this embodiment, the processor 140 may receive specification information and drive information for the information output device from the information output device 200 before transmitting a drive signal to the information output device 200. Here, the specification information and drive information for driving the information output device 200 may include information about a first information output area and a second information output area configured at a different location from the first information output area. The processor 140 can generate a drive signal for the information output unit so that graphic information is output to the first information output area, and generate a drive signal for the information output unit so that text information is output to the second information output area, and transmit these signals to the information output device 200.

[0108] The embodiments of the present invention described above can be implemented in the form of a computer program that can be executed on a computer via various components, and such a computer program can be recorded on a computer-readable medium. In this case, the medium may include magnetic media such as hard disks, floppy disks and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical recording media such as floptical disks, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, and flash memory.

[0109] On the other hand, the computer program may be specifically designed and configured for the present invention, or it may be publicly known and available to those skilled in the field of computer software. Examples of computer programs may include not only machine code, such as that produced by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like.

[0110] The use of the term “the foregoing” and similar referential terms in the specification of this invention (particularly in the claims) may correspond to both singular and plural. Furthermore, where a range is described in this invention, it is equivalent to describing each individual value constituting the range in the detailed description of the invention (unless otherwise stated) to include inventions to which the individual values ​​belonging to the said range are applied.

[0111] Unless otherwise stated, the steps constituting the method according to the present invention may be performed in any order that is appropriate. The present invention is not necessarily limited to the order in which the steps are described. In the present invention, the use of all examples or exemplary terms (e.g., ) is solely for the purpose of illustrating the present invention in detail, and the scope of the present invention is not limited by such examples or exemplary terms unless otherwise limited by the claims. Furthermore, those skilled in the art will understand that various modifications, combinations, and changes may be made within the scope of the claims or their equivalents, with design conditions and factors.

[0112] Therefore, the concept of the present invention should not be limited to the embodiments described above. Not only the claims described later, but also all scopes equivalent to or equivalently modified from these claims fall within the scope of the concept of the present invention. [Explanation of Symbols]

[0113] 100: Interactive Information Processing Device 200: Information output device 300: Network

Claims

1. An interactive information processing method executed by the processor of an interactive information processing device, The steps include outputting interactive information compatible with an information output device that outputs tactile information through upward or downward driving of at least one information output unit to a first region divided into multiple grid cells that constitute a user interface screen, and The steps include detecting the coordinate information of a grid cell corresponding to the interactive information output to the first region, The steps include detecting the coordinate information of an information output cell that has a one-to-one match with the coordinate information of the grid cell, The step includes generating a drive signal for an information output unit corresponding to the coordinate information of the information output cell and transmitting it to the information output device, Before the step of transmitting to the information output device, When a touch signal is received from a page description screen implemented in a third area at a different location from the first area that constitutes the user interface screen, the step of activating the page description screen is performed. The steps include receiving input of explanatory text for the interactive information output to the first area from the page description screen, When a touch signal is received from a braille conversion menu implemented in a different location from the page description screen in the third region, the system determines that the receipt of the description text is complete and converts the description text into braille. The steps include displaying the result of converting the explanatory text into Braille on a Braille output screen implemented in a different location from the Braille conversion menu in the third region, The further step includes transmitting the result converted to Braille, which is displayed on the Braille output screen, to the information output device. Interactive information processing method.

2. Before the step of outputting the aforementioned interactive information, The steps include receiving a touch on a grid cell display menu implemented in a second area located at a different position from the first area that constitutes the user interface screen, The steps include: displaying the plurality of grid cells in the first area by receiving a first touch signal for the grid cell display menu; and ending the display of the plurality of grid cells from the first area by receiving a second touch signal for the grid cell display menu. The interactive information processing method according to claim 1.

3. The step of outputting the aforementioned interactive information is: The process includes opening one of the selected files from one or more pre-saved files and one of the files received through communication with an external device in the first area and outputting it to the interactive information, The aforementioned one or more pre-saved files are Previously, including one or more files generated in the first region and stored in memory, and files captured in the first region and stored in memory, The interactive information processing method according to claim 1.

4. The step of outputting the aforementioned interactive information is: The process includes the step of outputting one of the set of touch inputs generated by touching the first region as interactive information until a touch input generated by real-time touching of the first region and a touch signal from a print button implemented in a third region at a different location from the first region are received. The interactive information processing method according to claim 1.

5. The step of outputting the aforementioned interactive information is: The process includes the step of outputting interactive information which includes one or more of the first region, graphic information, and text information. The interactive information processing method according to claim 3.

6. The step of transmitting to the information output device is: The step includes generating a drive signal for the information output unit corresponding to the result converted to Braille and transmitting it to the information output device, The interactive information processing method according to claim 1.

7. Before the step of transmitting to the information output device, The step of receiving specification information and drive information of the information output device from the information output device. Furthermore, The specification information and drive information relating to the operation of the aforementioned information output device are as follows: This includes information relating to a first information output area and a second information output area configured at a different location from the first information output area. The aforementioned interactive information is, Includes one or more of the following: graphic information and text information, The step of transmitting to the information output device is: The first information output area includes generating a drive signal for the information output unit so that the graphic information is output, and the second information output area includes generating a drive signal for the information output unit so that the text information is output and transmitting it to the information output device. The interactive information processing method according to claim 1.

8. A computer-readable recording medium on which a computer program for performing the method according to any one of claims 1 to 7 using a computer is stored.

9. As an interactive information processing device, Processor and The processor is operablely connected to a memory that stores at least one piece of code executed by the processor, When executed via the processor, the memory outputs interactive information compatible with an information output device that outputs haptic information through upward or downward driving to at least one information output unit to a first region divided into a plurality of grid cells constituting a user interface screen. The coordinate information of the grid cell corresponding to the interactive information output in the first region is detected, The coordinate information of the information output cell that has a one-to-one match with the coordinate information of the aforementioned grid cell is detected. A code is saved for generating a drive signal for an information output unit corresponding to the coordinate information of the information output cell and transmitting it to the information output device. When the memory is executed via the processor, before transmitting to the information output device, if it receives a touch signal from a page description screen implemented in a third area at a different location from the first area constituting the user interface screen, it activates the page description screen. The input of explanatory text for the interactive information output to the first area from the page description screen is received. When a touch signal is received from a braille conversion menu implemented in a different location from the page description screen in the third region, the system determines that the reception of the description text is complete and converts the description text into braille. The result of converting the explanatory text into Braille is displayed on a Braille output screen implemented in a different location from the Braille conversion menu in the third region. The system further stores a code for transmitting the result converted to Braille, as displayed on the Braille output screen, to the information output device. Interactive information processing device.

Images