Data processing apparatus, data processing method, and data processing program
The data processing device automates the mapping setting process using morphological analysis and cosine similarity to enhance accuracy and efficiency in data conversion between systems.
Patent Information
- Application Number
- JP2024139042
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-20
- Publication Date
- 2026-03-05
- Estimated Expiration
- 2044-08-20
AI Technical Summary
The manual setting of linkage data mapping masters in existing accounting systems is cumbersome and prone to errors.
A data processing device and method that utilizes morphological analysis, vectorization, and cosine similarity calculations to automate the mapping setting process between external and internal data items, aided by an item name conversion master table.
Reduces the workload and minimizes incorrect settings by providing automated and accurate mapping associations between external and internal data.
Smart Images

Figure 2026036438000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a data processing device, a data processing method, and a data processing program. [Background technology]
[0002] Conventionally, there is known an accounting processing device that processes trial balance data and auxiliary information from an external system into an external acceptance format for consolidated accounting based on the settings of a linked data mapping master, and accepts the data (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Publication No. 2017-182786 Summary of the Invention [Problem to be solved by the invention]
[0004] The linkage data mapping master in Patent Document 1 is generally set manually while visually checking, which makes the mapping master setting work complicated and prone to erroneous setting.
[0005] The present invention has been made in consideration of the above-mentioned problems, and aims to provide a data processing device, a data processing method, and a data processing program that can reduce the workload associated with setting mappings and prevent incorrect setting of mappings. [Means for solving the problem]
[0006] In order to solve the above-mentioned problems and achieve the object, a data processing device according to the present invention is a data processing device comprising a control unit that executes a mapping setting process which is a process of associating items of external data used outside a company's system with items of internal data used within the company's system, and a display unit, and is capable of accessing an item name conversion master table for converting the items of the external data into items of the internal data, and the item name conversion master table corresponds to names of columns of a data table, matching word names which are names similar to the names of the columns of the data table, and display item names which are display names corresponding to the names of the items of the internal data. the control unit acquires the names of the items of the external data, performs morphological analysis on the acquired names of the items of the external data to break down the names of the items of the external data into words, vectorizes the broken down words to acquire word vectors of the names of the items of the external data, calculates cosine similarities based on the word vectors of the acquired names of the items of the external data and the word vectors of the matching word names in the item name conversion master table, assigns a ranking based on the calculated cosine similarities, and displays the display item names of the item name conversion master table on the display unit based on the assigned rankings.
[0007] In addition, in the data processing device of the present invention, the item name conversion master table may further be associated with a matching word name vector, which is a word vector of the matching word name, and the matching word name vector may be obtained by performing morphological analysis on the matching word name in advance, thereby decomposing the matching word name into words and vectorizing the decomposed words.
[0008] In addition, in the data processing device of the present invention, when the display item name displayed on the display unit is selected, the control unit may execute a mapping setting process to associate the selected display item name with the name of an item of the external data.
[0009] Furthermore, a data processing method according to the present invention is a data processing method for executing a mapping setting process, which is a process for associating items of external data used outside the company's system with items of internal data used within the company's system, in which an item name conversion master table is used for converting the items of the external data into items of the internal data, and the item name conversion master table is information in which names of columns of a data table, matching word names which are names similar to the names of the columns of the data table, and display item names which are display names corresponding to the names of the items of the internal data are associated with each other, and the data processing method is executed by a data processing device having a control unit to acquire the names of the items of the external data, perform morphological analysis on the acquired names of the items of the external data to decompose the names of the items of the external data into words, vectorize the decomposed words to acquire word vectors of the names of the items of the external data, calculate cosine similarities based on the word vectors of the acquired names of the items of the external data and the word vectors of the matching word names in the item name conversion master table, assign a ranking based on the calculated cosine similarities, and display the display item names of the item name conversion master table on the display unit based on the assigned ranking.
[0010] Further, a data processing program according to the present invention is a data processing program for causing a data processing device having a control unit to execute a data processing method for executing a mapping setting process which is a process for associating items of external data used outside the company's system with items of internal data used within the company's system, wherein an item name conversion master table is used for converting the items of the external data into items of the internal data, and the item name conversion master table associates names of columns of a data table, matching word names which are names similar to the names of the columns of the data table, and display item names which are display names corresponding to the names of the items of the internal data. The data processing device executes the following operations: acquiring names of items of the external data; performing morphological analysis on the acquired names of the items of the external data to decompose the names of the items of the external data into words; vectorizing the decomposed words to acquire word vectors of the names of the items of the external data; calculating cosine similarities based on the word vectors of the acquired names of the items of the external data and the word vectors of the matching word names in the item name conversion master table; assigning rankings based on the calculated cosine similarities; and displaying the display item names in the item name conversion master table on the display unit based on the assigned rankings. [Effects of the Invention]
[0011] The present invention has the effect of reducing the workload associated with setting mapping and suppressing incorrect setting of mapping. [Brief explanation of the drawings]
[0012] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a data processing device. [Figure 2] FIG. 2 is a diagram illustrating the mapping setting process. [Figure 3] FIG. 3 is a diagram illustrating an example of the item name conversion master. [Figure 4] FIG. 4 is a diagram showing an example of the item name conversion master table. [Figure 5] FIG. 5 is a diagram illustrating an example of the data import format master. [Figure 6] FIG. 6 is a diagram illustrating an example of the data import format master. [Figure 7] FIG. 7 is a diagram illustrating an example of processing related to word vectorization. [Figure 8] FIG. 8 is a diagram illustrating an example of processing related to cosine similarity. [Figure 9] FIG. 9 is a diagram illustrating an example of the data import format master. [Figure 10] FIG. 10 is a diagram illustrating an example of the format conversion process. DETAILED DESCRIPTION OF THE INVENTION
[0013] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A data processing device, a data processing method, and a data processing program according to embodiments of the present invention will be described in detail below with reference to the accompanying drawings. However, the present invention is not limited to these embodiments.
[0014] [1. Configuration] An example of the configuration of a data processing device 100 according to this embodiment will be described with reference to Fig. 1 etc. Fig. 1 is a diagram showing an example of the configuration of a data processing device.
[0015] The data processing device 100 is a device that converts the format of external data used outside the company's system, i.e., in an external system, and the format of internal data used within the company's system. Specifically, the data processing device 100 is a terminal used to make an account transfer request to a financial institution, etc., and creates data related to the transfer request (transfer request data) and imports an FB (Firm Banking) file as external data obtained from the financial institution.
[0016] Furthermore, the data processing device 100 executes a mapping setting process when converting the formats of external data and internal data. The mapping setting process will be described with reference to FIG.
[0017] FIG. 2 is a diagram illustrating the mapping setting process. The mapping setting process is a process of associating items of external data with items of internal data. As shown in FIG. 2, external data such as an FB file includes, for example, items such as the deduction date, the deduction trustor number, and the deduction trustor name. On the other hand, internal data includes, for example, items such as the transfer date, the transfer trustor code, and the deduction trustor name. The mapping setting process associates the deduction date of the external data with the transfer date of the internal data, and similarly, associates the deduction trustor number with the transfer trustor code, and associates the deduction trustor name with the transfer trustor name. Then, by executing the mapping setting process, the data processing device 100 can convert the acquired external data into the internal data format based on the mapping settings.
[0018] The data processing device 100 is constructed based on a commercially available desktop personal computer. Note that the data processing device 100 is not limited to being constructed based on a stationary information processing device such as a desktop personal computer, but may also be constructed based on a portable information processing device such as a commercially available notebook personal computer, PDA (Personal Digital Assistant), smartphone, or tablet personal computer.
[0019] The data processing device 100 includes a control unit 102, a communication interface unit 104, a storage unit 106, and an input / output interface unit 108. The units included in the data processing device 100 are connected to each other so as to be able to communicate with each other via any communication path.
[0020] The communication interface unit 104 communicably connects the data processing device 100 to a network 300 via a communication device such as a router and a wired or wireless communication line such as a dedicated line. The communication interface unit 104 has a function of communicating data with other devices via the communication line. Here, the network 300 has a function of connecting the data processing device 100 and the server 200 so that they can communicate with each other, and is, for example, the Internet or a LAN (Local Area Network). Note that the data stored in the storage unit 106 may be stored in the server 200, for example.
[0021] An input device 112 and an output device 114 are connected to the input / output interface unit 108. The output device 114 may be a monitor (including a home television), a speaker, or a printer. The input device 112 may be a keyboard, a mouse, a microphone, or a monitor that functions as a pointing device in cooperation with a mouse. In the following, the output device 114 may be referred to as the monitor (display unit) 114, and the input device 112 may be referred to as the keyboard 112 or the mouse 112.
[0022] Various databases, tables, files, etc. are stored in the storage unit 106. Computer programs that work in conjunction with an OS (Operating System) to issue commands to a CPU (Central Processing Unit) to perform various processes are recorded in the storage unit 106. The storage unit 106 can be, for example, a memory device such as a RAM (Random Access Memory) or a ROM (Read Only Memory), a fixed disk device such as a hard disk, a flexible disk, an optical disk, etc.
[0023] The storage unit 106 stores various masters and various data. Specifically, the storage unit 106 stores an item name conversion master 121, an item name conversion master table 122, and a data import format master 123. The storage unit 106 may also store an FB file as external data. The various masters and various data will be described below. If there are overlapping items among the items included in the various masters and various data, some of the descriptions of the overlapping items will be omitted.
[0024] FIG. 3 is a diagram showing an example of an item name conversion master. The item name conversion master 121 is data used to convert items of external data into items of internal data. Specifically, the item name conversion master 121 is a master that sets how the names of each item of internal data are displayed on the display unit 114, i.e., the display item names. As shown in FIG. 3, the item name conversion master 121 includes the fields SEQ, physical table column name, matching word name, and display item name, and has the function of associating these pieces of information. SEQ is a sequence number, a number used to identify each row. The physical table column name is a name associated with each sequence number used in the physical table, i.e., the data table of the system. The matching word name is a name similar to an item of external data that is associated with the column name of the physical table. Multiple matching word names are provided. The display item name is a name associated with the column name of the physical table and displayed on the display unit 114.
[0025] The item name conversion master 121 also includes the functions of a registration button and a name batch set button, and the data processing device 100 executes processing based on the registration button and processing based on the name batch set button. The registration button is a button for registering the set display item names. The name batch set button is a button for setting the column names of physical tables as display item names in bulk.
[0026] FIG. 4 is a diagram showing an example of an item name conversion master table. The item name conversion master table 122 is data generated when the set display item name is registered. The item name conversion master table 122 is information obtained by adding word vector information of matching term names to the information of the item name conversion master 121. The item name conversion master table 122 includes items such as SEQ, physical table column name, display item name, matching word name, and matching word name vector, and these pieces of information are associated with each other. The SEQ, physical table column name, display item name, and matching word name are the same as those in the item name conversion master 121, so their explanation will be omitted. The matching word name vector is a vectorized version of the matching word name. Note that word vectorization will be described later.
[0027] FIG. 5 is a diagram showing an example of a data import format master. The data import format master 123 is data for setting a mapping that associates external data items with internal data items. The data import format master 123 includes SEQ, format item name, position, length, constant section, constant, and selection item, and has a function for associating this information. Note that the position, length, constant section, and constant items are items that do not require explanation in this embodiment, so they will be omitted. Also, SEQ is similar to the item name conversion master 121, etc., so its explanation will be omitted. The format item name is an external data item and is an item input via the input device 112. The selection item is an item into which the display item name of the item name conversion master table 122 is input. The selection item also includes a suggestion button function, and when the suggestion button is operated, candidate display item names are displayed.
[0028] Next, the control unit 102 will be described with reference to Fig. 1 again. The control unit 102 is a CPU or the like that performs overall control of the data processing device 100. The control unit 102 has an internal memory for storing control programs such as an OS, programs that define various processing procedures, and required data, and executes various information processes based on these stored programs.
[0029] The control unit 102 performs information processing to set up mapping based on various masters and various data stored in the storage unit 106.
[0030] A specific example of the processing executed by the control unit 102 will be described in detail below in [2. Specific Example of Processing].
[0031] [2. Specific examples of processing] Here, specific examples of processing executed by the data processing device 100 will be described with reference to Figs. 6 to 9. Fig. 6 is a diagram showing an example of a data import format master. Fig. 7 is a diagram showing an example of processing related to word vectorization. Fig. 8 is a diagram showing an example of processing related to cosine similarity. Fig. 9 is a diagram showing an example of a data import format master.
[0032] In the mapping setting process, first, the control unit 102 of the data processing device 100 executes the data import format master 123 to display the screen shown in Fig. 6 on the display unit 114. In Fig. 6, a name of the character string "withdrawal branch name" is entered as an external data item. The control unit 102 acquires the external data item, and when the suggest button in the selection item of the data import format master 123 is operated, executes a process related to word vectorization of the name, as shown in Fig. 7.
[0033] In the word vectorization process shown in FIG. 7, the control unit 102 performs morphological analysis on the names of the items of the acquired external data. Specifically, the control unit 102 breaks down the character string "withdrawal branch name" into the words "withdrawal," "branch," and "name." Then, based on the broken down words, the control unit 102 performs word vectorization using Word2Vec or the like. As a result, the control unit 102 obtains word vectors for the names of the items of the external data.
[0034] 7 is also applied to the case where matching word name vectors are obtained from the item name conversion master table 122. That is, when generating the item name conversion master table 122, the data processing device 100 obtains matching word name vectors by executing the process shown in FIG.
[0035] When the control unit 102 acquires the word vectors of the items of the external data, it calculates the cosine similarity based on the word vectors of the names of the acquired items of the external data and the matching word name vectors of the item name conversion master, as shown in Figure 8. Note that Figure 8 shows a work table based on the data import format master. Specifically, the control unit 102 sets the word vector of "Withdrawal Branch Name" to vector a, and the word vector of the matching word name to vector b. Then, the control unit 102 calculates the cosine similarity (cosθ) for each of the matching word names based on the predetermined calculation formula shown in Figure 8.
[0036] Next, the control unit 102 assigns a rank to the matching word names based on the calculated cosine similarity for each matching word name. In FIG. 8, the control unit 102 assigns a rank to the matching word names in descending order, with values having higher cosine similarity at the top and values having lower cosine similarity at the bottom. Then, as shown in FIG. 9, the control unit 102 displays the display item names of the item name conversion master 121 on the display unit 114 based on the assigned rank. Note that in FIG. 9, when the suggest button is operated, the control unit 102 opens an input window for inputting the display item names and displays the display item names selectably in the input window. Furthermore, the control unit 102 displays the top four display item names with the highest cosine similarity at the top of the input window, and displays the remaining display item names in ascending order of SEQ.
[0037] When a display item name displayed on the display unit 114 is selected, the control unit 102 executes a mapping setting process to associate the selected display item name with the name of an item in the external data. That is, when "Bank Branch Name in Kana" is selected as the display item name shown in Fig. 9, the control unit 102 executes a mapping setting process to associate "Withdrawal Branch Name" as an item in the external data with "Bank Branch Name in Kana" as an item in the internal data.
[0038] Next, an example of a format conversion process executed after mapping is set will be described with reference to FIG. 10. FIG. 10 is a diagram illustrating an example of the format conversion process. As shown in FIG. 10, the data processing device 100 converts the names of external data items into the names of internal data items based on the mapping settings. Specifically, when the data processing device 100 acquires an FB file, which is transfer request data acquired from a financial institution, it converts the FB file into an internal data format based on the mapping settings during an import process that imports the transfer request data. The data processing device 100 then generates deposit data and deposit reconciliation data based on the converted internal data and executes the deposit process and the deposit reconciliation process. Note that the format conversion process can be performed not only to convert the format from external data to internal data, but also to convert the format from internal data to external data.
[0039] As described above, according to this embodiment, the names of display items of internal data that are highly similar to the names of items of external data can be displayed on the display unit 114. Therefore, it is possible to present to the user internal data items that are appropriate for the items of external data, thereby reducing the workload involved in setting up mapping and preventing incorrect setting of mapping.
[0040] Furthermore, according to this embodiment, matching term names can be converted into word vectors in advance, which reduces the processing load of calculating cosine similarity using word vectors.
[0041] Furthermore, according to this embodiment, the names of the selected display items can be appropriately associated with the names of the items in the external data.
[0042] [3. Contribution to the United Nations-led Sustainable Development Goals (SDGs)] This embodiment can contribute to improving business efficiency and promoting appropriate management decisions by companies, thereby contributing to the achievement of SDGs Goals 8 and 9.
[0043] Furthermore, this embodiment can contribute to reducing waste and promoting paperless and electronic systems, thereby contributing to the achievement of SDGs Goals 12, 13, and 15.
[0044] Furthermore, this embodiment can contribute to strengthening control and governance, which can contribute to the achievement of Goal 16 of the SDGs.
[0045] 4. Other Embodiments The present invention may be implemented in various different embodiments other than those described above within the scope of the technical concept set forth in the claims.
[0046] For example, among the processes described in the embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using known methods.
[0047] Furthermore, the processing procedures, control procedures, specific names, information including parameters such as registered data and search conditions for each process, screen examples, and database configurations shown in this specification and drawings can be changed as desired unless otherwise specified.
[0048] Furthermore, with regard to the data processing device 100, the components shown in the figures are functional concepts, and do not necessarily have to be physically configured as shown in the figures.
[0049] For example, all or any part of the processing functions of the data processing device 100, particularly the processing functions performed by the control unit, may be implemented by a CPU and a program interpreted and executed by the CPU, or may be implemented as hardware using wired logic. The program is recorded on a non-transitory computer-readable recording medium containing programmed instructions for causing the information processing device to execute the processes described in this embodiment, and is mechanically read by the data processing device 100 as needed. That is, a computer program for providing instructions to the CPU in cooperation with the OS and performing various processes is recorded in a storage unit such as a ROM or HDD (Hard Disk Drive). The computer program is executed by being loaded into RAM, and cooperates with the CPU to form the control unit.
[0050] This computer program may also be stored in an application program server connected to the data processing device 100 via any network, and all or part of it may be downloaded as needed.
[0051] Furthermore, the program for executing the processes described in this embodiment may be stored in a non-transitory computer-readable recording medium or configured as a program product. Here, the term "recording medium" includes any "portable physical medium" such as a memory card, a Universal Serial Bus (USB) memory, a Secure Digital (SD) card, a flexible disk, a magneto-optical disk, a ROM, an Erasable Programmable Read Only Memory (EPROM), an Electrically Erasable and Programmable Read Only Memory (EEPROM (registered trademark)), a Compact Disk Read Only Memory (CD-ROM), a Magneto-Optical disk (MO), a Digital Versatile Disk (DVD), and a Blu-ray (registered trademark) disc.
[0052] Furthermore, a "program" is a data processing method written in any language or description method, regardless of the format, such as source code or binary code. Note that a "program" is not necessarily limited to a single program, but also includes programs that are distributed as multiple modules or libraries, or programs that achieve their functions by cooperating with other programs, such as an OS. Note that the specific configurations and reading procedures for reading a recording medium in each device shown in the embodiments, as well as the installation procedures after reading, can use well-known configurations and procedures.
[0053] The various databases stored in the memory unit are storage means such as memory devices such as RAM and ROM, fixed disk devices such as hard disks, flexible disks, and optical disks, and store various programs, tables, databases, and web page files used for various processes and providing websites.
[0054] The data processing device 100 may be configured as an information processing device such as a known personal computer or workstation, or may be configured as the information processing device to which any peripheral device is connected. The data processing device 100 may also be realized by installing software (including programs, data, etc.) that causes the device to perform the processes described in this embodiment.
[0055] Furthermore, the specific form of distribution and integration of the devices is not limited to that shown in the drawings, and all or part of them can be configured by functionally or physically distributing and integrating them in any unit depending on various additions or functional loads. In other words, the above-described embodiments can be implemented in any combination, or embodiments can be implemented selectively. [Industrial Applicability]
[0056] The present invention is useful in industries where file linkage between one system and another system occurs. [Explanation of symbols]
[0057] 100 Data processing device 102 Control section 104 Communication interface unit 106 Storage section 108 Input / Output Interface Section 112 Input Device 114 Output Device 121 Item name conversion master 122 Item name conversion master table 123 Data Import Format Master 200 servers 300 Network
Claims
1. A data processing device comprising: a control unit that executes a mapping setting process that associates items of external data used outside the company's system with items of internal data used within the company's system; and a display unit, accessing an item name conversion master table for converting the items of the external data into the items of the internal data; The item name conversion master table is information in which the names of columns of a data table, matching word names which are names similar to the names of the columns of the data table, and display item names which are display names corresponding to the names of the items of the internal data are associated with each other; The control unit Obtain the name of the item of the external data; performing morphological analysis on the names of the external data items acquired to break down the names of the external data items into words; performing vectorization of the decomposed words to obtain word vectors of names of items of said external data; Calculating a cosine similarity based on the word vector of the name of the item of the acquired external data and the word vector of the matching word name of the item name conversion master table; assigning a ranking based on the calculated cosine similarity; A data processing device that displays the display item names of the item name conversion master table on the display unit based on the assigned ranking.
2. The item name conversion master table further has associated therewith a matching word name vector, which is a word vector of the matching word name, 2. The data processing device according to claim 1, wherein the matching word name vector is obtained by performing a morphological analysis on the matching word name in advance, decomposing the matching word name into words, and vectorizing the decomposed words.
3. The control unit The data processing device according to claim 1 , wherein when the display item name displayed on the display unit is selected, a mapping setting process is executed to associate the selected display item name with the name of an item in the external data.
4. A data processing method for performing a mapping setting process that associates items of external data used outside a company's system with items of internal data used within the company's system, an item name conversion master table is used to convert the items of the external data into the items of the internal data; The item name conversion master table is information in which the names of columns of a data table, matching word names which are names similar to the names of the columns of the data table, and display item names which are display names corresponding to the names of the items of the internal data are associated with each other; Obtain the name of the item of the external data; performing morphological analysis on the names of the external data items acquired to break down the names of the external data items into words; performing vectorization of the decomposed words to obtain word vectors of names of items of said external data; Calculating a cosine similarity based on the word vector of the name of the item of the acquired external data and the word vector of the matching word name of the item name conversion master table; assigning a ranking based on the calculated cosine similarity; The data processing method is executed by a data processing device having a control unit, which displays the display item names of the item name conversion master table on a display unit based on the assigned ranking.
5. A data processing program for causing a data processing device having a control unit to execute a data processing method for executing a mapping setting process which is a process for associating items of external data used outside the company's system with items of internal data used within the company's system, the data processing program comprising: an item name conversion master table is used to convert the items of the external data into the items of the internal data; The item name conversion master table is information in which the names of columns of a data table, matching word names which are names similar to the names of the columns of the data table, and display item names which are display names corresponding to the names of the items of the internal data are associated with each other; Obtain the name of the item of the external data; performing morphological analysis on the names of the external data items acquired to break down the names of the external data items into words; performing vectorization of the decomposed words to obtain word vectors of names of items of said external data; Calculating a cosine similarity based on the word vector of the name of the item of the acquired external data and the word vector of the matching word name of the item name conversion master table; assigning a ranking based on the calculated cosine similarity; a data processing program for causing the data processing device to display the display item names of the item name conversion master table on a display unit based on the assigned ranking;
Citation Information
Patent Citations
Data extraction method and device for different data sources, equipment and storage medium
CN111858728A
Representation word recognition method and device, equipment and medium
CN114153944A
Program for mapping data schema, and computer system
JP2007179146A
Data processing program, data processing method and data processing device
JP2022027252A
Data Migration System
US20160140116A1