Data processing device, data processing method, and data processing program
The data processing device addresses complex and error-prone manual mapping by analyzing and ranking data names for efficient and accurate mapping setup, reducing workload and misconfigurations.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- OBIC CO LTD
- Filing Date
- 2024-08-20
- Publication Date
- 2026-05-19
AI Technical Summary
The manual setting of linkage data mapping in existing systems is complex and prone to misconfiguration.
A data processing device that performs morphological analysis on external data names, vectorizes the decomposed words, calculates cosine similarity with pre-converted internal data names, and ranks display items for easy mapping setup, using an item name conversion master table.
Reduces workload and minimizes mapping misconfigurations by providing ranked display names for accurate association of external and internal data items.
Smart Images

Figure 0007862487000001 
Figure 0007862487000002 
Figure 0007862487000003
Abstract
Description
Technical Field
[0001] The present invention relates to a data processing apparatus, a data processing method, and a data processing program.
Background Art
[0002] Conventionally, there has been known an accounting processing apparatus or the like that processes spreadsheet data and auxiliary information of an external system into an external acceptance format of consolidated accounting based on the setting of a linkage data mapping master and performs acceptance (see, for example, Patent Document 1).
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] The setting of the linkage data mapping master in Patent Document 1 is generally set manually while visually checking. For this reason, the setting work of the mapping master becomes a complicated work, and there is a possibility of misconfiguration.
[0005] The present invention has been made in view of the above problems, and an object thereof is to provide a data processing apparatus, a data processing method, and a data processing program that can reduce the workload related to the setting of mapping and suppress misconfiguration of mapping.
Means for Solving the Problems
[0006] To solve the above-mentioned problems and achieve the objective, the data processing device according to the present invention comprises a control unit that performs a mapping setting process, which is a process that associates items of external data used outside the company's system with items of internal data used within the company's system, and a display unit, wherein the data processing device has access to an item name conversion master table for converting the items of the external data to the items of the internal data, and the item name conversion master table comprises the names of the columns of the data table, matching word names which are names similar to the names of the columns of the data table, and display item names which are display names corresponding to the names of the items of the internal data. The information is provided, and the control unit obtains the name of the item in the external data, performs morphological analysis on the obtained name of the item in the external data to decompose the name of the item in the external data into words, performs vectorization of the decomposed words to obtain a word vector of the name of the item in the external data, calculates cosine similarity based on the obtained word vector of the name of the item in the external data and the word vector of the matching word name in the item name conversion master table, assigns a rank based on the calculated cosine similarity, and displays the display item name in the item name conversion master table on the display unit based on the assigned rank.
[0007] Furthermore, in the data processing device according to the present invention, the item name conversion master table is further associated with matching word name vectors, which are word vectors of the matching word names. The matching word name vectors may be obtained by performing morphological analysis on the matching word names in advance, thereby decomposing the matching word names into words, and then performing vectorization of the decomposed words.
[0008] Furthermore, in the data processing device according to the present invention, when a display item name displayed on the display unit is selected, the control unit may perform a mapping setting process that associates the selected display item name with the name of an item in the external data.
[0009] Furthermore, the data processing method according to the present invention is a data processing method that performs a mapping setting process, which is a process that associates items of external data used outside the company's system with items of internal data used within the company's system, wherein an item name conversion master table is used to convert the items of the external data into items of the internal data, the item name conversion master table is information that associates the names of columns in a data table, matching word names which are similar names to the names of the columns in the data table, and display item names which are display names corresponding to the names of the items of the internal data, and the data processing device equipped with a control unit performs the following: obtain the names of the items of the external data, perform morphological analysis on the obtained names of the items of the external data to decompose the names of the items of the external data into words, perform vectorization of the decomposed words to obtain word vectors of the names of the items of the external data, calculate cosine similarity based on the obtained word vectors of the names of the items of the external data and the word vectors of the matching word names in the item name conversion master table, assign a rank based on the calculated cosine similarity, and display the display item names in the item name conversion master table on the display unit based on the assigned rank.
[0010] Furthermore, the data processing program according to the present invention is a data processing program that causes a data processing device equipped with a control unit to execute a data processing method which is a process of associating items of external data used outside the company's system with items of internal data used within the company's system, wherein an item name conversion master table is used for converting the items of the external data to the items of the internal data, and the item name conversion master table is configured such that the names of the columns of the data table are associated with matching word names which are similar to the names of the columns of the data table, and display item names which are display names corresponding to the names of the items of the internal data. The data processing device is instructed to perform the following actions: obtain the names of the items in the external data, perform morphological analysis on the obtained names of the items in the external data to decompose the names of the items in the external data into words, perform vectorization of the decomposed words to obtain word vectors of the names of the items in the external data, calculate cosine similarity based on the obtained word vectors of the names of the items in the external data and the word vectors of the matching word names in the item name conversion master table, assign a rank based on the calculated cosine similarity, and display the display item names in the item name conversion master table on the display unit based on the assigned rank. [Effects of the Invention]
[0011] This invention has the effect of reducing the workload involved in setting up mappings and suppressing misconfigurations of mappings. [Brief explanation of the drawing]
[0012] [Figure 1] Figure 1 shows an example of the configuration of a data processing device. [Figure 2] Figure 2 is a diagram illustrating the mapping configuration process. [Figure 3] Figure 3 shows an example of an item name conversion master. [Figure 4] Figure 4 shows an example of an item name conversion master table. [Figure 5] FIG. 5 is a diagram showing an example of a data import format master. [Figure 6] FIG. 6 is a diagram showing an example of a data import format master. [Figure 7] FIG. 7 is a diagram showing an example of a process related to word vectorization. [Figure 8] FIG. 8 is a diagram showing an example of a process related to cosine similarity. [Figure 9] FIG. 9 is a diagram showing an example of a data import format master. [Figure 10] FIG. 10 is a diagram showing an example of a format conversion process.
Embodiments for Carrying Out the Invention
[0013] Hereinafter, embodiments of a data processing apparatus, a data processing method, and a data processing program according to the present invention will be described in detail based on the drawings. Note that the present invention is not limited by this embodiment.
[0014] [1. Configuration] An example of the configuration of a data processing apparatus 100 according to this embodiment will be described with reference to FIG. 1 and the like. FIG. 1 is a diagram showing an example of the configuration of a data processing apparatus.
[0015] The data processing apparatus 100 is an apparatus that converts the formats of external data used outside the company system, that is, in an external system, and internal data used within the company system. Specifically, the data processing apparatus 100 is, for example, a terminal used to request account transfers to financial institutions and the like, and creates data related to transfer requests (transfer request data) or imports an FB (Firm Banking) file as external data obtained from a financial institution.
[0016] In addition, when converting the formats of external data and internal data, the data processing apparatus 100 executes mapping setting processing. The mapping setting processing will be described with reference to FIG. 2.
[0017] FIG. 2 is a diagram for explaining the mapping setting process. The mapping setting process is a process of associating items of external data with items of internal data. As shown in FIG. 2, external data such as an FB file includes, as items, for example, the collection date, the collection client number, the collection client name, and the like. On the other hand, the internal data includes, as items, the transfer date, the transfer client code, the transfer client name, and the like. In the mapping setting process, the collection date of the external data is associated with the transfer date of the internal data, and similarly, the collection client number is associated with the transfer client code, and the collection client name is associated with the transfer client name. Then, by executing the mapping setting process, the data processing apparatus 100 can convert the acquired external data into the format of the internal data based on the mapping setting.
[0018] The data processing apparatus 100 is constructed based on a commercially available desktop personal computer. Note that the data processing apparatus 100 is not limited to being constructed based on a stationary information processing apparatus such as a desktop personal computer, and may be constructed based on a portable information processing apparatus such as a commercially available notebook personal computer, a PDA (Personal Digital Assistants), a smartphone, or a tablet personal computer.
[0019] The data processing apparatus 100 includes a control unit 102, a communication interface unit 104, a storage unit 106, and an input / output interface unit 108. Each unit included in the data processing apparatus 100 is communicably connected via an arbitrary communication path.
[0020] The communication interface unit 104 connects the data processing device 100 to the network 300 via a communication device such as a router and a wired or wireless communication line such as a dedicated line. The communication interface unit 104 has the function of communicating data with other devices via a communication line. Here, the network 300 has the function of connecting the data processing device 100 and the server 200 so that they can communicate with each other, and is, for example, the Internet or a LAN (Local Area Network). The data stored in the storage unit 106 may be stored in, for example, the server 200.
[0021] The input / output interface unit 108 is connected to an input device 112 and an output device 114. The output device 114 can be a monitor (including a home television), a speaker, or a printer. The input device 112 can be a keyboard, a mouse, a microphone, or a monitor that works in conjunction with a mouse to provide pointing device functionality. In the following, the output device 114 may be referred to as the monitor (display unit) 114, and the input device 112 may be referred to as the keyboard 112 or mouse 112.
[0022] The memory unit 106 stores various databases, tables, and files. The memory unit 106 also stores computer programs that work in cooperation with the OS (Operating System) to give instructions to the CPU (Central Processing Unit) to perform various processes. As the memory unit 106, for example, memory devices such as RAM (Random Access Memory) and ROM (Read Only Memory), fixed disk devices such as hard disks, flexible disks, and optical disks can be used.
[0023] The storage unit 106 stores various masters and various data. Specifically, the storage unit 106 stores the item name conversion master 121, the item name conversion master table 122, and the data import format master 123, etc. The storage unit 106 may also store FB files as external data. The various masters and various data will be described below. Note that if there are duplicate items in the various masters and various data, the explanation for the duplicate items will be partially omitted.
[0024] Figure 3 shows an example of an item name conversion master. The item name conversion master 121 is data used to convert items from external data to items from internal data. Specifically, the item name conversion master 121 is a master that sets how the names of each item in the internal data are displayed in the display unit 114, that is, the display item names. As shown in Figure 3, the item name conversion master 121 includes items for SEQ, physical table column names, matching word names, and display item names, and has the function of associating this information. SEQ is a sequence number, a number used to identify each row. The physical table column names are names associated with each sequence number used in the physical table, i.e., the data table of the system. The matching word names are names similar to the items in the external data that are associated with the column names of the physical table. Multiple matching word names are available. The display item names are names that are displayed in the display unit 114 and are associated with the column names of the physical table.
[0025] Furthermore, the item name conversion master 121 includes the functions of a registration button and a bulk name set button, and the data processing device 100 executes processing based on the registration button and processing based on the bulk name set button. The registration button is a button for registering the set display item names. The bulk name set button is a button for setting the column names of the physical table as display item names in bulk.
[0026] Figure 4 shows an example of an item name conversion master table. The item name conversion master table 122 is the data generated when the set display item name is registered. The item name conversion master table 122 adds word vector information of matching term names to the information in the item name conversion master 121. The item name conversion master table 122 includes fields for SEQ, physical table column names, display item names, matching word names, and matching word name vectors, and this information is associated with each other. The SEQ, physical table column names, display item names, and matching word names are the same as in the item name conversion master 121, so their explanation is omitted. The matching word name vector is a vectorized version of the matching word name. The vectorization of words will be explained later.
[0027] Figure 5 shows an example of a data import format master. The data import format master 123 is data for setting up a mapping that associates items of external data with items of internal data. The data import format master 123 includes SEQ, format item name, position, length, constant category, constant, and selection item, and has the function of associating this information. Note that the items of position, length, constant category, and constant do not require explanation in this embodiment and are therefore omitted. Also, SEQ is the same as the item name conversion master 121, etc., so its explanation is omitted. The format item name is an item of external data and is entered via the input device 112. The selection item is an item into which the display item name of the item name conversion master table 122 is entered. The selection item also includes a suggestion button function, and when the suggestion button is operated, candidate display item names are displayed.
[0028] Next, referring again to Figure 1, the control unit 102 will be described. The control unit 102 is a CPU or similar component that comprehensively controls the data processing device 100. The control unit 102 has internal memory for storing control programs such as the OS, programs that define various processing procedures, and required data, and executes various information processing based on these stored programs.
[0029] The control unit 102 performs information processing, specifically, processing related to mapping settings based on various masters and data stored in the storage unit 106.
[0030] The following section, [2. Specific Examples of Processing], will provide a detailed explanation of specific examples of processing performed by the control unit 102.
[0031] [2. Specific examples of processing] Here, specific examples of processing performed by the data processing device 100 will be explained with reference to Figures 6 to 9. Figure 6 is a diagram showing an example of a data acquisition format master. Figure 7 is a diagram showing an example of processing related to word vectorization. Figure 8 is a diagram showing an example of processing related to cosine similarity. Figure 9 is a diagram showing an example of a data acquisition format master.
[0032] In the mapping setup process, first, the control unit 102 of the data processing device 100 executes the data import format master 123, which displays the screen shown in Figure 6 on the display unit 114. In Figure 6, the string name "Withdrawal Branch Name" is entered as an item of external data. The control unit 102 acquires the item of external data, and when the suggestion button in the selection items of the data import format master 123 is operated, it executes a process related to word vectorization of the name, as shown in Figure 7.
[0033] In the word vectorization process shown in Figure 7, the control unit 102 performs morphological analysis on the names of the items in the acquired external data. Specifically, the control unit 102 decomposes the string "withdrawal branch name" into the words "withdrawal," "branch," and "name." After this, the control unit 102 performs word vectorization using Word2Vec or the like based on the decomposed words. As a result, the control unit 102 obtains word vectors of the names of the items in the external data.
[0034] Here, the word vectorization process shown in Figure 7 is also applied when obtaining matching word name vectors for the item name conversion master table 122. In other words, the data processing device 100 obtains matching word name vectors by executing the process shown in Figure 7 when generating the item name conversion master table 122.
[0035] When the control unit 102 obtains word vectors of items in the external data, it calculates cosine similarity based on the word vectors of the names of the obtained external data items and the matching word name vectors of the item name conversion master, as shown in Figure 8. Figure 8 shows a work table based on the data import format master. Specifically, the control unit 102 denotes the word vector of "withdrawal branch name" as vector a and the word vector of the matching word name as vector b. Then, the control unit 102 calculates the cosine similarity (cosθ) for each of the matching word names based on a predetermined calculation formula shown in Figure 8.
[0036] Next, the control unit 102 assigns ranks to the matching word names based on the calculated cosine similarity for each matching word name. In Figure 8, the control unit 102 assigns ranks to the matching word names in descending order, with higher values being higher and lower values lower. Then, as shown in Figure 9, the control unit 102 displays the display item names of the item name conversion master 121 on the display unit 114 based on the assigned ranks. In Figure 9, when the suggest button is operated, the control unit 102 expands the input window for entering the display item names and displays the display item names in the input window for selection. The control unit 102 also displays the top four display item names with the highest cosine similarity at the top of the input window, and displays the remaining display item names in ascending order of SEQ.
[0037] When a display item name displayed on the display unit 114 is selected, the control unit 102 performs a mapping setting process to associate the selected display item name with the name of an item in the external data. In other words, when "Bank Branch Name (Kana)" is selected as the display item name shown in Figure 9, the control unit 102 performs a mapping setting process to associate "Withdrawal Branch Name" as an item in the external data with "Bank Branch Name (Kana)" as an item in the internal data.
[0038] Next, with reference to Figure 10, an example of the format conversion process performed after the mapping is set will be described. Figure 10 is a diagram showing an example of the format conversion process. As shown in Figure 10, the data processing device 100 converts the names of items in the external data to the names of items in the internal data based on the mapping settings. Specifically, when the data processing device 100 obtains an FB file, which is transfer request data obtained from a financial institution, it converts the FB file to the internal data format based on the mapping settings during the import process to import the transfer request data. Then, the data processing device 100 generates deposit data and deposit reconciliation data based on the converted internal data and executes the deposit process and deposit reconciliation process. Note that the format conversion process can perform not only format conversion from external data to internal data, but also format conversion from internal data to external data.
[0039] As described above, this embodiment allows the display unit 114 to display internal data display item names that have a high degree of similarity to the names of external data items. Therefore, it is possible to present the user with internal data items that are appropriate for the external data items, thereby reducing the workload related to mapping settings and suppressing misconfigurations of mappings.
[0040] Furthermore, according to this embodiment, since the matching term names can be pre-vectorized, the processing load for calculating cosine similarity using word vectors can be reduced.
[0041] Furthermore, according to this embodiment, the selected display item name can be appropriately associated with the name of the item in the external data.
[0042] [3. Contribution to the United Nations-led Sustainable Development Goals (SDGs)] This embodiment can contribute to improving operational efficiency and promoting appropriate management decisions within companies, thereby enabling contributions to SDGs Goals 8 and 9.
[0043] Furthermore, this embodiment can contribute to reducing waste and promoting paperless and digital processes, thereby contributing to SDGs Goals 12, 13, and 15.
[0044] Furthermore, this embodiment can contribute to strengthening control and governance, thereby enabling contributions to SDG Goal 16.
[0045] [4. Other Embodiments] In addition to the embodiments described above, the present invention may be implemented in various different embodiments within the scope of the technical idea described in the claims.
[0046] For example, among the processes described in the embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by known methods.
[0047] Furthermore, the processing procedures, control procedures, specific names, information including parameters such as registration data and search conditions for each process, screen examples, and database configuration shown in this specification and in the drawings may be changed at will unless otherwise specified.
[0048] Furthermore, with respect to the data processing device 100, each component shown in the diagram is a functional concept and does not necessarily need to be physically configured as shown.
[0049] For example, the processing functions of the data processing device 100, particularly those performed by the control unit, may be implemented in whole or in part by a CPU and a program interpreted and executed by the CPU, or they may be implemented as wired logic hardware. The program is recorded on a non-temporary computer-readable recording medium containing programmed instructions for the information processing device to execute the processing described in this embodiment, and is mechanically read by the data processing device 100 as needed. That is, a storage unit such as ROM or HDD (Hard Disk Drive) contains a computer program that works in cooperation with the OS to give instructions to the CPU and perform various processing tasks. This computer program is executed by being loaded into RAM and works in cooperation with the CPU to constitute the control unit.
[0050] Furthermore, this computer program may be stored on an application program server connected to the data processing device 100 via any network, and it is possible to download all or part of it as needed.
[0051] Furthermore, the program for executing the processing described in this embodiment may be stored on a non-temporary computer-readable recording medium, or it may be configured as a program product. Here, "recording medium" includes any "portable physical medium" such as memory cards, USB (Universal Serial Bus) memory, SD (Secure Digital) cards, flexible disks, magneto-optical disks, ROMs, EPROMs (Erasable Programmable Read Only Memory), EEPROMs (Registered Trademark) (Electrically Erasable and Programmable Read Only Memory), CD-ROMs (Compact Disk Read Only Memory), MOs (Magneto-Optical disks), DVDs (Digital Versatile Disks), and Blu-ray (Registered Trademark) Discs.
[0052] Furthermore, "program" refers to a data processing method described in any language or writing method, regardless of its format, such as source code or binary code. Note that "program" is not necessarily limited to a single, monolithic structure; it also includes distributed structures consisting of multiple modules or libraries, and those that work in cooperation with other programs, such as an operating system, to achieve their functions. Regarding the specific configuration and reading procedures for reading the recording medium in each device shown in the embodiments, as well as the installation procedures after reading, well-known configurations and procedures can be used.
[0053] The various databases stored in the memory unit are storage means such as RAM, ROM, other memory devices, hard disks, flexible disks, and optical disks, and store various programs, tables, databases, and web page files used for various processes and website provision.
[0054] Furthermore, the data processing device 100 may be configured as a known personal computer or workstation or other information processing device, or as an information processing device to which any peripheral devices are connected. Alternatively, the data processing device 100 may be implemented by installing software (including programs or data, etc.) on the device that enables the processing described in this embodiment.
[0055] Furthermore, the specific forms of distribution and integration of the devices are not limited to those shown in the figures, and all or part of them can be configured by functionally or physically distributing and integrating them in any unit according to various additions or functional loads. In other words, the embodiments described above may be implemented in any combination, or the embodiments may be implemented selectively. [Industrial applicability]
[0056] This invention is useful in industries where file exchange between one's own system and other systems occurs. [Explanation of symbols]
[0057] 100 Data Processing Devices 102 Control Unit 104 Communication Interface Section 106 Storage section 108 Input / Output Interface Section 112 Input device 114 Output device 121 Item Name Conversion Master 122 Item Name Conversion Master Table 123 Data Import Format Master 200 servers 300 Networks
Claims
1. A data processing device comprising a control unit that performs a mapping setting process, which is a process that associates items of external data used outside the company's system with items of internal data used within the company's system, and a display unit, It is possible to access the item name conversion master table for converting the items of the external data to the items of the internal data. The aforementioned item name conversion master table is information that associates the names of columns in a data table with matching word names that are similar to the names of the columns in the data table and display item names that are the display names corresponding to the names of the items in the internal data. The control unit, The names of the items in the aforementioned external data are obtained, By performing morphological analysis on the names of the items in the acquired external data, the names of the items in the external data are broken down into words. Perform vectorization of the decomposed words to obtain word vectors of the names of the items in the external data, Based on the word vectors of the item names in the acquired external data and the word vectors of the matching word names in the item name conversion master table, the cosine similarity is calculated. A ranking is assigned based on the calculated cosine similarity, A data processing device that displays the display item names of the item name conversion master table on the display unit based on the assigned rank.
2. The aforementioned item name conversion master table has matching word name vectors, which are word vectors of the matching word names, further associated with it. The data processing device according to claim 1, wherein the matching word name vector is obtained by performing morphological analysis on the matching word name in advance, thereby decomposing the matching word name into words, and then performing vectorization of the decomposed words.
3. The control unit, The data processing device according to claim 1, wherein when a display item name displayed on the display unit is selected, a mapping setting process is performed to associate the selected display item name with the name of an item in the external data.
4. A data processing method that performs a mapping configuration process, which is the process of associating items of external data used outside the company's system with items of internal data used within the company's system, A master table for converting the items of the external data to the items of the internal data is used. The aforementioned item name conversion master table is information that associates the names of columns in a data table with matching word names that are similar to the names of the columns in the data table and display item names that are the display names corresponding to the names of the items in the internal data. The names of the items in the aforementioned external data are obtained, By performing morphological analysis on the names of the items in the acquired external data, the names of the items in the external data are broken down into words. Perform vectorization of the decomposed words to obtain word vectors of the names of the items in the external data, Based on the word vectors of the item names in the acquired external data and the word vectors of the matching word names in the item name conversion master table, the cosine similarity is calculated. A ranking is assigned based on the calculated cosine similarity, A data processing method in which a data processing device equipped with a control unit displays the display item names of the item name conversion master table on the display unit based on the assigned rank.
5. A data processing program for causing a data processing device equipped with a control unit to execute a data processing method that performs a mapping setting process, which is a process that associates items of external data used outside the company's system with items of internal data used within the company's system, A master table for converting the items of the external data to the items of the internal data is used. The aforementioned item name conversion master table is information that associates the names of columns in a data table with matching word names that are similar to the names of the columns in the data table and display item names that are the display names corresponding to the names of the items in the internal data. The names of the items in the aforementioned external data are obtained, By performing morphological analysis on the names of the items in the acquired external data, the names of the items in the external data are broken down into words. Perform vectorization of the decomposed words to obtain word vectors of the names of the items in the external data, Based on the word vectors of the item names in the acquired external data and the word vectors of the matching word names in the item name conversion master table, the cosine similarity is calculated. A ranking is assigned based on the calculated cosine similarity, A data processing program that causes the data processing device to display the display item names of the item name conversion master table on the display unit based on the assigned rank.