Program, computer, information processing system, and information processing method

Abstract

To provide a program, a computer, an information processing system and an information processing method which can make event information described in paper leaflets widely and publicly known.SOLUTION: A computer (management server 10) functions as reception means 14, extraction means 16, classification means 18, and transmission means 20, by executing a program. The reception means 14 receives printed matter information including an image of a printed matter, the extraction means 16 extracts event information from an image of the printed matter in the received printed matter information, the classification means 18 extracts specific information on a previously set item from the extracted event information, and classifies the event information for each of the previously set items on the basis of the extracted specific information, and the transmission means 20 transmits a display instruction signal to a user terminal 40, so as to display the event information classified into each of the previously set items by the classification means 18 on the user terminal 40.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a program, a computer, an information processing system, and an information processing method.

Background Art

[0002] Conventionally, various distribution systems for distributing leaflets to user terminals are known. For example, Patent Document 1 discloses a leaflet distribution system that distributes leaflets from a server to a terminal device and allows the leaflets to be viewed on the terminal device. Also, Patent Document 2 discloses a leaflet management device that enables a user to easily search for leaflets corresponding to desired products.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] There is a problem that a huge amount of paper leaflets exist in facilities of local governments and regional facilities, etc., but these information cannot be effectively provided to local residents.

[0005] The present disclosure has been made in consideration of such points, and an object thereof is to provide a program, a computer, an information processing system, and an information processing method capable of widely publicizing event information described in leaflets.

Means for Solving the Problems

[0006] The program of the present disclosure is A program that causes a computer to function as reception means, extraction means, classification means, and transmission means, wherein the reception means receives printed matter information including an image of the printed matter, the extraction means extracts event information from the image of the printed matter in the received printed matter information, the classification means extracts specific information regarding preset items from the extracted event information, and classifies the event information for each preset item based on the extracted specific information, and the transmission means transmits a display instruction signal to the user terminal to cause the user terminal to display the event information classified for each preset item by the classification means or to make the event information viewable.

[0007] Also, in the program of the present disclosure, the classification means may transmit a prompt including a question for extracting the specific information regarding the preset items from the extracted event information to a language model server, and when receiving an answer to the question calculated by the language model server from the language model server, classify the event information for each preset item based on the received answer.

[0008] Also, in the program of the present disclosure, information on the type of event information that the user wishes to view can be set on the user terminal, and the display instruction signal may cause the user terminal to display the event information related to the type set by the user.

[0009] Also, information on the location of the event information that the user wishes to view can be set on the user terminal, and the display instruction signal may cause the user terminal to display the event information related to the location set by the user.

[0010] In addition, in the user terminal, the user can set the date and time information of the event information that the user wants to view, and the display instruction signal may cause the user terminal to display the event information related to the date and time set by the user.

[0011] In addition, the program of the present disclosure further causes the computer to function as a determination means, and the determination means may determine whether the image of the printed matter is related to the event from the extracted event information.

[0012] In addition, in the program of the present disclosure, the determination means may determine whether the image of the printed matter is related to the event based on the specific information related to the preset items extracted by the classification means.

[0013] In addition, the program of the present disclosure further causes the computer to function as a duplicate determination means, and the duplicate determination means may determine whether the image of the printed matter newly received by the reception means overlaps with the image of the printed matter received by the reception means in the past.

[0014] In addition, in the program of the present disclosure, the duplicate determination means may perform a duplicate determination based on the event information extracted from the image of the printed matter newly received by the reception means and the event information extracted from the image of the printed matter received by the reception means in the past, or based on the specific information related to the preset items further extracted from the event information extracted from the image of the printed matter newly received by the reception means and the specific information related to the preset items further extracted from the event information extracted from the image of the printed matter received by the reception means in the past.

[0015] In addition, the program of the present disclosure further causes the computer to function as a privilege granting means, The printed matter information received by the reception means includes the user identification information of the user who transmitted information regarding the image of the printed matter to the computer, When the reception means receives the printed matter information, the privilege granting means may grant a privilege to the user corresponding to the user identification information included in the printed matter information.

[0016] Also, in the program of the present disclosure, When the image of the printed matter newly received by the reception means does not overlap with the image of the printed matter received by the reception means in the past, the privilege granting means may grant a more advantageous privilege than when the image of the printed matter newly received by the reception means overlaps with the image of the printed matter received by the reception means in the past.

[0017] Also, in the program of the present disclosure, The printed matter information received by the reception means includes specific auxiliary information set by the user together with the image of the printed matter, In addition to the specific information regarding the preset items extracted, the classification means may classify the event information for each preset item based on the specific auxiliary information included in the printed matter information received by the reception means.

[0018] Also, the program of the present disclosure Further functions the computer as a privilege granting means, The printed matter information received by the reception means includes the user identification information of the user who transmitted information regarding the image of the printed matter to the computer, When the reception means receives the printed matter information, the privilege granting means grants a privilege to the user corresponding to the user identification information included in the printed matter information, When the printed matter information received by the reception means includes specific auxiliary information set by the user, the privilege granting means may grant a more advantageous privilege than when the printed matter information received by the reception means does not include the specific auxiliary information.

[0019] In addition, the program of the present disclosure causes the computer to further function as a browsing rate calculation means, after the transmission means transmits the display instruction signal to the user terminal, when the event information is browsed on the user terminal, the reception means receives browsing information, the browsing rate calculation means may calculate a browsing rate, which is the ratio of the event information transmitted to the user terminal by the transmission means and browsed by the user on the user terminal, based on the number of user terminals to which the transmission means has transmitted the display instruction signal and the number of browsing information received by the reception means.

[0020] In addition, in the program of the present disclosure, the transmission means may transmit the display instruction signal so that the event information can be browsed on a predetermined user terminal based on the browsing rate calculated by the browsing rate calculation means.

[0021] The computer of the present disclosure is a computer that functions as a reception means, an extraction means, a classification means, and a transmission means by executing a program, the reception means receives printed matter information including an image of the printed matter, the extraction means extracts event information from the image of the printed matter in the received printed matter information, the classification means extracts specific information regarding preset items from the extracted event information, and classifies the event information for each preset item based on the extracted specific information, the transmission means transmits a display instruction signal to the user terminal so that the event information classified for each preset item by the classification means is displayed on the user terminal or makes the event information browsable.

[0022] The information processing system of the present disclosure is a computer and a user terminal communicably connected to the computer, comprises The computer functions as a receiving means, an extracting means, a classifying means, and a transmitting means by executing a program. The receiving means receives printed matter information including an image of the printed matter. The extracting means extracts event information from the image of the printed matter in the received printed matter information. The classifying means extracts specific information regarding preset items from the extracted event information, and classifies the event information for each preset item based on the extracted specific information. The transmitting means transmits a display instruction signal to the user terminal to cause the user terminal to display the event information classified for each preset item by the classifying means, or enables the event information to be browsed.

[0023] The information processing method of the present disclosure is an information processing method executed by a computer having a control unit, wherein the control unit receives printed matter information including an image of the printed matter; the control unit extracts event information from the image of the printed matter in the received printed matter information; the control unit extracts specific information regarding preset items from the extracted event information, and classifies the event information for each preset item based on the extracted specific information; the control unit transmits a display instruction signal to the user terminal to cause the user terminal to display the event information classified for each preset item, or enables the event information to be browsed. characterized by comprising the above.

Advantages of the Invention

[0024] According to the program, computer, information processing system, and information processing method of the present disclosure, the event information described in a paper flyer can be widely publicized.

Brief Description of the Drawings

[0025]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Embodiments for Carrying Out the Invention

[0026] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings, but the invention according to the present disclosure is not limited thereto. FIGS. 1 to 6 are diagrams showing an information processing system 1 and an information processing method according to the present embodiment.

[0027] [Information Processing System 1] The information processing system 1 according to the present embodiment shown in FIG. 1 includes a management server 10, a user terminal 40, a local government terminal 42, a web server 44, a language model server 46, and a communication network 50. The management server 10 is a server that can be used through a communication network 50 such as an Internet line. The user terminal 40, the local government terminal 42, etc. are communicably connected to the management server 10 via the communication network 50. Each component of such an information processing system 1 will be described below.

[0028] <Management Server (Computer) 10> The configuration of the management server (computer) 10 of the present disclosure will be described with reference to FIG. 1. FIG. 1 is a schematic configuration diagram schematically showing the configuration of the management server 10 of the present disclosure. The management server 10 of the present embodiment is composed of an industrial computer, a personal computer, a tablet terminal, etc. As shown in FIG. 1, it includes a control unit 12, a storage unit 30, and a communication interface unit 32.

[0029] The control unit 12 is composed of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), etc., and controls the operation of the management server 10. Specifically, the control unit 12 functions as a reception means 14, an extraction means 16, a classification means 18, a transmission means 20, a determination means 22, a duplication determination means 24, a privilege granting means 26, a viewing rate calculation means 28, etc. by executing a program stored in the storage unit 30 described later. Each of these means will be described later.

[0030] The storage unit 30 is composed of, for example, an HDD (Hard Disk Drive), a RAM (Random Access Memory), a ROM (Read Only Memory), an SSD (Solid State Drive), etc. Also, the storage unit 30 is not limited to being built into the management server 10, and may be a storage medium (for example, a USB memory) that can be detachably attached to the management server 10. In the present embodiment, the storage unit 30 can store a program executed by the control unit 12, event information, items, specific information, prompts, etc. described later. Note that these programs, event information, etc. may be stored in other storage means (such as a cloud server) instead of the storage unit 30.

[0031] The communication interface unit 32 connects the control unit 12 to an external device (for example, a user terminal 40, etc.) communicably by wireless or wired. The control unit 12 can transmit and receive signals to and from the external device via the communication interface unit 32.

[0032] (Details of the Control Unit 12) (Reception means 14) The reception means 14 has a function of receiving printed matter information including an image of the printed matter. The reception means 14 can receive the printed matter information including the image of the printed matter from the user terminal 40 or the local government terminal 42 via the website where the program according to the present disclosure is executed.

[0033] Examples of the "printed matter" include distributed materials such as so-called flyers introducing events. This printed matter preferably includes at least the name of the event, the date of holding, the location, the content, etc. (the "items" described later) in order to identify the event. It may also include the contact information or inquiry destination of the event organizer. Here, the "event" refers to a planned activity or event that has a specific purpose or theme, regardless of whether it is paid or free, and is held by gathering people. For example, it is an event that is carried out at a specific date and time (date, period) and location for the purpose of providing specific cultural, educational, entertainment, or social experiences or information to participants or spectators. Also, the recruitment on which it is premised may be included in the "event". Thus, in this specification, the "event" is not particularly limited (see also the examples of "event content" among the items described later). Even if one person acts without an audience, it may fall under the event if the intention of the creator of the printed matter is realized. Also, the image of the printed matter may be composed of 1 page (1 side), 2 pages (both sides), or a plurality of pages (such as a booklet).

[0034] In addition, the "printed matter information" received by the reception means 14 includes an image of the printed matter, and may further include user identification information of the user who transmitted information regarding the image of the printed matter to the computer (management server 10), and specific auxiliary information set by the user. The "specific auxiliary information" is information that assists in identifying the event described in the printed matter other than the image, and is so-called word-of-mouth information. The specific auxiliary information includes information that supplements the insufficient information in the printed matter, such as the acquisition location of the printed matter, topic information, correction / supplementary matters, and information that enlivens the event, such as hopeful speculation and wishes. Note that information such as the access method to the event venue and the presence or absence of nearby toilets or convenience stores is also useful.

[0035] Further, after the transmission means 20, which will be described later, transmits a display instruction signal to the user terminal 40, the reception means 14 may be configured to receive the browsing information (indicating that it has been read) when the event information is browsed on the user terminal 40.

[0036] (Extraction means 16) The extraction means 16 extracts event information from the image of the printed matter in the printed matter information received by the reception means 14. For the extraction of event information, OCR (Optical Character Recognition) processing may be performed on the image to read characters, numbers, symbols, etc. of the printed matter. Here, the text information extracted from the image of the printed matter is the "event information". Note that the OCR processing may be performed by an external device. In this case, the extraction means 16 sends the image received by the reception means 14 to the external device and receives the event information after OCR processing from the external device.

[0037] (Classification means 18) The classification means 18 extracts specific information regarding preset items from the event information (text information) extracted by the extraction means 16, and classifies the event information for each preset item based on the extracted specific information. Here, the "specific information (regarding an item)" is information that assists in identifying an event described in a printed matter, like the aforementioned specific auxiliary information, but is text information extracted from a printed matter image. Also, the "items" are preset by the administrator of the computer (management server 10) (hereinafter also simply referred to as the administrator) in order to classify various events, and examples include the name of the event, the date of holding, the location, the content, etc. (see FIG. 4). That is, the event information can be classified by the name of the event, for each holding location (in alphabetical order, etc.), in chronological order of the date of holding, or for each content (genre). In this way, if the event information can be classified and introduced for each item, it is convenient for the user. That is, the user can easily search for events that they are interested in and want to participate in via the website where the program according to the present disclosure is executed. For example, on the website, it may be possible to view event information by region or by local government. Note that FIG. 5 shows an example of introducing event information for a specific location, and FIG. 6 shows an example of introducing event information for a certain month of holding. Also, the website may be designed so that events can be searched from multiple items.

[0038] Among the items, examples of event content (types, genres) include daily life (e.g., disaster prevention, traffic safety, emergency measures, festivals, neighborhood association meetings, matchmaking parties, free legal and tax consultations, bazaars, children's cafeterias, election speeches, construction guides, new building guides), child-rearing (e.g., consultations, guidance, nursery school visits, talks, reading clubs), sports (e.g., grass baseball), hobbies (e.g., pottery, dressing, cooking), learning and classrooms (e.g., running classes, piano, computer), school-related (e.g., sports meets, cultural festivals, study tours, experiential learning), etc., but are not limited to these. The event content may correspond to multiple genres, and the administrator can appropriately set the specific information and which genre the event corresponds to. For example, it is common to classify the event information based on who the organizer of the event is. If "running" is extracted as specific information from the event information of "running classes", it can be classified into "school-related" if organized by the municipality, "learning and classrooms" if organized by an educational organization, and "sports" if organized by a sports organization.

[0039] Also, the classification means 18 may send a prompt including questions for extracting specific information regarding preset items from the extracted event information to the language model server 46, and when receiving the answers to the questions calculated by the language model server 46 from the language model server 46, classify the event information for each preset item based on the received answers (FIG. 2, FIG. 4).

[0040] Examples of such language models include LLM (BERT, XLNeT, T5, GPT), etc., and GPT is particularly preferred. Note that FIG. 4 shows an example of a prompt for extracting specific information from event information. After extracting specific information from the text, these specific information will be displayed in the JSON format. Furthermore, constraint conditions as shown in FIG. 4 can also be set. Also, for example, the calendar can be unified to the Gregorian calendar.

[0041] Furthermore, the classification means 18 and the language model as described above may classify event information for each preset item based not only on specific information but also on specific auxiliary information. In this way, by inputting more information, the accuracy of specifying and classifying event information can be improved.

[0042] (Transmission means 20) The transmission means 20 transmits a display instruction signal to the user terminal 40 to cause the user terminal 40 to display the event information classified for each preset item by the classification means 18, or makes this event information viewable. "Making the event information viewable" means, for example, transmitting the event information to the web server 44 (e.g., step S8 in FIG. 3) so that the event information becomes viewable, and when a predetermined display button is pressed on the user terminal 40 using a browser, an app, etc., the event information becomes displayed on the user terminal 40 (e.g., step S9 in FIG. 3).

[0043] In the example shown in FIG. 1, in order to display the event information classified for each item on the user terminal 40, the display instruction signal is managed by the administrator of the management server 10 or the local government terminal 42 via the web server 44 on the communication network 50 so that the event information is displayed on the website. The present invention is not limited to this, and it may be executed by a so-called app (application software) installed on the user terminal 40. Furthermore, the program according to the present disclosure may be executed by both the website and the app.

[0044] (Judgment means 22) The judgment means 22 judges whether the image of the printed matter is related to the event from the extracted event information (text information). Furthermore, the judgment means 22 may judge whether the image of the printed matter is related to the event not only directly from the text information extracted by the extraction means 21 but also based on the specific information extracted by the classification means 18.

[0045] As a determination method, for example, if "month and date" is described, it is determined as an event, and in the case of only "year" or only "month", it can be determined in combination with other information. Machine learning can be used for such determination. Also, specific auxiliary information can be used to determine whether it is an event or not.

[0046] (Duplicate determination means 24) The duplicate determination means 24 determines whether the image of the printed matter newly received by the reception means 14 overlaps with the image of the printed matter received by the reception means 14 in the past. Further, in addition to image recognition, the duplicate determination by the duplicate determination means 24 is based on the event information extracted from the image of the printed matter newly received by the reception means 14 and the event information extracted from the image of the printed matter received by the reception means 14 in the past, or is based on the specific information regarding the preset items further extracted from the event information extracted from the image of the printed matter newly received by the reception means 14 and the specific information regarding the preset items further extracted from the event information extracted from the image of the printed matter received by the reception means 14 in the past, and may be performed. Here, rather than comparing the event information extracted from the images of the newly received and past printed matters, if the duplicate determination is made by comparing the specific information extracted from the images of the newly received and past printed matters, it is only necessary to compare a small amount of information such as the holding date, location, and content, so the duplicate determination can be made more simply and quickly. That is, if even one item is different, it can be determined that the compared printed matters are different.

[0047] The image of the printed matter to be received has different character shapes and brightness depending on the shooting direction and time zone, and even for the same printed matter, the images are not exactly the same. Therefore, by combining object and contour detection in the image, angle correction, image similarity determination (such as calculation of similarity of feature amounts), etc. using AI and various image recognition and operation algorithms, the duplicate determination can be made.

[0048] (Privilege granting means 26) When the reception means 14 receives the printed matter information, the privilege granting means 26 grants a privilege to the user corresponding to the user identification information included in the printed matter information. Further, when the image of the printed matter newly received by the reception means 14 does not overlap with the image of the printed matter received by the reception means 14 in the past, the privilege granting means 26 may grant a more advantageous privilege than when the image of the printed matter newly received by the reception means 14 overlaps with the image of the printed matter received by the reception means 14 in the past. Furthermore, when the printed matter information received by the reception means 14 includes specific auxiliary information set by the user, the privilege granting means 26 may grant a more advantageous privilege than when the printed matter information received by the reception means 14 does not include specific auxiliary information. Also, the content of the privilege may be changed according to the content of the specific auxiliary information.

[0049] Note that the "privilege" is not particularly limited, and examples include money, money equivalents (such as gift certificates and points), prizes, etc. As the "more advantageous privilege", the amount of money or the like may be changed, or types such as gold points, silver points, and bronze points may be set. For example, one gold point may correspond to five silver points, and one silver point may correspond to five bronze points, and the superiority or inferiority may be set for the types.

[0050] (Browsing rate calculation means 28) The browsing rate calculation means 28 calculates the browsing rate based on the number of user terminals 40 to which the transmission means 20 has transmitted the display instruction signal and the number of browsing information received by the reception means 14. The "browsing rate" is the ratio at which the event information transmitted to the user terminal 40 by the transmission means 20 is browsed by the user on the user terminal 40 (the number of browsing information received by the reception means 14 / the number of user terminals 40 to which the transmission means 20 has transmitted the display instruction signal). Based on this browsing rate calculated by the browsing rate calculation means 28, the transmission means 20 may transmit a display instruction signal so that the event information can be browsed on a predetermined user terminal 40.

[0051] <User terminal 40> The user terminal 40 includes a personal computer, a tablet terminal, a mobile terminal, etc., but is not particularly limited as long as it can transmit and receive data with the management server 10 and input and output information. The user terminals 40 do not have to be the same terminal, and the same user may transmit and receive information using different terminals at different times. Also, whether the user is an individual or a group, as long as they are identified by the same registration information (user ID).

[0052] <Municipal terminal 42> The municipal terminal 42 includes an industrial computer, a personal computer, a tablet terminal, etc. The administrator of the municipal terminal 42 is a local government (prefecture, city, town, village, etc.). The municipal terminal 42 is communicably connected to the management server 10 via the communication network 50. If event information held by the local government is transmitted from the management server 10 (transmission means 20), the local government that operates the municipal terminal 42 can post this event information on its own website to provide information to residents. Also, the municipal terminal 42 may be able to send an instruction signal to the management server 10 or the web server 44 to send event information only to the user terminals 40 within this local government.

[0053] <Web server 44> The web server 44 is a server such as an industrial computer that responds to requests from the user terminal 40 etc. on a web page in accordance with the program by the management server 10 according to the present disclosure, and may be provided in a state where a virtual dedicated server is constructed in a physical server accessible via the Internet. The website on which the program according to the present disclosure is executed is managed by the web server 44. Also, as described above, the program according to the present disclosure may be executed by a so-called app (application software).

[0054] Note that via a screen on a website or an app, a user can set information on the types of event information that the user terminal 40 desires to view, and the display instruction signal can also cause the user terminal 40 to display event information related to the types set by the user. That is, depending on the settings of the management server 10, only the event information of the types that the user desires to view can be displayed on the user terminal 40. Alternatively, according to the settings of the management server 10, all event information is to be displayed on the user terminal 40, but depending on the user's selection, only the event information of the content (genre) desired by the user can be displayed on the user terminal 40. Here, if there are unique events, a category named "Others" may be set for the user to select. Also, there may be a plurality of types of event information to be selected.

[0055] Also, via a screen on a website or an app, a user can set information on the locations of event information that the user terminal 40 desires to view, and the display instruction signal can also cause the user terminal 40 to display event information related to the locations set by the user. That is, depending on the settings of the management server 10, only the event information held at the locations specified by the user can be displayed on the user terminal 40. Alternatively, according to the settings of the management server 10, all event information is to be displayed on the user terminal 40, but depending on the user's selection, only the event information of the venues where the user desires to hold events can be displayed on the user terminal 40. FIG. 5 shows an example in which events held in the "Toyosu, Higashi-Shinbashi, Ariake area" are displayed. The event information may be displayed in a map format. Further, for example, when the venue of the event to be viewed is the user's current location, only the event information of the current location may be displayed, or it may be set to also display the event information in the neighboring prefectures, cities, and towns.

[0056] Furthermore, via a screen on a website or an app, the user can set the date and time information of the event information they want to view on the user terminal 40, and the display instruction signal can also cause the user terminal 40 to display the event information related to the date and time set by the user. That is, according to the setting of the management server 10, only the event information at the date and time the user wants to view can be displayed on the user terminal 40. Alternatively, according to the setting of the management server 10, all event information is to be displayed on the user terminal 40, but depending on the user's selection, only the event information at the date and time the user desires can also be displayed on the user terminal 40. Fig. 6 shows an example where events held in May 2023 are displayed in a calendar format. Clicking on each event column enables viewing of its content. Also, specific auxiliary information may be made viewable. For past events, so-called review functions or community spaces (SNS) may be provided, and the view count (view rate) and actual number of participants may also be displayed so that the level of interest of other users can be understood.

[0057] Note that as a method of displaying event information, the user may simultaneously set and display on the user terminal 40 the type, location, and date and time of the event they want to view, and it may also be set up so that the user can further narrow down the event information they want to view from the displayed event information. For example, when futsal preliminaries are being held simultaneously, these event information can be narrowed down. Also, new event information may be received in email format, and for the new information received, the user may be able to select the type, location, and date and time of the event they want to view.

[0058] <Language model server 46> The language model server 46 is a server such as an industrial computer that responds to requests from the user terminal 40 etc. on a web page in accordance with a program by the management server 10 according to the present disclosure.

[0059] [Information processing method] Next, an information processing method according to the present disclosure will be described. Specifically, an example of the information processing method in the information processing system 1 described above will be described with reference to FIGS. 3 to 6. Components with the same reference numerals are the same as the above-described components, and duplicate descriptions will be omitted as appropriate.

[0060] First, the management server 10 (control unit 12, reception means 14) receives print information including an image of a printed matter from the user terminal 40 (FIG. 3, step S1).

[0061] Next, the control unit 12 (extraction means 16) extracts event information from the image of the printed matter in the received print information (FIG. 3, step S2).

[0062] Next, the control unit 12 (determination means 22) determines whether the image of the printed matter is related to an event (FIG. 3, step S3). Here, as described above, this determination process is performed from the extracted event information (text information).

[0063] If the image of the printed matter is not related to an event (\"NO\" in step S4), the process ends by the control unit 12. On the other hand, if the image of the printed matter is related to an event (\"YES\" in step S4), next, the control unit 12 (classification means 18) transmits a prompt including a question for extracting specific information to the language model server 46 (FIG. 3, step S5). Here, specific information is extracted from the event information (text information) as shown in the JSON format of FIG. 4.

[0064] Then, based on the answer received from the language model server 46, the control unit 12 (classification means 18) classifies the event information for each preset item (FIG. 3, step S6).

[0065] Next, the control unit 12 (privilege granting means 26) grants a privilege to the user who transmitted the print information (FIG. 3, step S7).

[0066] Next, the control unit 12 (transmission means 20) transmits the event information to the web server 44 (FIG. 3, step S8).

[0067] Next, the control unit 12 (transmission means 20) transmits a display instruction signal to the user terminal 40, enabling the user to view the event information posted on the website managed by the web server 44 (FIG. 3, step S9).

[0068] The above information processing method is an example, and the processing flow is not limited to the above. For example, the determination process by the determination means 22 may be determined based on the specific information regarding the preset items extracted by the classification means 18, rather than immediately after step S2 (after step S6 in FIG. 3). Furthermore, the granting of benefits by the benefit granting means 26 may be performed after step S1 or after step S9. Also, a confirmation operation by manual input may be performed in each step.

[0069] In the program, computer (management server 10), information processing system 1, and information processing method of the present embodiment having the above configuration, by executing the program, the computer (management server 10) functions as the reception means 14, extraction means 16, classification means 18, and transmission means 20. The reception means 14 receives print information including an image of a printed matter, the extraction means 16 extracts event information from the image of the printed matter in the received print information, the classification means 18 extracts specific information regarding preset items from the extracted event information, classifies the event information for each preset item based on the extracted specific information, and the transmission means 20 transmits a display instruction signal to the user terminal 40 to cause the user terminal 40 to display the event information classified for each preset item by the classification means 18 or makes the event information viewable.

[0070] Conventionally, there has been a huge amount of paper flyers in local governments, regional facilities, etc., and the number of flyer information created in a month can sometimes exceed 100. However, only a part of the information can be introduced in brochures or on websites. In addition, since there are multiple departments in charge and unified management is difficult, there has been a problem that these information cannot be effectively provided to local residents. On the other hand, there are also voices from local residents asking for event information for going out. That is, a huge number of flyers that can send event information to meet such demands have been created, but they have not reached the stage of information dissemination and operation such as webification, and most event information has not been utilized. In response to these problems, according to the program, computer (management server 10), information processing system 1, and information processing method of this embodiment, the user is asked to upload an image of a printed matter (flyer), and for example, perform OCR processing to read the characters of the flyer from the image, extract event information from the read characters, classify the extracted event information by item, and distribute the classified event information. In this way, compared with manually webifying, it is possible to shorten the working time to about one-fifth. Furthermore, it is possible to widely publicize the event information described in the flyer, and through cooperation with the administration, it is possible to realize the digital transformation of flyers, information sharing, and the creation of a town where people support each other.

[0071] Also, in the program, computer (management server 10), information processing system 1, and information processing method of this embodiment, as described above, the classification means 18 sends a prompt including a question for extracting specific information related to a preset item from the extracted event information to the language model server 46, and when receiving an answer to the question calculated by the language model server 46 from the language model server 46, the event information may be classified for each preset item based on the received answer. By using a generative AI such as GPT, it is possible to summarize text information or predict and create new sentences. In addition, compared with manual webification, routine processing such as summarizing the event content can be performed quickly, and the efficiency of the classification processing of text information can be improved.

[0072] Also, in the program, computer (management server 10), information processing system 1, and information processing method according to the present embodiment, the user can set information on the type of event information that the user wishes to view on the user terminal 40, and the display instruction signal may cause the user terminal 40 to display event information related to the type set by the user. Further, the user can set information on the location of the event information that the user wishes to view on the user terminal 40, and the display instruction signal may cause the user terminal 40 to display event information related to the location set by the user. Also, the user can set information on the date and time of the event information that the user wishes to view on the user terminal 40, and the display instruction signal may cause the user terminal 40 to display event information related to the date and time set by the user. As described above, by the user's selection and the settings of the computer (management server 10), only the event information of the type, location, and date and time set by the user can be displayed on the user terminal 40, enabling personalized distribution according to the user's attributes and interests.

[0073] Also, in the program, computer (management server 10), information processing system 1, and information processing method according to the present embodiment, the computer (management server 10) further functions as a determination means 22, and the determination means 22 may determine whether the image of the printed matter is related to the event from the extracted event information. Further, the determination means 22 may determine whether the image of the printed matter is related to the event based on the specific information regarding the preset items extracted by the classification means 18. In this way, it is possible to prevent the management server 10 (control unit 12) from performing unnecessary processing on printed matters such as receipts that are not related to the intended event, and thus prevent the user from accessing information other than the event.

[0074] Also, in the program, computer (management server 10), information processing system 1, and information processing method according to the present embodiment, the computer (management server 10) may further function as a duplication determination means 24, and the duplication determination means 24 may determine whether an image of a printed matter newly received by the reception means 14 overlaps with an image of a printed matter received by the reception means 14 in the past. Alternatively, the duplication determination means 24 is based on event information extracted from an image of a printed matter newly received by the reception means 14 and event information extracted from an image of a printed matter received by the reception means 14 in the past, or based on specific information regarding a preset item further extracted from the event information extracted from an image of a printed matter newly received by the reception means 14 and specific information regarding a preset item further extracted from the event information extracted from an image of a printed matter received by the reception means 14 in the past, duplication determination may be performed. In this way, it is possible to prevent one event from being registered and displayed on a website or posting site of an app in duplicate, and to prevent unnecessary confusion from occurring to users who come into contact with the event information.

[0075] Also, in the program, computer (management server 10), information processing system 1, and information processing method according to the present embodiment, the computer (management server 10) may further function as a privilege granting means 26, and the printed matter information received by the reception means 14 includes user identification information of a user who transmitted information regarding an image of a printed matter to the computer (management server 10), and the privilege granting means 26 may grant a privilege to a user corresponding to the user identification information included in the printed matter information when the reception means 14 receives the printed matter information. In this way, if a privilege is granted by providing the printed matter information, it will motivate the user to transmit the printed matter information to the management server 10, and it becomes possible to collect more printed matter information by the information processing system 1 or management server 10 of the present disclosure and make it widely known.

[0076] Also, in the program, computer (management server 10), information processing system 1, and information processing method according to the present embodiment, the privilege granting means 26 may grant a privilege that is more advantageous when the image of the printed matter newly received by the reception means 14 does not overlap with the image of the printed matter received by the reception means 14 in the past than when it overlaps with the image of the printed matter received by the reception means 14 in the past. Printed matter information of the same event may be transmitted by different users, and it is preferable from the viewpoint of motivation to grant a more advantageous privilege to the user who provided the new event information earlier. Conversely, when the images of the same printed matter are obtained from the same user ID, it can be set not to grant a privilege. Note that this duplication determination may be performed by the duplication determination means 24 described above.

[0077] Also, in the program, computer (management server 10), information processing system 1, and information processing method according to the present embodiment, the printed matter information received by the reception means 14 includes specific auxiliary information set by the user together with the image of the printed matter, and the classification means 18 can classify the event information for each preset item based on the specific auxiliary information included in the printed matter information received by the reception means 14 in addition to the specific information regarding the preset items that have been extracted. In this way, specific auxiliary information such as word-of-mouth information can be associated with the image of the printed matter and uploaded. Also, it can handle the case where the creator of the printed matter that viewed the website wants to correct the information described in the printed matter.

[0078] Also, in the program, computer (management server 10), information processing system 1, and information processing method according to the present embodiment, as described above, the computer (management server 10) further functions as privilege granting means 26, and the printed matter information received by reception means 14 includes the user identification information of the user who transmitted information regarding the image of the printed matter to the computer (management server 10). When reception means 14 receives the printed matter information, privilege granting means 26 grants a privilege to the user corresponding to the user identification information included in the printed matter information. When the printed matter information received by reception means 14 includes specific auxiliary information set by the user, privilege granting means 26 may grant a privilege more advantageous than when the specific auxiliary information is not included in the printed matter information received by reception means 14. This is because information not included in the image of the printed matter, such as word-of-mouth, may be valuable.

[0079] Also, in the program, computer (management server 10), information processing system 1, and information processing method according to the present embodiment, the computer (management server 10) further functions as viewing rate calculation means 28. After transmission means 20 transmits a display instruction signal to user terminal 40, when event information is viewed on user terminal 40, reception means 14 receives viewing information. Viewing rate calculation means 28 calculates a viewing rate, which is the ratio of the number of user terminals 40 to which transmission means 20 transmitted the event information and the number of viewing information received by reception means 14, based on the number of user terminals 40 to which transmission means 20 transmitted the display instruction signal and the number of viewing information received by reception means 14. This viewing rate (opening rate) reflects the user's interest and concern regardless of whether they participate or not. Based on the viewing rate, various marketing activities can be carried out based on the event information. From the perspective of the event organizer, the low participation rate provides information for examining whether the cause lies in the flyer format, the event title, the event date, etc. Comparing with the results of other events can assist in these examinations. Also, relevant persons such as those in the regional section of a local government can know the user's interest and concern based on the viewing rate (opening rate) and utilize it for the consideration and implementation of administrative projects.

[0080] Also, in the program, computer (management server 10), information processing system 1, and information processing method according to the present embodiment, the transmission means 20 may transmit a display instruction signal so that event information can be viewed on a predetermined user terminal 40 based on the viewing rate calculated by the viewing rate calculation means 28. As described above, it is possible to create an event heat map for each region from the viewing rate (opening rate). For example, a display instruction signal can be transmitted so that event information related to soccer can be viewed only on the user terminal 40 in a region where the viewing rate is high and soccer is presumed to be popular (for example, at the prefecture or municipality level). Conversely, in order to improve the degree of interest in soccer in a region with a low viewing rate, a display instruction signal can also be transmitted so that event information related to soccer can be viewed only on the user terminal 40 in a region with a low viewing rate.

[0081] Note that the program, computer (management server 10), information processing system 1, and information processing method according to the present embodiment are not limited to the above-described modes, and various changes can be made.

[0082] For example, the generation AI may be made to recognize the image of the printed matter itself. That is, by causing the generation AI to function as the extraction means 16 and the classification means 18, the event information may be classified for each item.

[0083] Also, by digitizing the printed matter (flyer) as described above, multi-language support and voice output are also made possible by a translation function or the like.

Explanation of Signs

[0084] 1 Information processing system 10 Management server (computer) 12 Control unit 14 Reception means 16 Extraction means 18 Classification means 20 Transmission means 22 Judgment means 24 Duplication judgment means 26 Incentive granting means 28 Browsing rate calculation means 30 Memory unit 32 Communication interface unit 40 User terminal 42 Local government terminal 44 Web server 46 Language model server 50 Communication network

Claims

1. A program that causes a computer to function as a reception means, an extraction means, a determination means, a classification means, and a transmission means, wherein the reception means receives printed matter information including an image of the printed matter, the extraction means extracts event information from the image of the printed matter in the received printed matter information, the determination means determines whether the image of the printed matter is related to an event from the extracted event information, the classification means extracts specific information related to preset items from the extracted event information, and classifies the event information for each preset item based on the extracted specific information, the transmission means transmits a display instruction signal to the user terminal to cause the user terminal to display the event information classified for each preset item by the classification means, or makes the event information viewable.

2. The program according to claim 1, wherein the classification means transmits a prompt including a question for extracting the specific information related to the preset item from the extracted event information to a language model server, and when receiving an answer to the question calculated by the language model server from the language model server, classifies the event information for each preset item based on the received answer.

3. The program according to claim 1, wherein in the user terminal, the user can set information on the type of the event information to be viewed, and the display instruction signal causes the user terminal to display the event information related to the type set by the user.

4. The program according to claim 1, wherein in the user terminal, the user can set information on the location of the event information to be viewed, and the display instruction signal causes the user terminal to display the event information related to the location set by the user.

5. The program according to claim 1, wherein in the user terminal, the user can set information on the date and time of the event information to be viewed, and the display instruction signal causes the user terminal to display the event information related to the date and time set by the user.

6. The program according to claim 1, wherein the determination means determines whether the image of the printed matter is related to an event based on the specific information regarding the preset items extracted by the classification means.

7. The computer is further caused to function as a duplication determination means, The program according to claim 1, wherein the duplication determination means determines whether the image of the printed matter newly received by the reception means overlaps with the image of the printed matter received by the reception means in the past.

8. The duplication determination means performs a duplication determination based on the event information extracted from the image of the printed matter newly received by the reception means and the event information extracted from the image of the printed matter received by the reception means in the past, or based on the specific information regarding the preset items further extracted from the event information extracted from the image of the printed matter newly received by the reception means and the specific information regarding the preset items further extracted from the event information extracted from the image of the printed matter received by the reception means in the past. The program according to claim 7.

9. The computer is further caused to function as a privilege granting means, The printed matter information received by the reception means includes user identification information of the user who transmitted information regarding the image of the printed matter to the computer, The program according to claim 1, wherein the privilege granting means grants a privilege to the user corresponding to the user identification information included in the printed matter information when the reception means receives the printed matter information.

10. The program according to claim 9, wherein the privilege granting means grants a more advantageous privilege when the image of the printed matter newly received by the reception means does not overlap with the image of the printed matter received by the reception means in the past than when they overlap.

11. The printed matter information received by the reception means includes specific auxiliary information set by the user together with the image of the printed matter, The program according to claim 1, wherein the classification means classifies the event information for each preset item based on the specific information regarding the preset items extracted and the specific auxiliary information included in the printed matter information received by the reception means.

12. The computer is further caused to function as a privilege granting means, The printed matter information received by the reception means includes user identification information of the user who transmitted information regarding the image of the printed matter to the computer, When the reception means receives the printed matter information, the privilege granting means grants a privilege to the user corresponding to the user identification information included in the printed matter information, The privilege granting means according to claim 11, wherein when the printed matter information received by the reception means includes specific auxiliary information set by the user, a privilege superior to that in the case where the received printed matter information does not include the specific auxiliary information is granted to the printed matter information received by the reception means.

13. The computer is further caused to function as a viewing rate calculation means, After the transmission means transmits the display instruction signal to the user terminal, when the event information is viewed on the user terminal, the reception means receives viewing information, Based on the number of user terminals to which the transmission means has transmitted the display instruction signal and the number of viewing information received by the reception means, the viewing rate calculation means calculates a viewing rate, which is the ratio of the event information transmitted to the user terminal by the transmission means and viewed by the user on the user terminal. The program according to claim 1.

14. Based on the viewing rate calculated by the viewing rate calculation means, the transmission means transmits the display instruction signal so that the event information can be viewed on a predetermined user terminal. The program according to claim 13.

15. A computer that functions as a reception means, an extraction means, a determination means, a classification means, and a transmission means by executing a program, The reception means receives printed matter information including an image of a printed matter, The extraction means extracts event information from the image of the printed matter in the received printed matter information, The determination means determines whether the image of the printed matter is related to an event from the extracted event information, The classification means extracts specific information regarding preset items from the extracted event information, and classifies the event information for each preset item based on the extracted specific information, The transmission means transmits a display instruction signal to the user terminal so that the event information classified for each preset item by the classification means is displayed on the user terminal or makes the event information viewable. A computer.

16. A computer, and A user terminal communicably connected to the computer, comprising: The computer functions as a reception unit, an extraction unit, a determination unit, a classification unit, and a transmission unit by executing a program. The reception unit receives print information including an image of a printed matter. The extraction unit extracts event information from the image of the printed matter in the received print information. The determination unit determines whether the image of the printed matter is related to an event from the extracted event information. The classification unit extracts specific information related to a preset item from the extracted event information, and classifies the event information for each preset item based on the extracted specific information. The transmission unit transmits a display instruction signal to the user terminal to cause the user terminal to display the event information classified for each preset item by the classification unit, or makes the event information viewable. An information processing system.

17. An information processing method executed by a computer having a control unit, the step of the control unit receiving print information including an image of a printed matter; the step of the control unit extracting event information from the image of the printed matter in the received print information; the step of the control unit determining whether the image of the printed matter is related to an event from the extracted event information; the step of the control unit extracting specific information related to a preset item from the extracted event information, and classifying the event information for each preset item based on the extracted specific information; the step of the control unit transmitting a display instruction signal to the user terminal to cause the user terminal to display the event information classified for each preset item, or making the event information viewable; An information processing method comprising:

Images