Program, computer, information processing system and information processing method

The program transforms paper flyers into digital event information by extracting and classifying content from images, enabling widespread dissemination of local event information and addressing the inefficiency of manual conversion.

JP2025051123AActive Publication Date: 2025-04-04PIAZZA INC
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2023160054
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-09-25
Publication Date
2025-04-04
Estimated Expiration
2043-09-25

AI Technical Summary

Technical Problem

Local government facilities and local facilities have a large number of paper flyers with event information that cannot be effectively disseminated to local residents.

Method used

A program that enables a computer to function as a reception, extraction, classification, and transmission means, accepting printed matter information, extracting event information from images, classifying it into preset items, and transmitting display instructions to user terminals for viewing.

Benefits of technology

The program effectively publicizes event information from paper flyers to a wider audience, reducing manual conversion time and enhancing the dissemination of local event information.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025051123000001_ABST
    Figure 2025051123000001_ABST
Patent Text Reader

Abstract

To provide a program, a computer, an information processing system and an information processing method which can make event information described in paper leaflets widely and publicly known.SOLUTION: A computer (management server 10) functions as reception means 14, extraction means 16, classification means 18, and transmission means 20, by executing a program. The reception means 14 receives printed matter information including an image of a printed matter, the extraction means 16 extracts event information from an image of the printed matter in the received printed matter information, the classification means 18 extracts specific information on a previously set item from the extracted event information, and classifies the event information for each of the previously set items on the basis of the extracted specific information, and the transmission means 20 transmits a display instruction signal to a user terminal 40, so as to display the event information classified into each of the previously set items by the classification means 18 on the user terminal 40.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a program, a computer, an information processing system, and an information processing method. [Background technology]

[0002] Conventionally, various distribution systems for distributing electronic flyers to user terminals have been known. For example, Patent Document 1 discloses an electronic flyer distribution system that distributes electronic flyers from a server to a terminal device and allows the user to view the electronic flyers on the terminal device. Patent Document 2 discloses an electronic flyer management device that allows the user to easily search for electronic flyers that correspond to products that the user wants. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-109771 A [Patent Document 2] JP 2023-084136 A Summary of the Invention [Problem to be solved by the invention]

[0004] There are huge amounts of paper flyers in municipal and local facilities, but there was a problem in that this information could not be provided effectively to local residents.

[0005] The present disclosure has been made in consideration of these points, and aims to provide a program, computer, information processing system, and information processing method that can widely disseminate event information listed on flyers. [Means for solving the problem]

[0006] The program of the present disclosure is A program that causes a computer to function as a receiving means, an extracting means, a classifying means, and a transmitting means, The receiving means receives print information including an image of a print, The extraction means extracts event information from an image of the printed matter in the received printed matter information, The classification means extracts specific information related to a preset item from the extracted event information, and classifies the event information for each preset item based on the extracted specific information; The transmission means is characterized in that it transmits a display instruction signal to the user terminal to cause the user terminal to display the event information classified by items preset by the classification means, or makes the event information viewable.

[0007] In addition, in the program of the present disclosure, The classification means may transmit a prompt including a question for extracting the specific information related to a preset item from the extracted event information to a language model server, and upon receiving an answer to the question calculated by the language model server from the language model server, classify the event information for each preset item based on the received answer.

[0008] In addition, in the program of the present disclosure, The user may be able to set information on the type of event information that he or she wishes to view on the user terminal, and the display instruction signal may cause the user terminal to display the event information related to the type set by the user.

[0009] In addition, the user may be able to set location information of the event information that the user wishes to view on the user terminal, and the display instruction signal may cause the user terminal to display the event information related to the location set by the user.

[0010] In addition, the user may be able to set information on the date and time of the event information that he or she wishes to view on the user terminal, and the display instruction signal may cause the user terminal to display the event information related to the date and time set by the user.

[0011] In addition, the program of the present disclosure is The computer further functions as a determination means, The determining means may determine, from the extracted event information, whether or not the image of the printed matter is related to an event.

[0012] In addition, in the program of the present disclosure, The determining means may determine whether or not the image of the printed matter is related to an event, based on the specific information related to a preset item extracted by the classifying means.

[0013] In addition, the program of the present disclosure is The computer is further caused to function as a duplication determination means, The overlap determination means may determine whether or not an image of a printed sheet newly accepted by the acceptance means overlaps with an image of a printed sheet previously accepted by the acceptance means.

[0014] In addition, in the program of the present disclosure, The overlap determination means may perform overlap determination based on event information extracted from an image of a printed matter newly accepted by the reception means and event information extracted from an image of a printed matter previously accepted by the reception means, or based on specific information regarding pre-set items further extracted from the event information extracted from the image of a printed matter newly accepted by the reception means and specific information regarding pre-set items further extracted from the event information extracted from an image of a printed matter previously accepted by the reception means.

[0015] In addition, the program of the present disclosure is causing the computer to further function as a reward providing means; the print information received by the reception means includes user identification information of a user who has transmitted information regarding an image of the print to the computer; The bonus granting means may grant a bonus to a user corresponding to user identification information included in the printed matter information when the accepting means accepts the printed matter information.

[0016] In addition, in the program of the present disclosure, When the image of the printed matter newly accepted by the acceptance means does not overlap with an image of a printed matter previously accepted by the acceptance means, the bonus granting means may grant a more advantageous bonus than when the image of the printed matter newly accepted by the acceptance means overlaps with an image of a printed matter previously accepted by the acceptance means.

[0017] In addition, in the program of the present disclosure, The print information received by the reception means includes specific auxiliary information set by a user together with an image of the print, The classification means may classify the event information into each pre-set item based on specific auxiliary information contained in the printed information accepted by the acceptance means, in addition to the specific information relating to the extracted pre-set items.

[0018] In addition, the program of the present disclosure is causing the computer to further function as a reward providing means; the print information received by the reception means includes user identification information of a user who has transmitted information regarding an image of the print to the computer; When the reception means receives the printed matter information, the reward giving means grants a reward to a user corresponding to user identification information included in the printed matter information; When the printed matter information accepted by the reception means includes specific auxiliary information set by a user, the bonus granting means may grant a more advantageous bonus than when the printed matter information accepted by the reception means does not include the specific auxiliary information.

[0019] In addition, the program of the present disclosure is The computer is further caused to function as a browsing rate calculation means, the accepting means accepts viewing information when the event information is viewed at the user terminal after the transmitting means transmits the display instruction signal to the user terminal, The viewing rate calculation means may calculate a viewing rate, which is the percentage of the event information transmitted to the user terminal by the transmitting means that was viewed by users on the user terminal, based on the number of user terminals to which the transmitting means sent the display instruction signal and the number of viewing information received by the receiving means.

[0020] In addition, in the program of the present disclosure, The transmitting means may transmit the display instruction signal to make the event information viewable at a predetermined user terminal, based on the view rate calculated by the view rate calculating means.

[0021] The computer of the present disclosure includes: A computer that functions as a receiving means, an extracting means, a classifying means, and a transmitting means by executing a program, The receiving means receives print information including an image of a print, The extraction means extracts event information from an image of the printed matter in the received printed matter information, The classification means extracts specific information related to a preset item from the extracted event information, and classifies the event information for each preset item based on the extracted specific information; The transmission means is characterized in that it transmits a display instruction signal to the user terminal to cause the user terminal to display the event information classified by items preset by the classification means, or makes the event information viewable.

[0022] The information processing system of the present disclosure includes: A computer, A user terminal communicatively connected to the computer; Equipped with The computer functions as a receiving unit, an extracting unit, a classifying unit, and a transmitting unit by executing a program; The receiving means receives print information including an image of a print, The extraction means extracts event information from an image of the printed matter in the received printed matter information, The classification means extracts specific information related to a preset item from the extracted event information, and classifies the event information for each preset item based on the extracted specific information; The transmission means is characterized in that it transmits a display instruction signal to the user terminal to cause the user terminal to display the event information classified by items preset by the classification means, or makes the event information viewable.

[0023] The information processing method of the present disclosure includes: An information processing method executed by a computer having a control unit, a step of the control unit receiving print information including an image of a print; extracting event information from an image of the printed matter in the received printed matter information by the control unit; a step of the control unit extracting specific information related to a preset item from the extracted event information, and classifying the event information into each preset item based on the extracted specific information; a step of transmitting a display instruction signal to a user terminal by the control unit to cause the user terminal to display the event information classified by preset items, or making the event information viewable; The present invention is characterized by comprising: Effect of the Invention

[0024] According to the program, computer, information processing system, and information processing method disclosed herein, event information printed on paper flyers can be widely disseminated. [Brief description of the drawings]

[0025] [Figure 1] 1 is a diagram illustrating a schematic configuration of an information processing system according to an embodiment of the present invention. [Diagram 2] 2 is a diagram showing an exemplary flow of information processing by the information processing system shown in FIG. 1. [Diagram 3] FIG. 2 is a diagram showing an exemplary flow of information processing in an information processing method according to an embodiment of the present invention. [Figure 4] 1. FIG. 4 is a diagram showing an example of a prompt for extracting specific information from event information in the information processing system shown in FIG. [Diagram 5] 2 is a diagram showing a screen in which event information processed in the information processing system shown in FIG. 1 is displayed on a monitor of a user terminal. FIG. [Figure 6] 1. FIG. 4 is a diagram showing another screen in which event information processed in the information processing system shown in FIG. 1 is displayed on the monitor of the user terminal. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0026] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings, but the invention according to the present disclosure is not limited thereto. Fig. 1 to Fig. 6 are diagrams showing an information processing system 1 and an information processing method according to the present embodiment.

[0027] [Information Processing System 1] The information processing system 1 according to the present embodiment shown in Fig. 1 includes a management server 10, a user terminal 40, a local government terminal 42, a web server 44, a language model server 46, and a communication network 50. The management server 10 is a server that can be used through the communication network 50 such as an Internet line. The user terminal 40, the local government terminal 42, and the like are connected to the management server 10 so as to be able to communicate with each other via the communication network 50. Each of the components of the information processing system 1 will be described below.

[0028] <Management Server (Computer) 10> The configuration of a management server (computer) 10 of the present disclosure will be described with reference to Fig. 1. Fig. 1 is a schematic diagram showing the configuration of the management server 10 of the present disclosure. The management server 10 of this embodiment is composed of an industrial computer, a personal computer, a tablet terminal, or the like, and includes a control unit 12, a storage unit 30, and a communication interface unit 32, as shown in Fig. 1.

[0029] The control unit 12 is composed of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), etc., and controls the operation of the management server 10. Specifically, the control unit 12 executes programs stored in a storage unit 30, which will be described later, thereby functioning as a reception means 14, an extraction means 16, a classification means 18, a transmission means 20, a determination means 22, a duplication determination means 24, a reward granting means 26, a browsing rate calculation means 28, etc. Each of these means will be described later.

[0030] The storage unit 30 is configured with, for example, a hard disk drive (HDD), a random access memory (RAM), a read only memory (ROM), a solid state drive (SSD), etc. Furthermore, the storage unit 30 is not limited to being built into the management server 10, and may be a storage medium (for example, a USB memory) that can be detachably attached to the management server 10. In this embodiment, the storage unit 30 is configured to store a program executed by the control unit 12, event information, items, specific information, prompts, etc., which will be described later. Note that these programs, event information, etc. may be stored in other storage means (such as a cloud server) instead of the storage unit 30.

[0031] The communication interface unit 32 connects the control unit 12 to an external device (e.g., a user terminal 40, etc.) wirelessly or via a wire so as to be able to communicate with the external device. The control unit 12 is capable of transmitting and receiving signals to and from the external device via the communication interface unit 32.

[0032] (Details of control unit 12) (Means of reception 14) The reception unit 14 has a function of receiving printed matter information including an image of a printed matter. The reception unit 14 can receive printed matter information including an image of a printed matter from a user terminal 40 or a local government terminal 42 via a website on which a program according to the present disclosure is executed.

[0033] Examples of "printed material" include handouts such as so-called flyers that introduce events. In order to specify the event, it is preferable that the printed material includes at least the name, date, location, and content of the event ("items" described later). The printed material may also include the contact information and inquiries of the event organizer. Here, an "event" refers to a planned activity or event that has a specific purpose or theme and brings together people, regardless of whether it is paid or free. For example, it is an event that is held at a specific time (date, period) and place with the purpose of providing participants and spectators with a specific cultural, educational, entertainment, or social experience or information. In addition, the "event" may also include the recruitment that is the premise of the event. Thus, in this specification, the "event" is not particularly limited (see also the example of "event content" in the item described later). If the intention of the creator of the printed material is realized, even if one person acts without an audience, it may be considered an event. In addition, the image of the printed material may be composed of one page (one side), two pages (both sides), or multiple pages (such as a booklet).

[0034] Furthermore, the "printed matter information" received by the reception means 14 includes the image of the printed matter, and may further include user identification information of the user who transmitted information on the image of the printed matter to the computer (management server 10) and specific auxiliary information set by the user. The "specific auxiliary information" is information other than the image that assists in identifying the event described in the printed matter, and is so-called word-of-mouth information. The specific auxiliary information includes information that supplements information that is lacking in the printed matter, such as the location where the printed matter was obtained, information about the plot, corrections and supplementary information, and information that aims to liven up the event, such as wishful thinking and wishes. Information such as how to access the event venue and whether there are toilets or convenience stores nearby is also useful.

[0035] In addition, the receiving means 14 may be configured to receive viewing information (that the event information has been read) when the event information is viewed on the user terminal 40 after the transmitting means 20 described later transmits a display instruction signal to the user terminal 40.

[0036] (Extraction means 16) The extraction means 16 extracts event information from the image of the printed matter in the printed matter information accepted by the acceptance means 14. In order to extract the event information, OCR (optical character recognition) processing may be performed on the image to read characters, numbers, symbols, etc. on the printed matter. Here, the text information extracted from the image of the printed matter is the "event information." Note that the OCR processing may be performed by an external device, in which case the extraction means 16 sends the image accepted by the acceptance means 14 to the external device and accepts the event information after OCR processing from the external device.

[0037] (Classification means 18) The classification means 18 extracts specific information related to preset items from the event information (text information) extracted by the extraction means 16, and classifies the event information for each preset item based on the extracted specific information. Here, the "specific information (related to an item)" is information that assists in identifying the event described in the printed matter, like the above-mentioned specific auxiliary information, but is text information extracted from the printed matter image. In addition, the "item" is set in advance by the administrator (hereinafter simply referred to as the administrator) of the computer (management server 10) in order to classify various events, and examples include the name, date, location, and content of the event (see FIG. 4). That is, the event information can be classified by event name, by event location (alphabetical order, etc.), by event date (chronological order), and by content (genre). In this way, it is convenient for users if event information can be classified and introduced by item. That is, users can easily search for events that they are interested in and would like to participate in via a website on which the program according to the present disclosure is executed. For example, the website may be configured to allow users to view event information by region or by municipality. Note that Fig. 5 shows an example of introducing event information for a specific location, and Fig. 6 shows an example of introducing event information for a certain month. The website may also be designed to allow events to be searched for using multiple items.

[0038] Examples of the event contents (types, genres) among the items include, but are not limited to, daily life (e.g., disaster prevention, traffic safety, first aid, festivals, neighborhood association meetings, matchmaking parties, free legal and tax consultations, bazaars, children's cafeterias, election speeches, construction information, new building information), child-rearing (e.g., consultations, guidance, nursery school tours, talks, readings), sports (e.g., amateur baseball), hobbies (e.g., pottery, dressing, cooking), learning / classes (e.g., running classes, piano, computers), school-related (e.g., athletic meets, cultural festivals, tours, experiential learning), etc. Event contents may fall into multiple genres, and the administrator can set which genre the specific information or event falls into as appropriate. For example, the event information may be classified based on who is the organizer of the event. If "running" is extracted as specific information from event information for "running class," it is possible to categorize it as "school-related" if it is organized by a city, ward, town, or village, "learning / class" if it is organized by an educational organization, or "sports" if it is organized by a sports organization.

[0039] In addition, the classification means 18 may send a prompt including a question for extracting specific information related to a preset item from the extracted event information to the language model server 46, and upon receiving an answer to the question calculated by the language model server 46 from the language model server 46, classify the event information for each preset item based on the received answer (FIGS. 2 and 4).

[0040] Examples of this language model include LLM (BERT, XLNeT, T5, GPT), and GPT is particularly preferable. FIG. 4 shows an example of a prompt for extracting specific information from event information, and after specific information is extracted from text, the specific information is displayed in JSON format. Furthermore, constraint conditions such as those shown in FIG. 4 can also be set. For example, the calendar may be unified to the Gregorian calendar.

[0041] Furthermore, the classification means 18 and the above-mentioned language model may classify the event information for each preset item based on not only the specific information but also the specific auxiliary information. In this way, by inputting more information, the accuracy of identifying and classifying the event information can be improved.

[0042] (Transmission means 20) The transmitting means 20 transmits a display instruction signal to the user terminal 40 to cause the user terminal 40 to display the event information classified by the items preset by the classifying means 18, or makes the event information viewable. "Making the event information viewable" means, for example, transmitting the event information to the web server 44 so that the event information is viewable (e.g., step S8 in FIG. 3), and pressing a predetermined display button on a browser, app, or the like on the user terminal 40 causes the event information to be displayed on the user terminal 40 (e.g., step S9 in FIG. 3).

[0043] 1, in order to display the event information classified by item on the user terminal 40, a display instruction signal is sent via a web server 44 on the communication network 50, and the event information is displayed on a website managed by the administrator of the management server 10 or the local government terminal 42. The present invention is not limited to this, and may be executed by a so-called app (application software) installed on the user terminal 40. Furthermore, the program according to the present disclosure may be executed by both the website and the app.

[0044] (Judgment means 22) The determination means 22 determines whether or not the image of the printed matter is related to an event from the extracted event information (text information). Furthermore, the determination means 22 may determine whether or not the image of the printed matter is related to an event based on the specific information extracted by the classification means 18, in addition to directly determining based on the text information extracted by the extraction means 21.

[0045] As a method of determination, for example, if the "date" is written, it is determined to be an event, and if only the "year" and "month" are written, it can be determined by combining them with other information. Machine learning can be used for such determination. In addition, specific auxiliary information can also be used to determine whether it is an event or not.

[0046] (Duplicity determination means 24) The overlap determination means 24 determines whether the image of the printed matter newly accepted by the accepting means 14 overlaps with the image of the printed matter previously accepted by the accepting means 14. Furthermore, other than image recognition, the overlap determination by the overlap determination means 24 may be performed based on the event information extracted from the image of the printed matter newly accepted by the accepting means 14 and the event information extracted from the image of the printed matter previously accepted by the accepting means 14, or based on specific information related to preset items further extracted from the event information extracted from the image of the printed matter newly accepted by the accepting means 14 and specific information related to preset items further extracted from the event information extracted from the image of the printed matter previously accepted by the accepting means 14. Here, if the specific information extracted from the new and previously accepted printed matter images is compared to determine the overlap, it is possible to compare a small amount of information such as the date, location, and content, and therefore the overlap determination can be performed more simply and quickly. In other words, if even one item is different, it can be determined that the compared printed matter is different.

[0047] The images of the printed matter received will vary in character shape and brightness depending on the direction and time of day they were taken, so even if they are the same printed matter, the images will not be exactly the same. Therefore, duplication can be determined by combining object and contour detection within the image, angle correction, image similarity determination (calculation of similarity of feature amounts, etc.) using AI and various image recognition and operation algorithms.

[0048] (Benefit granting means 26) When the reception means 14 receives the printed matter information, the privilege granting means 26 grants a privilege to a user corresponding to the user identification information included in the printed matter information. In addition, when the image of the printed matter newly received by the reception means 14 does not overlap with the image of the printed matter previously received by the reception means 14, the privilege granting means 26 may grant a privilege that is more advantageous than when the image of the printed matter newly received by the reception means 14 overlaps with the image of the printed matter previously received by the reception means 14. In addition, when the printed matter information received by the reception means 14 includes specific auxiliary information set by the user, the privilege granting means 26 may grant a privilege that is more advantageous than when the printed matter information received by the reception means 14 does not include the specific auxiliary information. In addition, the content of the privilege may be changed depending on the content of the specific auxiliary information.

[0049] The "benefit" is not particularly limited, and examples include money, monetary equivalents (gift certificates, points, etc.), prizes, etc. The "superior benefit" may be a change in the amount of money, etc., or may be classified into categories such as gold points, silver points, and bronze points, and the superiority or inferiority of each category may be set, for example, such that one gold point is equivalent to five silver points, and one silver point is equivalent to five bronze points, etc.

[0050] (Viewing rate calculation means 28) The viewing rate calculation means 28 calculates a viewing rate based on the number of user terminals 40 to which the transmitting means 20 has transmitted a display instruction signal and the number of pieces of viewing information received by the receiving means 14. The "viewing rate" is the proportion of the event information transmitted to the user terminals 40 by the transmitting means 20 that has been viewed by users at the user terminals 40 ("the number of pieces of viewing information received by the receiving means 14" / "the number of user terminals 40 to which the transmitting means 20 has transmitted a display instruction signal"). Based on this viewing rate calculated by the viewing rate calculation means 28, the transmitting means 20 may transmit a display instruction signal to make the event information viewable at a specific user terminal 40.

[0051] <User terminal 40> The user terminal 40 may be a personal computer, a tablet terminal, a mobile terminal, etc., but is not particularly limited as long as it can transmit and receive information to and from the management server 10. The user terminal 40 does not have to be the same terminal, and the same user may transmit and receive information using different terminals at different times. In addition, the user may be an individual or an organization as long as they are identified by the same registration information (user ID).

[0052] <Local Government Terminal 42> The local government terminal 42 includes an industrial computer, a personal computer, a tablet terminal, and the like. The manager of the local government terminal 42 is a local government (such as a prefecture, a city, a ward, a town, or a village). The local government terminal 42 is communicatively connected to the management server 10 via a communication network 50, and when event information to be held in the local government is transmitted from the management server 10 (transmission means 20), the local government operating the local government terminal 42 can post the event information on its own website to provide the information to residents. In addition, the local government terminal 42 may be capable of transmitting an instruction signal to the management server 10 or the web server 44 to transmit the event information only to user terminals 40 within the local government.

[0053] <Web Server 44> The web server 44 is a server such as an industrial computer that responds to requests from the user terminal 40 or the like on a web page in accordance with the program by the management server 10 according to the present disclosure, and may be provided in a state in which a virtual dedicated server is constructed within a physical server accessible via the Internet. The website on which the program according to the present disclosure is executed is managed by the web server 44. Also, as described above, the program according to the present disclosure may be executed by a so-called app (application software).

[0054] In addition, the user can set the type of event information that the user wants to view on the user terminal 40 via a screen on the website or app, and the display instruction signal can also cause the user terminal 40 to display event information related to the type set by the user. That is, the management server 10 can be set to display only the type of event information that the user wants to view on the user terminal 40. Alternatively, although all event information is to be displayed on the user terminal 40 according to the management server 10 setting, the user can select to display only event information of the content (genre) desired by the user on the user terminal 40. Here, if there is a unique event, a category of "other" can be set to allow the user to select. Also, the type of event information to be selected may be multiple.

[0055] In addition, the user can set the location information of the event information he / she wants to view on the user terminal 40 via a screen on the website or app, and the display instruction signal can display the event information related to the location set by the user on the user terminal 40. That is, the management server 10 can display only the event information held at the location specified by the user on the user terminal 40 by setting. Alternatively, although all event information is to be displayed on the user terminal 40 according to the management server 10 setting, the user can select to display only the event information of the location desired by the user on the user terminal 40. FIG. 5 shows an example in which events held in the "Toyosu, Shinonome, and Ariake area" are displayed. The event information may be displayed in a map format. Furthermore, for example, if the location of the event to be viewed is the user's current location, only the event information of the current location may be displayed, and event information in neighboring prefectures and cities, towns, and villages may also be displayed.

[0056] Furthermore, the user can set the date and time of the event information that the user wants to view on the user terminal 40 via a screen on the website or app, and the display instruction signal can also display the event information related to the date and time set by the user on the user terminal 40. That is, the management server 10 can be set to display only the event information of the date and time that the user wants to view on the user terminal 40. Alternatively, the management server 10 sets all event information to be displayed on the user terminal 40, but the user can select to display only the event information of the date and time that the user wants on the user terminal 40. FIG. 6 shows an example in which events to be held in May 2023 are displayed in a calendar format. The contents of each event can be viewed by clicking on the event column. In addition, specific auxiliary information may also be viewable. For past events, a so-called review function or a community space (SNS) may be provided, and the number of views (view rate) and the actual number of participants may be displayed so that the interest level of other users can be understood.

[0057] As a method of displaying event information, the type, location, and date and time of the event that the user wants to view may be simultaneously set and displayed on the user terminal 40 by the user, and the user may be able to further narrow down the event information that he / she wants to view from the displayed event information. For example, if a futsal qualifying match is being held at the same time, the user may be able to narrow down the event information. In addition, new event information may be received in the form of email, and the user may be able to select the type, location, and date and time of the event that he / she wants to view for the new information to be received.

[0058] <Language Model Server 46> The language model server 46 is a server such as an industrial computer that responds to requests from the user terminal 40 or the like on a web page in accordance with a program by the management server 10 according to the present disclosure.

[0059] [Information processing method] Next, an information processing method according to the present disclosure will be described. Specifically, an example of the information processing method in the above-mentioned information processing system 1 will be described with reference to Fig. 3 to Fig. 6. Components with the same reference numerals are the same as the above-mentioned components, and duplicated descriptions will be omitted as appropriate.

[0060] First, the management server 10 (control unit 12, reception means 14) receives print information including an image of a print from the user terminal 40 (FIG. 3, step S1).

[0061] Next, the control unit 12 (extraction means 16) extracts event information from the image of the printed matter in the received printed matter information (FIG. 3, step S2).

[0062] Next, the control unit 12 (determination means 22) determines whether the image of the printed matter is related to an event (FIG. 3, step S3). Here, as described above, this determination process is performed from the extracted event information (text information).

[0063] If the image of the printed matter is not related to an event ("NO" in step S4), the control unit 12 ends the process. On the other hand, if the image of the printed matter is related to an event ("YES" in step S4), the control unit 12 (classification means 18) then sends a prompt including a question for extracting specific information to the language model server 46 (FIG. 3, step S5). Here, the specific information is extracted from the event information (text information) as shown in the JSON format in FIG. 4.

[0064] Then, based on the response received from the language model server 46, the control unit 12 (classification means 18) classifies the event information into preset items (FIG. 3, step S6).

[0065] Next, the control unit 12 (benefit providing means 26) provides a benefit to the user who has transmitted the print information (FIG. 3, step S7).

[0066] Next, the control unit 12 (transmission means 20) transmits the event information to the web server 44 (FIG. 3, step S8).

[0067] Next, the control unit 12 (transmission means 20) transmits a display instruction signal to the user terminal 40, allowing the user to view the event information posted on the website managed by the web server 44 (FIG. 3, step S9).

[0068] The above-mentioned information processing method is an example, and the process flow is not limited to the above. For example, the determination process by the determination means 22 may be performed based on specific information related to a preset item extracted by the classification means 18, not immediately after step S2 (after step S6 in FIG. 3). Furthermore, the award by the award granting means 26 may be performed after step S1 or after step S9. Also, manual confirmation may be performed at each step.

[0069] In the program, computer (management server 10), information processing system 1, and information processing method of this embodiment configured as described above, by executing the program, the computer (management server 10) functions as a reception means 14, an extraction means 16, a classification means 18, and a transmission means 20, the reception means 14 receives printed matter information including images of printed matter, the extraction means 16 extracts event information from the images of printed matter in the received printed matter information, the classification means 18 extracts specific information relating to pre-set items from the extracted event information and classifies the event information for each pre-set item based on the extracted specific information, and the transmission means 20 transmits a display instruction signal to the user terminal 40 to cause the user terminal 40 to display the event information classified for each pre-set item by the classification means 18, or makes the event information viewable.

[0070] Conventionally, there are huge amounts of paper flyers in municipalities and local facilities, and flyer information may be created in a month, with more than 100 pieces of information, but only a part of the information can be introduced in public relations magazines and websites. In addition, there are multiple departments in charge, making it difficult to centrally manage the information, and there is a problem that this information cannot be effectively provided to local residents. On the other hand, there are also voices saying that local residents want event information for going out. In other words, a huge number of flyers that disseminate event information that can meet such demand have been created, but the information has not been disseminated or operated as in the case of web-based information, and most of the event information has not been used. In response to these problems, the program, computer (management server 10), information processing system 1, and information processing method of the present embodiment have users upload images of printed matter (flyers), and, for example, OCR processing is performed to read the characters on the flyer from the image, event information is extracted from the read characters, the extracted event information is classified by item, and the classified event information is distributed. In this way, it is possible to reduce the work time to about one-fifth compared to manually creating a web page. Furthermore, it is possible to widely disseminate the event information listed on the flyers, and by working with the government, it is possible to realize digital transformation of flyers, information sharing, and the creation of a city where people support each other.

[0071] In the program, computer (management server 10), information processing system 1, and information processing method of the present embodiment, as described above, the classification means 18 may transmit a prompt including a question for extracting specific information related to a preset item from the extracted event information to the language model server 46, and upon receiving an answer to the question calculated by the language model server 46 from the language model server 46, classify the event information for each preset item based on the received answer. By using a generation AI such as GPT, it is possible to summarize text information and predict and create new sentences. In addition, compared to manual web conversion, routine processing such as summarizing event contents can be performed quickly, and the efficiency of the classification processing of text information can be improved.

[0072] In addition, in the program, computer (management server 10), information processing system 1, and information processing method according to the present embodiment, the user can set information on the type of event information that the user wants to view on the user terminal 40, and the display instruction signal may be for displaying event information related to the type set by the user on the user terminal 40. In addition, the user can set information on the location of the event information that the user wants to view on the user terminal 40, and the display instruction signal may be for displaying event information related to the location set by the user on the user terminal 40. In addition, the user can set information on the date and time of the event information that the user wants to view on the user terminal 40, and the display instruction signal may be for displaying event information related to the date and time set by the user on the user terminal 40. In this way, only event information of the type, location, and date and time set by the user can be displayed on the user terminal 40 by the user's selection and the setting of the computer (management server 10), making it possible to perform personalized delivery according to the user's attributes and interests.

[0073] Furthermore, in the program, computer (management server 10), information processing system 1, and information processing method according to the present embodiment, the computer (management server 10) may further function as a determination means 22, which may determine whether or not an image of a printed matter is related to an event from the extracted event information. The determination means 22 may also determine whether or not an image of a printed matter is related to an event based on specific information related to preset items extracted by the classification means 18. In this way, it is possible to prevent the management server 10 (controller 12) from performing unnecessary processing on printed matter such as receipts that are unrelated to the intended event, and thus to prevent the user from accessing information other than that of the event.

[0074] In the program, computer (management server 10), information processing system 1, and information processing method according to the present embodiment, the computer (management server 10) may further function as a duplication determination means 24, and the duplication determination means 24 may determine whether or not an image of a printed matter newly accepted by the acceptance means 14 overlaps with an image of a printed matter previously accepted by the acceptance means 14. Alternatively, the duplication determination means 24 may perform duplication determination based on the event information extracted from the image of a printed matter newly accepted by the acceptance means 14 and the event information extracted from the image of a printed matter previously accepted by the acceptance means 14, or based on specific information regarding a preset item further extracted from the event information extracted from the image of a printed matter newly accepted by the acceptance means 14 and specific information regarding a preset item further extracted from the event information extracted from the image of a printed matter previously accepted by the acceptance means 14. In this way, it is possible to prevent one event from being registered, displayed, etc. on a website or an application posting site in duplicate, and to prevent unnecessary confusion from occurring to users who come into contact with the event information.

[0075] Moreover, in the program, computer (management server 10), information processing system 1, and information processing method according to the present embodiment, the computer (management server 10) further functions as a reward granting means 26, the printed matter information received by the reception means 14 includes user identification information of a user who has transmitted information related to an image of a printed matter to the computer (management server 10), and the reward granting means 26 may grant a reward to a user corresponding to the user identification information included in the printed matter information when the reception means 14 receives the printed matter information. In this way, if a reward is granted in exchange for providing printed matter information, this provides an incentive to transmit printed matter information to the management server 10, and it becomes possible for the information processing system 1 or the management server 10 disclosed herein to collect and widely disseminate a large amount of printed matter information.

[0076] In addition, in the program, computer (management server 10), information processing system 1, and information processing method according to the present embodiment, the reward granting means 26 may grant a more advantageous reward when the image of the printed matter newly accepted by the acceptance means 14 does not overlap with the image of the printed matter previously accepted by the acceptance means 14, than when the image of the printed matter newly accepted by the acceptance means 14 overlaps with the image of the printed matter previously accepted by the acceptance means 14. Since printed matter information of the same event may be transmitted by different users, it is preferable from the viewpoint of motivation to grant a more advantageous reward to the user who provides new event information first. Conversely, it may be set so that no reward is granted when the image of the same printed matter is obtained from the same user ID. This overlap determination may be performed by the above-mentioned overlap determination means 24.

[0077] Furthermore, in the program, computer (management server 10), information processing system 1, and information processing method according to the present embodiment, the printed matter information received by the reception means 14 includes specific auxiliary information set by the user along with an image of the printed matter, and the classification means 18 can classify the event information into preset items based on the specific auxiliary information included in the printed matter information received by the reception means 14 in addition to the specific information related to the extracted preset items. In this way, it is possible to upload the image of the printed matter by linking it with specific auxiliary information such as word-of-mouth information. It is also possible to respond to a case where the creator of the printed matter who viewed the website wants to correct the information written on the printed matter.

[0078] In the program, computer (management server 10), information processing system 1, and information processing method according to the present embodiment, as described above, the computer (management server 10) further functions as a reward granting means 26, the printed matter information received by the reception means 14 includes user identification information of the user who transmitted information related to the image of the printed matter to the computer (management server 10), the reward granting means 26 grants a reward to the user corresponding to the user identification information included in the printed matter information when the reception means 14 receives the printed matter information, and when the printed matter information received by the reception means 14 includes specific auxiliary information set by the user, the reward granting means 26 may grant a more advantageous reward than when the printed matter information received by the reception means 14 does not include the specific auxiliary information. This is because information not included in the image of the printed matter, such as word-of-mouth, may be more valuable.

[0079] In the program, computer (management server 10), information processing system 1, and information processing method according to the present embodiment, the computer (management server 10) further functions as a viewing rate calculation means 28, and the reception means 14 receives viewing information when the event information is viewed at the user terminal 40 after the transmission means 20 transmits a display instruction signal to the user terminal 40, and the viewing rate calculation means 28 may calculate a viewing rate, which is the rate at which the event information transmitted to the user terminal 40 by the transmission means 20 is viewed by users at the user terminal 40, based on the number of user terminals 40 to which the transmission means 20 transmits a display instruction signal and the number of viewing information received by the reception means 14. This viewing rate (opening rate) reflects the interests of users regardless of whether they participate or not. Based on the viewing rate, various marketing activities can be developed based on the event information. From the viewpoint of the event organizer, this information is useful for examining whether the low participation rate is due to the format of the flyer, the title of the event, or the date of the event. Comparing with the results of other events helps with these examinations. In addition, local government regional divisions and other relevant parties can learn about users' interests based on the viewing rate (opening rate), which can be useful when considering and implementing administrative projects.

[0080] Furthermore, in the program, computer (management server 10), information processing system 1, and information processing method according to the present embodiment, the transmission means 20 may transmit a display instruction signal to make the event information viewable at a predetermined user terminal 40 based on the view rate calculated by the view rate calculation means 28. As described above, it is possible to create an event heat map for each region from the view rate (open rate), and for example, a display instruction signal can be transmitted to make soccer-related event information viewable only to user terminals 40 in regions (for example, prefectures or municipalities) where the view rate is high and soccer is estimated to be popular. Conversely, in order to increase interest in soccer in regions with low view rates, a display instruction signal can be transmitted to make soccer-related event information viewable only to user terminals 40 in regions with low view rates.

[0081] The program, the computer (management server 10), the information processing system 1, and the information processing method according to the present embodiment are not limited to the above-mentioned aspects, and various modifications can be made.

[0082] For example, the generation AI may be made to recognize the image of the printed matter itself. That is, the generation AI may be made to function as the extraction means 16 and the classification means 18 to classify the event information by item.

[0083] In addition, by digitizing printed materials (flyers) as described above, it becomes possible to provide multilingual support and audio output through translation functions, etc. [Explanation of symbols]

[0084] 1. Information Processing Systems 10 Management Server (Computer) 12 Control section 14. Method of reception 16 Extraction means 18 Classification means 20 Transmission Method 22 Judgment means 24 Duplication determination means 26 Means of awarding benefits 28 Viewing rate calculation method 30 Storage section 32 Communication interface section 40 User terminal 42 Local Government Terminals 44 Web Server 46 Language Model Server 50 Communication Network

Claims

1. A program that causes a computer to function as a receiving means, an extracting means, a classifying means, and a transmitting means, The receiving means receives print information including an image of a print, The extraction means extracts event information from an image of the printed matter in the received printed matter information, The classification means extracts specific information related to a preset item from the extracted event information, and classifies the event information for each preset item based on the extracted specific information; The transmission means is a program that transmits a display instruction signal to the user terminal to cause the user terminal to display the event information classified by items previously set by the classification means, or makes the event information viewable.

2. 2. The program according to claim 1, wherein the classifying means transmits to a language model server a prompt including a question for extracting the specific information related to a preset item from the extracted event information, and, upon receiving from the language model server an answer to the question calculated by the language model server, classifies the event information for each preset item based on the received answer.

3. The program described in claim 1, wherein the user is capable of setting information on the type of event information that the user wishes to view on the user terminal, and the display instruction signal causes the user terminal to display the event information related to the type set by the user.

4. The program of claim 1, wherein the user is capable of setting location information of the event information that the user wishes to view on the user terminal, and the display instruction signal causes the user terminal to display the event information related to the location set by the user.

5. The program of claim 1, wherein the user is capable of setting information on the date and time of the event information that the user wishes to view on the user terminal, and the display instruction signal causes the user terminal to display the event information related to the date and time set by the user.

6. The computer further functions as a determination means, 2. The program according to claim 1, wherein said determining means determines whether or not the image of the printed matter is related to an event based on the extracted event information.

7. 7. The program according to claim 6, wherein the determining means determines whether or not the image of the printed matter is related to an event based on the specific information related to a preset item extracted by the classifying means.

8. The computer is further caused to function as a duplication determination means, 2. The program according to claim 1, wherein the overlap determination means determines whether or not the image of the print newly accepted by the acceptance means overlaps with an image of a print previously accepted by the acceptance means.

9. The program of claim 8, wherein the overlap determination means performs overlap determination based on event information extracted from an image of a printed matter newly received by the reception means and event information extracted from an image of a printed matter previously received by the reception means, or based on specific information regarding predetermined items further extracted from the event information extracted from the image of a printed matter newly received by the reception means and specific information regarding predetermined items further extracted from the event information extracted from an image of a printed matter previously received by the reception means.

10. causing the computer to further function as a reward providing means; the print information received by the reception means includes user identification information of a user who has transmitted information regarding an image of the print to the computer; 2. The program according to claim 1, wherein the bonus giving means, when the accepting means accepts the printed matter information, gives a bonus to a user corresponding to user identification information included in the printed matter information.

11. The program according to claim 10, wherein the bonus granting means grants a more advantageous bonus when the image of the printed matter newly accepted by the acceptance means does not overlap with an image of a printed matter previously accepted by the acceptance means than when the image of the printed matter newly accepted by the acceptance means overlaps with an image of a printed matter previously accepted by the acceptance means.

12. The print information received by the reception means includes specific auxiliary information set by a user together with an image of the print, 2. The program according to claim 1, wherein the classification means classifies the event information into predetermined items based on specific auxiliary information contained in the printed information accepted by the acceptance means in addition to the specific information relating to the extracted predetermined items.

13. causing the computer to further function as a reward providing means; the print information received by the reception means includes user identification information of a user who has transmitted information regarding an image of the print to the computer; When the reception means receives the printed matter information, the reward giving means grants a reward to a user corresponding to user identification information included in the printed matter information; The program according to claim 12, wherein the bonus granting means grants a more advantageous bonus when the printed matter information accepted by the acceptance means includes specific auxiliary information set by a user than when the printed matter information accepted by the acceptance means does not include the specific auxiliary information.

14. The computer is further caused to function as a browsing rate calculation means, the accepting means accepts viewing information when the event information is viewed at the user terminal after the transmitting means transmits the display instruction signal to the user terminal, The program described in claim 1, wherein the viewing rate calculation means calculates a viewing rate, which is the percentage of the event information transmitted to the user terminal by the transmitting means that is viewed by users at the user terminal, based on the number of user terminals to which the transmitting means transmitted the display instruction signal and the number of viewing information received by the receiving means.

15. 15. The program according to claim 14, wherein the transmitting means transmits the display instruction signal to enable the event information to be viewed at a predetermined user terminal based on the viewing rate calculated by the viewing rate calculating means.

16. A computer that functions as a receiving means, an extracting means, a classifying means, and a transmitting means by executing a program, The receiving means receives print information including an image of a print, The extraction means extracts event information from an image of the printed matter in the received printed matter information, The classification means extracts specific information related to a preset item from the extracted event information, and classifies the event information for each preset item based on the extracted specific information; The transmission means transmits a display instruction signal to the user terminal to cause the user terminal to display the event information classified by the items preset by the classification means, or makes the event information viewable.

17. A computer, A user terminal communicatively connected to the computer; Equipped with The computer functions as a receiving unit, an extracting unit, a classifying unit, and a transmitting unit by executing a program; The receiving means receives print information including an image of a print, The extraction means extracts event information from an image of the printed matter in the received printed matter information, The classification means extracts specific information related to a preset item from the extracted event information, and classifies the event information for each preset item based on the extracted specific information; The transmission means transmits a display instruction signal to the user terminal to cause the user terminal to display the event information classified by items pre-set by the classification means, or makes the event information viewable.

18. An information processing method executed by a computer having a control unit, a step of the control unit receiving print information including an image of a print; extracting event information from an image of the printed matter in the received printed matter information by the control unit; a step of the control unit extracting specific information related to a preset item from the extracted event information, and classifying the event information into each preset item based on the extracted specific information; a step of transmitting a display instruction signal to a user terminal by the control unit to cause the user terminal to display the event information classified by preset items, or making the event information viewable; An information processing method comprising:

Citation Information

Patent Citations

  • Method and system for issuing coupon for reward to information provider and recording medium recording coupon issue processing program for reward to information provider

    JP2000268093A

  • Advertising leaflet management system

    JP2002150111A

  • Information processing method, information processor, program and recording medium which records this

    JP2008077250A

  • Advertisement system

    JP2018195026A

  • Information search method, device, facility, storage medium, and program

    JP2021182392A