Information processing apparatus, destination registration method, and computer program

Abstract

To provide a technique capable of shortening time required for registration of baggage information.SOLUTION: The information processing device includes a camera, a processing unit that reads an image of the delivery slip photographed by the camera by optical character recognition and recognizes a destination described in the delivery slip, the destination being a delivery destination of a package to which the delivery slip is attached, and a storage unit that stores information on the destination. The processing unit executes recognition of the address of each delivery slip in parallel with photographing for a plurality of delivery slips photographed continuously, displays a plurality of recognized addresses in a single confirmation screen, and registers an address satisfying a predetermined condition in a storage unit.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing device, a destination registration method, and a computer program. [Background technology]

[0002] In recent years, the spread of internet shopping has led to an increase in demand for logistics services, and an increase in the number of people (hereinafter referred to as "delivery personnel") engaged in delivery work, delivering packages such as merchandise to designated destinations. To assist delivery personnel in delivering packages, there is a known application that stores information about packages that the delivery personnel must deliver that day and provides delivery support functions to the delivery personnel. The package information is hereinafter also referred to as "package information." Various delivery support functions are provided, such as a function that allows the delivery personnel to view package information and a function that provides the delivery personnel with route guidance to the package destination. For example, Non-Patent Document 1 describes an application that has the delivery personnel take a photograph of a package's delivery slip with a camera, reads the image of the delivery slip using optical character recognition (OCR), and stores the address written on the delivery slip as "package information for the package that the delivery personnel must deliver that day," and provides a delivery support function using the package information. [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] "GODOOR Personal Service", [online], Zenrin Datacom Co., Ltd., [Retrieved July 16, 2024], Internet<URL:https: / / www.zenrin-datacom.net / contact / faq / delivery.html> Summary of the Invention [Problem to be solved by the invention]

[0004] Although it depends on the size and nature of the parcels, the delivery person's level of expertise, the size of the area they are responsible for, and other factors, a delivery person generally needs to deliver approximately 70 to 150 parcels per day. For this reason, there is a demand for registering parcel information as quickly as possible. In this regard, the technology described in Non-Patent Document 1 has a problem in that it requires a long waiting time because the delivery person takes a photograph of the delivery slip and then recognizes the addressee using OCR.

[0005] For this reason, there has been a demand for a technology that can reduce the time required to register package information. [Means for solving the problem]

[0006] The present invention has been made to solve at least part of the above-mentioned problems, and can be realized in the following aspects.

[0007] (1) According to one aspect of the present invention, there is provided an information processing device including a camera, a processing unit that reads an image of a delivery slip photographed by the camera using optical character recognition and recognizes addresses written on the delivery slip as destinations for a package to which the delivery slip is attached, and a storage unit that stores information about the addresses, wherein the processing unit recognizes the addresses for each of a plurality of delivery slips photographed successively in parallel with the photographing, displays the recognized addresses on a single confirmation screen, and registers addresses that satisfy predetermined conditions in the storage unit.

[0008] According to this configuration, the processing unit recognizes the destination of each delivery slip while photographing the multiple delivery slips that are photographed consecutively, thereby reducing the user's waiting time for the entire process from photographing to destination recognition compared to when photographing and destination recognition are processed serially. Furthermore, the processing unit displays the multiple recognized destinations on a single confirmation screen, reducing the user's workload compared to when the recognized destinations are displayed one by one on the confirmation screen and the user is required to confirm them one by one. As a result, an information processing device can be provided that can reduce the time required to register package information.

[0009] (2) In the information processing device of the above aspect, the processing unit may display the recognized multiple destinations in a vertical line on the confirmation screen. According to this configuration, the processing unit displays the recognized destinations in a vertical row on the confirmation screen, allowing the user to check the destinations displayed on the confirmation screen at once by scrolling vertically. In other words, according to this configuration, by optimizing the configuration of the confirmation screen for smartphones, which are overwhelmingly the most popular user terminals, it is possible to significantly improve usability for users.

[0010] (3) In the information processing device of the above form, the processing unit may display a registration button for each destination on the confirmation screen, and when a tap on one of the registration buttons is detected, register the destination associated with the registration button in the memory unit, and delete the destination registered in the memory unit from the confirmation screen. According to this configuration, the processing unit displays a registration button for each destination on the confirmation screen, and when a tap on one of the registration buttons is detected, the processing unit registers the destination associated with that registration button in the storage unit. This allows the user to check whether the destination recognition was performed correctly by checking each item against the delivery slip of the package they have on hand. In addition, the processing unit deletes the destination registered in the storage unit from the confirmation screen, so the user can see at a glance how many destinations remain to be confirmed.

[0011] (4) In the information processing device of the above aspect, the processing unit may display a group designation field for grouping the destinations for each destination on the confirmation screen, and when registering the destination in the storage unit, add information about the group designated in the group designation field. According to this configuration, when registering a destination in the storage unit, the processing unit adds information about the group specified in the group specification field. This allows the user to group destinations according to desired criteria. As a result, usability for the user can be improved.

[0012] (5) In the information processing device of the above form, the processing unit may inquire about whether corresponding map data exists for each of the recognized multiple destinations, and if corresponding map data exists, automatically register the destination in the memory unit and display on the confirmation screen the destination in association with a message that the destination has been registered, and if corresponding map data does not exist, display on the confirmation screen the destination in association with a message prompting the user to edit the destination. According to this configuration, if map data corresponding to the recognized destination exists, the processing unit automatically registers the destination in the storage unit, thereby eliminating the need for the user to confirm the destination. Furthermore, if map data corresponding to the recognized destination does not exist, the processing unit displays the destination in association with a message prompting the user to edit the destination on the confirmation screen. A case in which map data corresponding to the recognized destination does not exist refers to a case in which OCR reading is not performed correctly, for example, due to the number 1 (one) being mistakenly recognized as the alphabet I (eye), resulting in an address for which no map data exists (i.e., a non-existent address) being obtained as the destination. In such a case, the processing unit can prompt the user to "manually correct the misrecognition." As a result, according to this configuration, the time required to register package information can be further reduced.

[0013] (6) In the information processing device of the above aspect, the processing unit may display, on the confirmation screen, a map image above the recognized destinations, with pins as markers representing the recognized destinations. According to this configuration, the processing unit displays a map image on the confirmation screen with pins, which are markers representing the multiple recognized destinations, above the multiple recognized destinations, thereby improving usability for users.

[0014] (7) In the information processing device of the above form, the processing unit may display a bulk registration button on the map image of the confirmation screen, and when a tap on the bulk registration button is detected, register all of the destinations corresponding to the pins present on the map image in the memory unit. According to this configuration, the processing unit displays a bulk registration button on the map image on the confirmation screen, and when a tap on the bulk registration button is detected, registers all destinations corresponding to pins on the map image in the storage unit. Therefore, instead of checking the address written in text, the user can check whether the destination recognition was performed correctly by checking the address location (pin location) displayed on the map. It is generally known that the human brain processes information much faster with respect to the speed at which image information is processed than with text information. Therefore, according to this configuration, the time required for the user to check whether the destination recognition was performed correctly can be significantly reduced, and since all destinations can be registered at once, the time required to register package information can be further reduced.

[0015] (8) In the information processing device of the above form, when the processing unit acquires addition or editing of information associated with the destination on the confirmation screen, the processing unit may add the information associated with the destination when registering the destination in the memory unit. According to this configuration, when the processing unit acquires the addition or editing of information associated with a destination on the confirmation screen, the processing unit adds the information associated with the destination when registering the destination in the memory unit, thereby improving convenience for the user.

[0016] The present invention can be realized in various forms, for example, in the form of an information processing device, a destination registration device, a delivery support device, a computer program for realizing the functions of each of these devices and a system including each of these devices, a server device for distributing the computer program, a non-transitory storage medium on which the computer program is stored, etc. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a diagram showing a schematic configuration of a system according to an embodiment of the present invention; [Figure 2] FIG. 10 is a sequence diagram illustrating an example of a processing procedure of a support process. [Figure 3] FIG. 10 is a diagram illustrating an example of a map display screen. [Figure 4] FIG. 10 is a diagram showing an example of a reading screen immediately after startup. [Figure 5] FIG. 10 is a diagram showing an example of a reading screen after photographing one delivery slip. [Figure 6] FIG. 10 is a diagram illustrating an example of a reading result screen. [Figure 7] FIG. 10 is a diagram showing an example of a detailed map screen. [Figure 8] FIG. 10 is a diagram showing an example of a redisplayed reading result screen. [Figure 9] FIG. 10 is a diagram showing an example of a map display screen that is redisplayed. [Figure 10] FIG. 10 is a sequence diagram illustrating an example of a processing procedure of a support process according to the second embodiment. [Figure 11] FIG. 10 is a diagram illustrating an example of a reading result screen according to the second embodiment. [Figure 12] FIG. 11 is a diagram illustrating an example of a reading result screen according to the third embodiment. [Figure 13] FIG. 13 is a diagram showing an example of a reading result screen according to the fourth embodiment. [Figure 14] FIG. 13 is a diagram illustrating an example of a reading result screen according to the fifth embodiment. [Figure 15] FIG. 13 is a diagram illustrating a schematic configuration of a system according to a sixth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0018] A. First embodiment: FIG. 1 is a diagram showing the schematic configuration of system 1 according to one embodiment of the present invention. System 1 is a system in which users are delivery personnel engaged in logistics operations, particularly the task of delivering packages such as merchandise to designated destinations. System 1 accepts registration of information on packages (hereinafter simply referred to as "packages") to be delivered by users. The package information will be referred to as "package information" hereinafter. Furthermore, system 1 provides a delivery support function using the registered package information. In the following explanation, a function that allows users to view package information will be exemplified as the delivery support function. System 1 may also include other functions, such as a function that provides users with route guidance to the package destination.

[0019] The system 1 includes a server 10 and a user terminal 30. The server 10 is connected to the Internet INT by wired communication. The user terminal 30 is connected to the Internet INT by wireless communication via a communication carrier BS. The communication carrier BS includes a transmitting / receiving antenna, a wireless base station, and a switching center. In other words, the server 10 and the user terminal 30 can communicate with each other via the Internet INT.

[0020] The server 10 includes a CPU 110, a communication unit 120, a ROM / RAM 130, and a storage unit 140, and each unit is connected to one another by a bus (not shown).

[0021] The CPU 110 controls each part of the server 10 by loading a computer program stored in the ROM 130 into the RAM 130 and executing it. The CPU 110 also functions as a control unit 111. The control unit 111 cooperates with the user terminal 30 to execute the assistance processing described below. In the assistance processing, the control unit 111 authenticates the user terminal 30, checks whether map data corresponding to the recognized destination exists, and provides a map image to the user terminal 30. Details will be described later.

[0022] The communication unit 120 controls communication with other devices such as the user terminal 30 via a communication interface (not shown).

[0023] The storage unit 140 is composed of a hard disk, a flash memory, a memory card, etc. A map information database 142 and a building information database 143 are pre-stored in the storage unit 140. In the following description, the databases will also be simply referred to as "DBs." The map information DB 142 is a database that stores data representing map images. The data representing the map images includes information necessary for map display, such as the shape of topography, buildings, and roads. The building information DB 143 is a database that stores information about buildings (hereinafter also referred to as "building information"). The building information may include the name of the building, information representing the building's nameplate, the address (and / or latitude and longitude) of the building's location, information about the number of floors the building has, information about whether the building has a delivery box, etc.

[0024] The user terminal 30 can be configured as any device, such as a smartphone as shown in the figure, a personal computer, an in-vehicle device, a wearable device, etc. The user terminal 30 includes a CPU 310, a communication unit 320, a ROM / RAM 330, a storage unit 340, an input / output unit 350, and a current position acquisition unit 360, and each unit is interconnected by a bus (not shown). The user terminal 30 corresponds to an "information processing device."

[0025] The CPU 310 controls each unit of the user terminal 30 by loading a computer program stored in the ROM 330 into the RAM 330 and executing it, and also functions as a processing unit 311. The processing unit 311 executes the support processing described below in cooperation with the server 10. The communication unit 320 controls communication with other devices such as the server 10 via a communication interface (not shown).

[0026] The storage unit 340 is composed of a hard disk, a flash memory, a memory card, etc. The storage unit 340 corresponds to the "storage unit." The storage unit 340 stores package information 341 by a support process described later. The package information 341 is information about packages to be delivered by a user (package information). Here, the package information in this embodiment includes, for example, the following a1 to a10. (a1) Postal code: Indicates the postal code of the delivery destination. (a2) Address: Indicates the address of the delivery destination. (a3) Name: Indicates the name of the delivery recipient. (a4) Telephone number: Indicates the telephone number of the recipient of the package. (a5) Time zone specification: This indicates the specified delivery time zone for each package. (a6) Availability of delivery box: Indicates whether or not a delivery box designated for each package can be used. (a7) Nameplate information / building / tenant information: Either information indicating the nameplate of the delivery destination (for example, "Yamada" for a non-apartment building, or "101 Yamada" for an apartment building), or information indicating the building name and tenant name where the delivery destination is located (for example, "XYZ Building"). (a8) Remarks: Indicates important points to note regarding delivery. (a9) Size information: Indicates the size of the package (small, medium, large, extra large, etc.) and the number of packages. (a10) Drop-off information: This may include whether drop-off is possible, the location of drop-off, and the conditions for drop-off (date, time, weather, etc.).

[0027] Of the information a1 to a10, information a1, a2, and a3 are also collectively referred to as "destination information." In other words, "destination" is information that indicates the address and name of the delivery destination. Information a4 to a10 are also collectively referred to as "accompanying information." In other words, "accompanying information" is information that is associated with the destination and is information used for delivering the package. For this reason, in this embodiment, "registering package information" includes the meaning of "registering destination information" and "registering accompanying information."

[0028] Note that the associated information a4 to a10 are merely examples, and some of the information may be omitted or replaced. Further associated information not described above may also be employed. For example, a "delivery date" may be included as associated information. The delivery date refers to the date on which the user intends to perform the delivery work for the package. If the delivery date is included as associated information, it becomes possible to accumulate past history without erasing the registered contents of package information 341 for each work day. In the following examples, for the sake of simplicity, an operation will be described in which the delivery date is not included as associated information, and the registered contents of package information 341 are erased for each work day (in other words, an operation in which all packages stored in package information 341 are to be delivered on the same day).

[0029] The input / output unit 350 is a variety of interfaces used for inputting and outputting information between the user terminal 30 and the user. The input unit of the input / output unit 350 includes a camera and a touch panel. The display unit (output unit) of the input / output unit 350 can be a touch panel, a liquid crystal panel, or the like. The current location acquisition unit 360 receives radio waves transmitted from artificial satellites constituting the GPS (Global Positioning System) or QZSS (Quasi-Zenith Satellite System) and acquires current location information (latitude and longitude) indicating the current location of the user terminal 30. Here, since the user carries the user terminal 30, the current location acquired by the current location acquisition unit 360 can be considered the same as the user's current location.

[0030] FIG. 2 is a sequence diagram showing an example of the processing procedure of the support process. In FIG. 2, the components of the user terminal 30 are enclosed in a dashed frame, and the user terminal 30 is simply referred to as "terminal 30." The support process of this embodiment is a process that accepts registration of package information a1 to a10 (particularly destination information a1 to a3) and realizes a delivery support function using the package information a1 to a10. The support process can be executed at any timing. In the example of FIG. 2, the support process is executed in response to the start of a predetermined application installed on the user terminal 30. Note that in FIG. 2, for convenience of illustration, the delivery slip is simply referred to as "slip."

[0031] In step S10, when a specific application is launched, the processing unit 311 of the user terminal 30 transmits a user ID to the server 10. The user ID is a unique ID assigned to distinguish each user. In step S12, the control unit 111 of the server 10 executes authentication processing using the user ID. Specifically, the control unit 111 refers to the qualification information pre-stored in the communication unit 120 and determines whether the received user ID is qualified to use the system 1. In step S14, the control unit 111 transmits the authentication result to the user terminal 30. If the authentication result is NG, the processing unit 311 of the user terminal 30 terminates the processing.

[0032] If the authentication result in step S14 is permitted (OK), the processing unit 311 of the user terminal 30 transitions the process to step S20. In step S20, the processing unit 311 of the user terminal 30 causes the map display screen W1 to be displayed on the input / output unit 350. Note that, in order to display the map display screen W1, information (a series of data used for screen display and map data) may be transmitted and received between the user terminal 30 and the server 10 between steps S14 and S20.

[0033] Fig. 3 is a diagram showing an example of a map display screen W1. The map display screen W1 is a screen that is initially displayed on the user terminal 30 in step S20 of Fig. 2. The map display screen W1 includes a map, a current location symbol PL, buttons B1 to B7, and a button B11. The center position and scale of the map displayed on the map display screen W1 can be determined arbitrarily.

[0034] Button B1 is a button for transitioning to a settings screen. On the settings screen, the user can check and change their personal settings, as well as general settings for the application (such as various initial values). Button B2 is a button that displays the total number of packages that the user needs to deliver that day. The total number of packages displayed on button B2 is equal to the number of package information for that day registered in package information 341. In the example of Figure 3, package information has not yet been registered in package information 341, so the total number of packages on button B2 is 0. Tapping button B2 may transition to a package list screen that displays a list of all package information for the packages that the user needs to deliver that day.

[0035] The button B11 is a button for starting the registration of package information. By tapping the button B11, the processing of steps S22 to S54 of the support processing (FIG. 2) is executed. The buttons B3 to B7 on the map display screen W1 will be described later.

[0036] In step S22 of FIG. 2, the processing unit 311 of the user terminal 30 determines whether a trigger to start reading the delivery slip has been established. In this embodiment, the start trigger is the detection of a tap on button B11 on the map display screen W1. If the start trigger has not been established, the processing unit 311 continues to display the map display screen W1. If the start trigger has been established, the processing unit 311 transitions the processing to step S24. In step S24, the processing unit 311 of the user terminal 30 activates the camera on the back of the user terminal 30 and displays the reading screen W2 on the input / output unit 350.

[0037] Fig. 4 is a diagram showing an example of the reading screen W2 immediately after startup. Fig. 5 is a diagram showing an example of the reading screen W2 after a delivery slip has been photographed. The reading screen W2 includes a subject area PA, a shutter button B20, a history button B21, and a number button B22.

[0038] The subject area PA is an area that displays the image obtained by the camera activated in step S24. As shown in the figure, the subject area PA includes a rectangular frame BO1 and a selection field BO2 for selecting a time period (information a5). In the example of FIG. 4, the frame BO1 has an aspect ratio that can accommodate the "Delivery Address" field on a delivery slip, and is sized so that its horizontal dimension is close to the edge of the subject area PA. The selection field BO2 is located between the frame BO1 and the button B20. The selection field BO2 includes buttons that fit into a general time period designation framework (none, morning, 12-2 PM, 2-4 PM, 4-6 PM, 6-8 PM, 7-9 PM, and 8-9 PM). Note that the time period designation framework displayed in the selection field BO2 may be changeable by the user.

[0039] The shutter button B20 is a button for capturing an image within the subject area PA. The history button B21 is a button for checking the previously captured image and enabling re-capture. Immediately after the reading screen W2 is launched (i.e., before an image is captured), the history button B21 displays only a frame as shown in FIG. 4. The number button B22 is a button that displays the total number of delivery slip images that have been captured. Immediately after the reading screen W2 is launched (i.e., before an image is captured), the number button B22 displays 0 as shown in FIG. 4.

[0040] In step S30 of FIG. 2, the user photographs a delivery slip. Specifically, as shown in FIG. 4, the user adjusts the "Delivery Address" field on the delivery slip attached to a package so that it fits entirely within frame BO1, then selects one option from selection field BO2 based on the time period listed on the delivery slip, and taps the shutter button B20. In the example of FIG. 4, "Morning" is selected in selection field BO2. By tapping the shutter button B20, processing unit 311 acquires an image of subject area PA. Processing unit 311 performs the following processes b1 to b6 on the acquired image. Processes b1 to b4 correspond to "destination recognition." Either process b5 or process b6 may be omitted. (b1) Of the acquired image, the area within the frame BO1 is read using optical character recognition (OCR). (b2) The recognition result of the postal code written in the delivery address column of the delivery slip is obtained as the postal code (information a1). (b3) The recognition result of the address written in the delivery address field of the delivery slip is obtained as the address (information a2). (b4) The recognition result of the name written in the delivery address column of the delivery slip is obtained as the name (information a3). (b5) The recognition result of the telephone number written in the delivery address column of the delivery slip is obtained as the telephone number (information a4). (b6) Of the acquired image, the contents of the selection field BO2 are read using OCR, and the selection content in the selection field BO2 is acquired as the time period designation (information a5).

[0041] 2, the processing unit 311 of the user terminal 30 confirms with the server 10 whether the recognized address exists. Specifically, the processing unit 311 transmits a request for confirming the existence of an address and the address obtained in process b3 to the server 10. In step S34, the control unit 111 of the server 10 searches the map information DB 142 using the address received in step S32, and responds with the search result (matched / not matched) to the user terminal 30. Note that in steps S32 and S34, the existence confirmation may be performed not only on the address but also on the postal code obtained in process b2.

[0042] After photographing one delivery slip (in other words, after tapping the shutter button B20 in FIG. 4), the reading screen W2 continues to be displayed on the input / output unit 350. As shown in FIG. 5, the user similarly aligns the delivery slip with the frame BO1 for the delivery slip attached to the next package, taps the selection field BO2, and then taps the shutter button B20. As a result, steps S32 and S34 in FIG. 2 are similarly executed for the address (information a2) obtained from the next delivery slip. Also, the number displayed in the quantity button B22 is incremented (+1). Note that, as shown in FIG. 5, a reduced image of the delivery slip photographed one time is displayed in the frame of the history button B21. By tapping the history button B21, the user can check the image of the delivery slip photographed one time previously and re-photograph the delivery slip photographed one time previously. When the delivery slip is photographed again, the processing unit 311 performs the processes b1 to b6 and the user terminal 30 and the server 10 perform steps S32 and S34 again on the rephotographed image.

[0043] The user repeats the operation of photographing the delivery slip for all packages for which the user intends to register package information. As a result, step S1 of FIG. 2 (specifically, steps S30 to S34) is executed for all packages for which the user intends to register package information. Here, the user's operation of photographing the delivery slip, processes b1 to b6 by the processing unit 311, and steps S32 and S34 by the user terminal 30 and server 10 are all processed in parallel (parallel processing). In other words, while the user is photographing the delivery slip, processes b1 to b6 and steps S32 and S34 are being executed in the background. Note that it is sufficient for the processing unit 311 to process at least the user's operation of photographing the delivery slip and processes b1 to b6 by the processing unit 311 in parallel, and steps S32 and S34 may be executed for all packages at once, for example, after an end trigger is established (after step S40).

[0044] In step S40 of FIG. 2, the processing unit 311 of the user terminal 30 determines whether a trigger to end the reading of the delivery slip has been established. In this embodiment, the end trigger is the detection of a tap on the number button B22 on the reading screen W2. If the end trigger has not been established, the processing unit 311 continues to display the reading screen W2. If the end trigger has been established, the processing unit 311 transitions the processing to step S42. In step S42, the processing unit 311 of the user terminal 30 stops the camera and causes the input / output unit 350 to display the reading result screen W3.

[0045] FIG. 6 is a diagram showing an example of the reading result screen W3. The reading result screen W3 includes a header H1 and confirmation fields D1 to D3 arranged in a vertical row below the header H1. The reading result screen W3 corresponds to a "confirmation screen." The header H1 displays "5 unregistered items / total 5 items." This means that the total number of delivery slips for which step S1 in FIG. 2 was executed is 5, and 5 of those have not been registered.

[0046] The confirmation field D1 includes an information display RR1, a registration button B130, and buttons B131, B132, and B133. Similarly, the confirmation field D2 includes an information display RR2, a registration button B230, and buttons B231, B232, and B233. The confirmation field D3 includes an information display RR3, a registration button B330, and buttons B331, B332, and B333. In the illustrated example, only confirmation fields D1 to D3 are displayed, but the confirmation fields are displayed in a vertical row for the number of delivery slips for which step S1 in FIG. 2 was executed. That is, in the example of header H1, since the number of delivery slips for which step S1 was executed is 5, the confirmation fields on the reading result screen W3 include D1 to D5. Furthermore, for example, if the number of delivery slips for which step S1 was executed is 100, the confirmation fields on the reading result screen W3 include D1 to D100. Users can quickly view all confirmation fields by scrolling the screen vertically in the DD direction.

[0047] The confirmation fields will be described below, with an example of confirmation field D1. Information display RR1 displays information acquired for one delivery slip through processes b1 to b6. Information display RR1 shown in FIG. 6 has a "Nameplate" field and a "Memo" field, which do not appear in processes b1 to b6. The nameplate field displays the contents of the nameplate information / building / tenant information (information a7) of the package information. The memo field displays the contents of the remarks information (information a8) of the package information. The nameplate field and memo field are blank in the initial state, as shown in information display RR1. Note that the nameplate field and memo field may be omitted. Furthermore, in addition to the nameplate field and memo field, information display RR1 may include display fields for various additional information, as exemplified for package information. The display of these additional information fields on information display RR1 may be switched on / off.

[0048] The registration button B130 is a button for registering the content displayed in the information display RR1 in the package information 341 upon detection of a tap (in other words, for executing step S50 in FIG. 2). The button B131 is a button for displaying a detailed map screen W4, which will be described later. The button B132 is a button for enabling editing of the content displayed in the information display RR1 upon detection of a tap. When the button B132 is tapped, the processing unit 311 enables editing of the text representing the destination information (postal code, address, name) and the text representing the associated information (telephone number, time zone designation, nameplate, memo, and other associated information) displayed in the information display RR1. The confirmation field D3 in FIG. 6 illustrates an example of the information display RR3 after the nameplate field and memo field have been edited. The button B133 is a button for deleting the content displayed in the information display RR1 upon detection of a tap (discarding the content without registering it in the package information 341).

[0049] In the example of FIG. 6, the postal code and address in the information display RR2 in the confirmation field D2 are surrounded by a box BO3. The bottom of the box BO3 displays the message "This address cannot be registered." The box BO3 is added to data for which the server 10 responds "Not Matched" as a result of the address existence check for the delivery slip (FIG. 2: steps S32 and S34). By using this box BO3, the user can easily recognize that an address not assigned a box BO3 is an address that exists in the map information DB 142. Furthermore, by using the box BO3, the user can easily recognize that an address assigned a box BO3 is an address that does not exist in the map information DB 142. In other words, on the read result screen W3, the box BO3 is added to data for which the response of "Not Matched" as a result of the address existence check, thereby prompting the user to confirm and edit the destination information (postal code, address) in the information display RR2.

[0050] 7 is a diagram showing an example of a detailed map screen W4. The detailed map screen W4 is a screen that is displayed on the input / output unit 350 when the button B131 on the reading result screen W3 is tapped. The detailed map screen W4 includes a map W41 and information W42. Hereinafter, the address that is displayed on the information display RR1 when the button B131 on the reading result screen W3 is tapped will also be referred to as the "selected address."

[0051] The map W41 is a narrow-area map centered on the selected address and displaying the vicinity of the selected address. A pin P1 is superimposed on the map W41 at the location of the selected address. Text representing the selected address is displayed in the upper section of the information W42. The contents of the information display RR1 are displayed in the lower section of the information W42. Here, icons indicating package size information (information a9), drop-off delivery information (information a10), and whether or not a delivery box can be used (information a6) are displayed if they have been edited in the information display RR1 of the read result screen W3. In the illustrated example, only the package size information (information a9) is displayed, and the drop-off delivery information (information a10) and whether or not a delivery box can be used (information a6) are displayed with dashed lines, i.e., are not yet set. These icons may be omitted.

[0052] The map W41 on the detailed map screen W4 may be used for confirmation purposes to check the map of the address (i.e., the selected address) displayed in the information display RR1 on the read result screen W3. On the other hand, the map W41 on the detailed map screen W4 may be used for editing purposes to edit the address displayed in the information display RR1 on the read result screen W3. When used for editing, the detailed map screen W4 may be configured as follows, for example. First, the user presses and holds an arbitrary position on the map W41 where the user wishes to change the position of the pin P1 (i.e., the new position of the pin P1). The position of the pin P1 is then changed to the position pressed and held on the map W41. The position of the pin P1 may also be changed by sliding the displayed position of the pin P1. The text representing the selected address displayed in the upper section of the information W42 is then changed to the address corresponding to the new position of the pin P1. The lower section of the information W42 remains unchanged. In this state, the user taps the cross button in the upper right corner of the map W41. Then, the screen transitions to the read result screen W3, and on the read result screen W3 after the transition, the destination information (postal code, address) in the information display RR1 becomes the changed address corresponding to the upper part of the information W42.

[0053] As shown in the figure, a button B102 may be provided below the text representing the selected address to set whether or not the building has a delivery box. When button B102 is set to "Yes," processing unit 311 of user terminal 30 may update information in building information DB 143 of server 10 as to whether or not the building has a delivery box.

[0054] In step S50 of FIG. 2, the processing unit 311 of the user terminal 30 detects that a registration operation has been performed. Specifically, the processing unit 311 detects that one of the registration buttons B130, B230, or B330 on the reading result screen W3 has been tapped. In step S52, the processing unit 311 of the user terminal 30 stores the data for which the registration operation has been performed in the package information 341. For example, when detecting a tap on the registration button B130 in FIG. 6, the processing unit 311 stores the contents of the information display RR1 in the package information 341. In step S54, the processing unit 311 of the user terminal 30 updates the reading result screen W3 and redisplays it on the input / output unit 350.

[0055] FIG. 8 shows an example of the redisplayed reading result screen W3. As shown in the figure, the header H1 on the updated reading result screen W3 has been changed to "4 unregistered items out of a total of 5 items." Furthermore, the confirmation field D1 corresponding to the data for which registration was performed is hidden. The user checks the information display RRx for all confirmation fields Dx (where x represents any natural number; the same applies hereinafter) displayed on the reading result screen W3, edits the content as necessary, and then taps the registration button Bx30. If there are multiple confirmation fields for a single delivery slip, the user can delete one by tapping button Bx33. As a result, step S2 (specifically, steps S50 to S54) in FIG. 2 is executed for all packages for which the user intends to register package information. When the number of unregistered items becomes zero, the processing unit 311 of the user terminal 30 automatically closes the reading result screen W3.

[0056] After the reading result screen W3 is terminated, in step S60 of Fig. 2, the processing unit 311 of the user terminal 30 acquires all package information from the package information 341. In step S62, the processing unit 311 of the user terminal 30 re-displays the map display screen W1 using the acquired package information.

[0057] FIG. 9 is a diagram showing an example of the redisplayed map display screen W1. On the redisplayed map display screen W1, pins P1 to P4 are superimposed on the map. The pins P1 to P4 are markers plotted on the map at locations corresponding to the delivery destinations of packages, and are also called "delivery destination pins." Each pin may be displayed in a different color depending on the time period specified in the package information (information a5). Each pin may have text inside it indicating the package status of the package information. If the accompanying information does not include the package status, the text inside the pin can be omitted. When multiple destinations exist within a single apartment building, as in the case of pin P1, the pins are unified and badges corresponding to the number of destinations are assigned. The total number of packages in button B2 is five, which is the number of package information items registered through the processing in FIG. 2. Note that, for simplicity's sake, five package information items have been described in the above example. However, since users typically need to deliver approximately 70 to 150 packages per day, the number of package information items may reach approximately 70 to 150.

[0058] Button B3 is a button for changing the map scale so that all packages to be delivered that day fit on one screen. For example, if button B2 displays "150" as the total number of packages, tapping button B3 will display a wide-area map on the map display screen W1 with pins for those 150 packages on one screen. Button B4 is a button for narrowing down (filtering) the pins to be displayed. Tapping button B4 launches a window for specifying filter conditions. For example, a time period (information a5) can be used as a filter condition. After setting the filter conditions, the user taps the OK button on the window. As a result, only the pins narrowed down by the specified conditions are displayed on the map display screen W1. Button B5 is a button for switching between displaying and hiding pins on the map. Button B6 is a button for changing the center position of the map so that the current location symbol PL is at the center of the map. The button B7 is a button for enlarging (when tapping +) or reducing (when tapping -) the scale of the map on the map display screen W1.

[0059] As described above, according to the user terminal 30 of the first embodiment, the processing unit 311 recognizes the destination of each delivery slip while photographing the delivery slips that have been photographed consecutively (FIG. 2: step S30). This reduces the user's waiting time for the entire process from photographing to destination recognition, compared to when photographing and destination recognition are performed serially. Furthermore, the processing unit 311 displays the recognized destinations on a single confirmation screen (read result screen W3), thereby reducing the user's workload compared to when the recognized destinations are displayed one by one on the confirmation screen and the user is required to confirm them one by one. As a result, a user terminal 30 can be provided that can reduce the time required to register package information.

[0060] Furthermore, according to the user terminal 30 of the first embodiment, the processing unit 311 displays the recognized multiple destinations RR1 to RRx in a vertical row on the reading result screen W3. This allows the user to check the multiple destinations RR1 to RRx displayed on the reading result screen W3 at once by vertically scrolling. In other words, by optimizing the configuration of the reading result screen W3 for smartphones, which are overwhelmingly popular as user terminals 30, usability for users can be significantly improved.

[0061] Furthermore, according to the user terminal 30 of the first embodiment, the processing unit 311 displays registration buttons B130 to Bx30 for each of the destinations RR1 to RRx on the reading result screen W3, and when a tap on one of the registration buttons B130 is detected, the processing unit 311 registers the destination RR1 associated with the registration button B130 in the package information 341 in the storage unit 340. This allows the user to check whether the destination recognition has been performed correctly by checking each of the delivery slips of the packages at hand. In addition, the processing unit 311 deletes the destination RR1 registered in the storage unit 340 from the redisplayed reading result screen W3 (FIG. 8), so the user can grasp at a glance "how many more destinations need to be confirmed."

[0062] Furthermore, according to the user terminal 30 of the first embodiment, when the processing unit 311 acquires addition or editing of accompanying information (telephone number, time zone designation, nameplate, memo, and other accompanying information) associated with the destination on the reading result screen W3, the processing unit 311 adds the information associated with the destination when registering the destination in the package information 341 in the memory unit 340, thereby improving convenience for the user.

[0063] B. Second embodiment: FIG. 10 is a sequence diagram showing an example of the processing procedure of the support processing of the second embodiment. FIG. 11 is a diagram showing an example of the reading result screen W3A of the second embodiment. In the second embodiment, an example of automatic registration of package information will be described. The system 1A of the second embodiment has a user terminal 30A instead of the user terminal 30 in the configuration described in the first embodiment. The user terminal 30A has a processing unit 311A ​​instead of the processing unit 311. The processing unit 311A ​​executes the support processing shown in FIG. 10.

[0064] The support process shown in Figure 10 differs from Figure 2 in that step S70 is executed after step S34, and in that step S42A is executed instead of step S42. In step S70, if the server 10 responds that there is a match as a result of confirming the existence of an address on the delivery slip (steps S32, S34), the processing unit 311A ​​automatically saves the information obtained from the delivery slip as a result of processes b1 to b6 in the package information 341. On the other hand, if the server 10 responds that there is no match, the information is not automatically saved in the package information 341.

[0065] In step S42A, the processing unit 311A ​​displays the reading result screen W3A shown in FIG. 11 on the input / output unit 350. The reading result screen W3A differs from FIG. 6 in that a gray layer is superimposed on the information display RR1 in the confirmation field D1A, and an icon indicating "Registered" is added. Furthermore, the confirmation field D1A includes an Edit button B130A instead of the Register button B130. The gray layer and the Registered icon in the confirmation field D1A indicate that the information displayed in the information display RR1 was automatically registered in the package information 341 in step S70 of FIG. 10. The gray layer and the Registered icon indicate that the destination has been registered. Either the gray layer or the Registered icon may be omitted. When the user taps the Edit button B130A, the gray layer and the Registered icon disappear, and the contents of the information display RR1 become editable (i.e., the display of the confirmation field D1A becomes the same as that of the confirmation field D1 in FIG. 6). These points also apply to the confirmation field D3A.

[0066] Meanwhile, the confirmation field D2 does not display a gray layer or a registered icon, and only displays the registration button B230. This is because the server 10 responded "not found" as a result of the address existence check on the delivery slip (steps S32, S34), so automatic saving to the package information 341 was not performed. The box BO3 in the confirmation field D2 and the display of "This address cannot be registered" correspond to a "message prompting editing of the destination." Either the box BO3 or the display of "This address cannot be registered" may be omitted. Note that the header H1A displays "1 item / total of 5 items" as unregistered.

[0067] In this way, the processing unit 311A ​​of the user terminal 30A may automatically register the destinations RR1 and RR3 in the storage unit 340 depending on the result of confirming the existence of an address on the delivery slip. The user terminal 30A of the second embodiment can also achieve the same effects as those of the first embodiment described above.

[0068] Furthermore, according to the user terminal 30A of the second embodiment, if map data corresponding to the recognized destination exists in the map information DB 142, the processing unit 311A ​​automatically registers the destination in the storage unit 340 (FIG. 10: step S70). This eliminates the need for the user to perform confirmation. Furthermore, if map data corresponding to the recognized destination does not exist in the map information DB 142, the processing unit 311A ​​displays the destination RR2 in association with a message prompting the user to edit the destination on the read result screen W3A (confirmation screen). A case in which map data corresponding to the recognized destination RR2 does not exist refers to, for example, a case in which OCR reading is not performed correctly due to a mistaken recognition of the number 1 (one) as the alphabet I (eye), resulting in an address for which no map data exists (i.e., a non-existent address) being obtained as the destination RR2. In such a case, the processing unit 311A ​​can prompt the user to "manually correct the misrecognition." As a result, the user terminal 30A can further reduce the time required to register package information.

[0069] C. Third embodiment: 12 is a diagram showing an example of a reading result screen W3B of the third embodiment. In the third embodiment, an example in which package information (destination information) can be grouped will be described. The system 1B of the third embodiment includes a user terminal 30B instead of the user terminal 30 in the configuration described in the first embodiment.

[0070] In step S42 of FIG. 2, the processing unit 311 of the user terminal 30B displays the reading result screen W3B on the input / output unit 350. The reading result screen W3B differs from FIG. 6 in that group designation fields B135 to B335 are displayed next to each of the confirmation fields D1 to D3. The group designation fields B135 to B335 are checkboxes with options 1, 2, and 3, and are initially unchecked. For example, as shown in FIG. 12, the user checks "1" in the group designation field B135 and taps the register button B130. Then, when the processing unit 311 of the user terminal 30B stores the contents of the information display RR1 in the package information 341 (FIG. 2: step S52), it adds information indicating that the data belongs to group 1. The same applies to the group designation fields B235 and B335. That is, in the example of this embodiment, data with the same number checked in the group designation fields B135 to B335 is linked to the same group in the package information 341.

[0071] Note that the specific means for specifying a group is not limited to a check box, and any method may be employed. For example, a subwindow may be launched by long-pressing the confirmation field D1, and a group may be input in the subwindow. In this case, the subwindow corresponds to the group specification field. For example, a group identifier may be input as associated information in the information display RR1. In this case, the associated information item in the information display RR1 corresponds to the group specification field. Also, in FIG. 12, the numbers 1, 2, and 3 are given as examples of group identifiers. However, the group identifier is not limited to numbers, and a character string, icon, or the like arbitrarily set by the user may be used as the group identifier.

[0072] In this way, the processing unit 311 of the user terminal 30B may configure the reading result screen W3B to enable grouping of package information (destination information). The user terminal 30B of this third embodiment can also achieve the same effects as the first embodiment described above. Furthermore, according to the user terminal 30B of the third embodiment, the processing unit 311 adds information about the group specified in the group specification fields B135 to B335 when registering the destinations RR1 to RR3 in the package information 341. This allows the user to group the destinations RR1 to RR3 according to desired criteria. As a result, the packages can be grouped according to criteria such as the temperature range, size, or shipper of the package, improving usability for the user. In the example of this embodiment, the filter conditions displayed by tapping the button B4 on the map display screen W1 may include group specification.

[0073] D. Fourth embodiment: 13 is a diagram showing an example of a reading result screen W3C of the fourth embodiment. In the fourth embodiment, an example will be described in which the reading result screen W3C includes a map pin image DC. The system 1C of the fourth embodiment includes a user terminal 30C instead of the user terminal 30 in the configuration described in the first embodiment.

[0074] 2, the processing unit 311 of the user terminal 30C causes the input / output unit 350 to display the reading result screen W3C. The reading result screen W3C differs from that of FIG. 6 in that it includes a map pin image DC between the header H1 and the confirmation field D1. For ease of explanation, the arrangement of the pins Pa to Pe in the map pin image DC of FIG. 13 differs from the arrangement of the pins P1 to P4 on the map display screen W1 of FIG. 9.

[0075] The map pin image DC is an image in which pins Pa to Pe and a map are superimposed. Pin Pa is a landmark plotted at a position corresponding to the destination information (postal code, address) of information display RR1. Similarly, pins Pb to Pd are landmarks plotted at positions corresponding to the destination information of information displays RR3 to RRx. On the other hand, pin Pe corresponds to the destination information of information display RR2. Here, the destination information of information display RR2 is an address that does not exist in the map information DB 142, so the processing unit 311 cannot place pin Pe on the map. For this reason, the processing unit 311 displays pin Pe at a position in one of the four corners of the map where it does not overlap with other pins, in a manner that makes it distinguishable from the other pins. In the illustrated example, pin Pe is placed in a gray rectangular frame at the top right corner of the map, and the character "?" is added inside pin Pe. Note that the display of pin Pe may be omitted.

[0076] The processing unit 311 may use the map pin image DC for confirmation purposes, to check maps of addresses represented by the information displays RR1 to RRx on the reading result screen W3C, or for editing purposes, to edit maps of addresses represented by the information displays RR1 to RRx. When using the map pin image DC for editing purposes, the user changes the position of the pin Pe by long-pressing an arbitrary position on the map pin image DC where the user wishes to change the position of the pin Pe (i.e., the position of the new pin Pe). Then, the destination information (postal code, address) displayed on the information display RR2 is changed to an address corresponding to the position of the pin Pe after the change. Details are the same as those described in FIG. 7. In this way, the user can easily and intuitively edit the destinations of the information displays RR1 to RRx by using the map image.

[0077] On the reading result screen W3C, for example, when the registration button B130 is tapped and the content of the information display RR1 is registered in the baggage information 341, the processing unit 311 may delete the corresponding pin Pa from the map pin image DC. Alternatively, the processing unit 311 may change the display mode of the pin Pa without deleting the corresponding pin Pa from the map pin image DC. To change the display mode, various methods can be used, such as changing the transparency, changing the color, or adding an arbitrary marker. Note that, as shown in FIG. 13, the pins Pa to Pe may or may not be color-coded according to the content of the time period specified for the information displays RR1 to RRx.

[0078] In this way, the reading result screen W3C may include a map pin image DC. The user terminal 30C of the fourth embodiment can also achieve the same effects as those of the first embodiment. Furthermore, according to the user terminal 30C of the fourth embodiment, the processing unit 311 displays the map pin image DC with pins attached as markers representing the multiple recognized destinations above the multiple recognized destinations RR1 to RRx on the reading result screen W3C (confirmation screen), thereby improving usability for the user.

[0079] E. Fifth embodiment: 14 is a diagram showing an example of a reading result screen W3D of the fifth embodiment. In the fifth embodiment, an example in which bulk registration of package information is possible will be described. The system 1D of the fifth embodiment has a user terminal 30D instead of the user terminal 30C in the configuration described in the fourth embodiment.

[0080] In step S42 of FIG. 2, the processing unit 311 of the user terminal 30D displays the reading result screen W3D on the input / output unit 350. The reading result screen W3D has the same configuration as the reading result screen W3C described in FIG. 13, except that it includes a bulk registration button B140. When detecting a tap on the bulk registration button B140, the processing unit 311 of the user terminal 30D collectively stores the contents of all information displays RR1, RR3 to RRx corresponding to pins Pa to Pd present on the map of the map pin image DC in the baggage information 341. Here, the pin Pe is located within a gray-filled rectangular frame in the map pin image DC and is not located on the map. Therefore, the processing unit 311 does not register the information display RR2 corresponding to the pin Pe in the baggage information 341. Note that when the bulk registration button B140 is tapped while a pin Pe that cannot be plotted on the map is included, the processing unit 311 may display an error message prompting the user to edit the information display RR2 corresponding to the pin Pe.

[0081] In this way, the reading result screen W3D may include a bulk registration button B140. The user terminal 30D of this fifth embodiment can also achieve the same effects as those of the first and fourth embodiments described above. Note that the buttons B130 to Bx30 for individual registration may be omitted from the reading result screen W3D.

[0082] Furthermore, according to the user terminal 30D of the fifth embodiment, the processing unit 311 displays a batch registration button B140 on the map image of the read result screen W3D (confirmation screen), and when a tap on the batch registration button B140 is detected, registers all destinations RR1, RR3 to RRx corresponding to pins Pa to Pd present on the map image in the storage unit 340. Therefore, instead of checking the address written in text, the user can check whether the destination recognition has been performed correctly by checking the address position (the position of pins Pa to Pd) displayed on the map. It is generally known that the human brain processes information much faster than text information. Therefore, according to the read result screen W3D of the fifth embodiment, the time required for the user to check whether the destination recognition has been performed correctly can be significantly reduced, and all destinations RR1, RR3 to RRx can be registered collectively, thereby further reducing the time required to register package information.

[0083] F. Sixth embodiment: 15 is a diagram showing a schematic configuration of a system 1E of the sixth embodiment. The system 1E of the sixth embodiment includes a user terminal 30E instead of the user terminal 30, and does not include a server 10. The user terminal 30E of the sixth embodiment executes the support process without cooperating with the server 10.

[0084] The CPU 310E of the user terminal 30E is equipped with a processing unit 311E instead of the processing unit 311. The memory unit 340E of the user terminal 30E further stores a map information DB 342. The map information DB 342 is similar to the map information DB 142 described in the first embodiment. In this embodiment, the part described as "map information DB 142 of the server 10" in FIG. 2 can be read as "map information DB 342 of the user terminal 30E."

[0085] As described above, the configuration of the system 1E can be modified in various ways, and the processing unit 311E of the user terminal 30E may execute the assistance process without collaborating with the server 10. At least a part of the map information DB 142 may be stored in an external data server. The system 1E of the sixth embodiment can also achieve the same effects as those of the first embodiment described above.

[0086] G. Variations: In the above embodiment, a part of the configuration realized by hardware may be replaced by software, and conversely, a part of the configuration realized by software may be replaced by hardware. In addition, the following modifications are also possible.

[0087] Variation 1: Although the above embodiment shows an example of the configuration of the system, server, and user terminal, any configuration of each device can be adopted.

[0088] For example, the server 10 and the user terminal 30 may implement a function of providing a delivery person with route guidance to the delivery destination of a package. The route guidance function may be implemented by cooperation between the server 10 and the user terminal 30, or may be implemented solely by the user terminal 30. For example, at least one of the map information DB 142 and the building information DB 143 of the server 10 may be stored in the user terminal 30 or an external server connected via the Internet INT. For example, the configurations of the map information DB 142, the building information DB 143, and the package information 341 described above are merely examples, and some of the illustrated information may be omitted, other information not illustrated may be included, or the information may be stored in multiple databases.

[0089] Variation 2: In the above embodiment, the support process (FIG. 2) has been described using an example of a processing procedure. However, these processing procedures can be modified in various ways, and the processing content of each step may be added, omitted, or changed, and the execution order of each step may be changed.

[0090] For example, the start trigger of step S22 may be a trigger other than tapping the button B11 on the map display screen W1, such as inputting a voice command. For example, the end trigger of step S04 may be a trigger other than tapping the number button B22 on the reading screen W2, such as inputting a voice command. For example, the execution of steps S32 and S34 and the display of frame BO3 on the reading result screen W3 may be omitted.

[0091] Variation 3: In the above embodiment, an example of the screen configuration and screen transitions was described for various screens displayed on the user terminal 30. However, these screen configurations and screen transitions can be modified in various ways, and items to be arranged on each screen may be added, omitted, or changed, and the transition order of each screen may be changed.

[0092] For example, on the reading screen W2, at least one of the rectangular frame BO1 and the selection field BO2 for selecting the time period specification (information a5) may be omitted. For example, on the reading screen W2, the button B21 may be omitted. For example, on the reading screen W2, the display of "Total number of delivery slip images taken" in the button B22 may be omitted. For example, the reading screen W2 may be configured to include other items that will not be explained. Examples of other items that will not be explained include buttons for setting the camera (flash on / off, shooting mode, etc.).

[0093] For example, the display manner of the confirmation fields D1 to Dx on the reading result screen W3 can be modified in various ways. For example, the confirmation field D1 may display an image of the delivery slip obtained by photographing the delivery slip (FIG. 2: step S30) and the information display RR1 side by side. In this case, it is preferable that the image displayed side by side is an image cropped to only the area within the frame BO1. This allows the user to quickly check the image of the delivery slip and the information display RR1 without shifting their gaze. For example, the colors of the confirmation fields D1 to Dx may be changed depending on the time period specified. For example, either button B131 or button B133 may be omitted.

[0094] For example, in the reading result screen W3, the confirmation fields D1 to Dx are displayed in a vertical row. However, as long as the confirmation fields D1 to Dx are displayed within a single reading result screen W3, they do not have to be displayed in a vertical row. For example, the confirmation fields D1 to Dx may be displayed in a horizontal row. In this case, the user can quickly view all the confirmation fields by scrolling the screen horizontally in a direction perpendicular to the DD direction in FIG. 6. Note that when the confirmation fields D1 to Dx are displayed in a horizontal row, multiple confirmation fields may be displayed vertically in accordance with the aspect ratio of the screen of the user terminal 30. For example, if the user terminal 30 is a smartphone, the confirmation fields D1 and D2 may be displayed vertically, and confirmation fields D3 and D4 may be displayed by scrolling horizontally, followed by confirmation fields D5 and D6.

[0095] Variation 4: The present invention is not limited to the above-described embodiments, examples, and modifications, and can be realized in various configurations without departing from the spirit of the present invention. For example, the technical features in the embodiments, examples, and modifications corresponding to the technical features in each aspect described in the Summary of the Invention section can be appropriately replaced or combined to solve some or all of the above-described problems or achieve some or all of the above-described effects. Furthermore, if a technical feature is not described as essential in this specification, it can be deleted as appropriate.

[0096] For example, the first to sixth embodiments and modifications 1 to 3 described above may be combined as appropriate. The automatic registration described in the second embodiment may be combined with the display of the map pin image DC described in the fourth or fifth embodiment. For example, the grouping described in the third embodiment may be combined with the display of the map pin image DC described in the fourth or fifth embodiment. For example, a user terminal 30 (sixth embodiment) may be configured to execute the functions described in the second to fifth embodiments without cooperating with the server 10.

[0097] The present invention can also be realized in the following forms. [Application example 1] An information processing device, A camera and a processing unit that reads the image of the delivery slip captured by the camera using an optical character reader and recognizes the address written on the delivery slip as the delivery destination of the package to which the delivery slip is attached; a storage unit that stores the destination information; Equipped with The processing unit For the plurality of delivery slips photographed successively, recognition of the destination of each of the delivery slips is performed in parallel with the photographing; Displaying the recognized destinations in a single confirmation screen; The information processing device registers the destination that satisfies a predetermined condition in the storage unit. [Application example 2] The information processing device according to Application Example 1, The information processing apparatus is configured such that the processing unit displays the recognized destinations in a vertical row on the confirmation screen. [Application example 3] The information processing device according to Application Example 1 or Application Example 2, The processing unit On the confirmation screen, a registration button is displayed for each destination; When a tap on one of the registration buttons is detected, the destination associated with the registration button is registered in the storage unit; The information processing device deletes the destination registered in the storage unit from the confirmation screen. [Application example 4] The information processing device according to any one of Application Examples 1 to 3, The processing unit On the confirmation screen, a group designation field for grouping the destinations is displayed for each destination; When registering the destination in the storage unit, the information processing device adds information about the group designated in the group designation field. [Application example 5] The information processing device according to any one of Application Examples 1 to 4, The processing unit Inquiring whether or not there is map data corresponding to each of the recognized destinations; If corresponding map data exists, the destination is automatically registered in the storage unit, and the destination is displayed on the confirmation screen in association with a message indicating that the destination has been registered; If corresponding map data does not exist, the information processing device displays the destination and a message prompting the user to edit the destination in association with each other on the confirmation screen. [Application Example 6] The information processing device according to any one of Application Examples 1 to 5, The processing unit displays, on the confirmation screen, a map image with pins as markers representing the recognized destinations above the recognized destinations. [Application Example 7] The information processing device according to any one of Application Examples 1 to 6, The processing unit a batch registration button is displayed on the map image on the confirmation screen; When a tap on the batch registration button is detected, the information processing device registers all of the destinations corresponding to the pins present on the map image in the storage unit. [Application Example 8] The information processing device according to any one of Application Examples 1 to 7, When the processing unit acquires addition or editing of information associated with the destination on the confirmation screen, the processing unit adds the information associated with the destination when registering the destination in the storage unit. [Application Example 9] A destination registration method, comprising: A processing step of reading an image of the delivery slip photographed by the camera using an optical character reader and recognizing the address written on the delivery slip, In the processing step, For the plurality of delivery slips photographed successively, recognition of the destination of each of the delivery slips is performed in parallel with the photographing; Displaying the recognized destinations in a single confirmation screen; A destination registration method, wherein the destination that satisfies a predetermined condition is registered in the storage unit. [Application Example 10] A computer program that is installed in an information processing device connected to a storage unit, An image of the delivery slip photographed by the camera is read by an optical character reader, and a processing function for recognizing the destination written on the delivery slip is executed; The processing function is For the plurality of delivery slips photographed successively, recognition of the destination of each of the delivery slips is performed in parallel with the photographing; Displaying the recognized destinations in a single confirmation screen; A computer program that registers the destination that satisfies a predetermined condition in the storage unit. [Explanation of symbols]

[0098] 1, 1A~1E…System 10...Server 30, 30A to 30E...User terminal 110...CPU 111...Control unit 120…Communications Department 130...ROM / RAM 140...Storage section 142...Map information database 143...Building information database 310,310E...CPU 311, 311A, 311E...Processing section 320…Communications Department 330...ROM / RAM 340,340B…Storage unit 341...Baggage information 350…Input / output section 360…Current position acquisition unit

Claims

1. An information processing device, A camera and a processing unit that reads the image of the delivery slip captured by the camera using an optical character reader and recognizes the address written on the delivery slip as the delivery destination of the package to which the delivery slip is attached; a storage unit that stores the destination information; Equipped with The processing unit For the plurality of delivery slips photographed successively, recognition of the destination of each of the delivery slips is performed in parallel with the photographing; Displaying the recognized destinations in a single confirmation screen; The information processing device registers the destination that satisfies a predetermined condition in the storage unit.

2. 2. The information processing device according to claim 1, The information processing apparatus is configured such that the processing unit displays the recognized destinations in a vertical row on the confirmation screen.

3. 3. The information processing device according to claim 2, The processing unit On the confirmation screen, a registration button is displayed for each destination; When a tap on one of the registration buttons is detected, the destination associated with the registration button is registered in the storage unit; The information processing device deletes the destination registered in the storage unit from the confirmation screen.

4. 4. The information processing device according to claim 3, The processing unit On the confirmation screen, a group designation field for grouping the destinations is displayed for each destination; When registering the destination in the storage unit, the information processing device adds information about the group designated in the group designation field.

5. 3. The information processing device according to claim 2, The processing unit Inquiring whether or not there is map data corresponding to each of the recognized destinations; If corresponding map data exists, the destination is automatically registered in the storage unit, and the destination is displayed on the confirmation screen in association with a message indicating that the destination has been registered; If corresponding map data does not exist, the information processing device displays the destination and a message prompting the user to edit the destination in association with each other on the confirmation screen.

6. 6. The information processing device according to claim 2, The processing unit displays, on the confirmation screen, a map image with pins as markers representing the recognized destinations above the recognized destinations.

7. 7. The information processing device according to claim 6, The processing unit a batch registration button is displayed on the map image on the confirmation screen; When a tap on the batch registration button is detected, the information processing device registers all of the destinations corresponding to the pins present on the map image in the storage unit.

8. 6. The information processing device according to claim 2, When the processing unit acquires addition or editing of information associated with the destination on the confirmation screen, the processing unit adds the information associated with the destination when registering the destination in the storage unit.

9. A destination registration method, comprising: A processing step of reading an image of the delivery slip photographed by the camera using an optical character reader and recognizing the address written on the delivery slip, In the processing step, For the plurality of delivery slips photographed successively, recognition of the destination of each of the delivery slips is performed in parallel with the photographing; Displaying the recognized destinations in a single confirmation screen; A destination registration method, wherein the destination that satisfies a predetermined condition is registered in the storage unit.

10. A computer program that is installed in an information processing device connected to a storage unit, An image of the delivery slip photographed by the camera is read by an optical character reader, and a processing function for recognizing the destination written on the delivery slip is executed; The processing function is For the plurality of delivery slips photographed successively, recognition of the destination of each of the delivery slips is performed in parallel with the photographing; Displaying the recognized destinations in a single confirmation screen; A computer program that registers the destination that satisfies a predetermined condition in the storage unit.

Images