Display device

Abstract

When designating a section from within the movement trajectory of an object displayed on a map, the present invention, while enabling fine adjustment of the section, reduces the time and effort for this adjustment and improves usability. Items representing the position of an object at each instance of a first time interval are displayed on a map as the trajectory of the object, and one of the items is set as a first selection point. A plurality of items representing the position of the object at each time that is separated, in units of a second time interval longer than the first time interval, from the time pertaining to the set first selection point are extracted and displayed as candidates for a second selection point. After having set the first selection point, a first selection point setting unit accepts, in units of the first time interval, a correction of the first selection point to other items. A second selection point candidate display unit re-extracts, as candidates for a second selection point, a plurality of items representing the position at each time that is separated in units of the second time interval from the time pertaining to a new first selection point.

Description

Technical Field

[0001] The present invention relates to a display device.

Background Art

[0002] There is known a video management system that acquires arbitrary videos from videos captured by devices such as a drive recorder (see, for example, Patent Document 1).

[0003] Patent Document 1 describes a video management system that, in response to a request from a client computer, displays the operation trajectory information of a garbage collection vehicle on a map image, accepts a position designation on the displayed trajectory, and extracts and distributes a recorded video corresponding to the designated position, a passing time when the garbage collection vehicle passes through the designated position, and a fixed time range before and after the passing time.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In the video management system as described in Patent Document 1, among the driving trajectories of the vehicle displayed on the map, recorded videos corresponding to the designated position and a certain range before and after it are to be extracted. Therefore, it may be difficult to finely adjust the range in which videos can be acquired.

[0006] In response to such problems, for example, it is conceivable to display items representing the vehicle's position at each time on a map as a driving trajectory so that they can be selected, accept the selection of one item and another item, and set the specified section between the specified items as the section for video acquisition to enable fine adjustment of the specified section. In this case, since the interval between each item becomes the minimum unit of the adjustment width of the specified section, the finer the adjustment of the specified section can be made as the interval between the items is narrowed.

[0007] However, it is conceivable that as the interval between each item is narrowed, the labor required to consider the selected items increases and the usability decreases.

[0008] As an example of the problem to be solved by the present invention, when specifying a section for video acquisition from among the movement trajectories of an object displayed on a map, while enabling fine adjustment of the section, the labor for the adjustment is reduced and the usability is improved.

Means for Solving the Problem

[0009] In order to solve the above problems, the invention according to claim 1 is a display device that displays, on a map, an item representing the position of an object at each first time interval as the trajectory of the object, comprising: a first selection point setting unit that accepts any selection among the items and sets it as a first selection point; a second selection point candidate display unit that extracts, as second selection point candidates, a plurality of the items representing the position of the object at each time interval separated by a second time interval longer than the first time interval from the time related to the set first selection point, and displays them in a selectable state; and an interval setting unit that accepts any selection among the second selection point candidates, sets the item related to the selected second selection point candidate as a second selection point, and sets, as a designated interval, an interval determined by the item set as the first selection point and the item set as the second selection point. The first selection point setting unit, after setting any one of the items as the first selection point, accepts the correction of the first selection point to another one of the items in units of the first time interval, sets it as a new first selection point, and the second selection point candidate display unit extracts, again as second selection point candidates, a plurality of the items representing the position of the object at each time interval separated by the second time interval from the time related to the new first selection point, and displays them in a selectable state.

[0010] The invention according to claim 5 is an information processing method executed by a computer, comprising: a trajectory point display step of displaying, on a map, an item representing the position of an object at each first time interval as the trajectory of the object; a first selection point setting step of accepting any selection among the items and setting it as a first selection point; a second selection point candidate display step of extracting, as second selection point candidates, a plurality of the items representing the position of the object at each time interval separated by a second time interval longer than the first time interval from the time related to the set first selection point, and displaying them in a selectable state; and an interval setting step of accepting any selection among the second selection point candidates, setting the item related to the selected second selection point candidate as a second selection point, and setting an interval defined by the item set as the first selection point and the item set as the second selection point as a designated interval. In the interval setting step, after setting the designated interval, modification of the first selection point to another item is accepted in units of the first time interval, set as a new first selection point, and a plurality of the items representing the position at each time interval separated by the second time interval from the time related to the new first selection point are extracted again as the second selection point candidates and displayed in a selectable state.

[0011] The invention according to claim 6 is characterized in that the information processing method according to claim 5 is executed by a computer as an information processing program.

[0012] The invention according to claim 7 is characterized in that the information processing program according to claim 6 is stored in a computer-readable storage medium.

Brief Description of the Drawings

[0013]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Embodiments for Carrying Out the Invention

[0014] Hereinafter, a display device according to an embodiment of the present invention will be described. The display device according to an embodiment of the present invention is a display device that displays, on a map, an item representing the position of an object at each first time interval as the trajectory of the object. The display device includes a first selection point setting unit that accepts a selection of any one of the items and sets it as the first selection point. Then, the second selection point candidate display unit extracts, as second selection point candidates, a plurality of items representing the positions of the object at each time separated by a second time interval longer than the first time interval from the time related to the set first selection point, and displays them in a selectable state. Then, the section setting unit accepts a selection of any one of the second selection point candidates, sets the item related to the selected second selection point candidate as the second selection point, and sets the section determined by the item set as the first selection point and the item set as the second selection point as the designated section. After setting any one of the items as the first selection point, the first selection point setting unit accepts a correction of the first selection point to another item in units of the first time interval and sets it as a new first selection point. The second selection point candidate display unit extracts again, as second selection point candidates, a plurality of items representing the positions at each time separated by the second time interval from the time related to the new first selection point, and displays them in a selectable state. By doing so, it is possible to reduce the labor of considering the item to be set as the second selection point compared to the item set as the first selection point. Further, when the first selection point is corrected, since the second selection point candidates are extracted again in units of the second time interval, it is possible to reduce the labor of considering the items to be selected while finely adjusting the designated section. Therefore, it is possible to improve the user-friendliness by enabling fine adjustment of the section when designating a section for video acquisition from among the movement trajectories of the objects displayed on the map while reducing the labor for the adjustment.

[0015] Further, the second selection point candidate display unit may set the second time interval based on at least one of object information indicating information of the object corresponding to the item and surrounding information indicating the situation around the object corresponding to the item. By doing so, the second time interval can be dynamically changed according to the state of the object corresponding to the item and the situation around the object corresponding to the item.

[0016] Also, the object information is information on the speed of the object, and the second selection point candidate display unit may set the second time interval to be smaller as the speed of the object is higher, and set the second time interval to be larger as the speed of the object is lower. By doing so, for example, when acquiring an image of an object traveling at high speed on a highway, it is possible to prevent the information obtained from the acquired image from becoming excessive. Also, for example, when acquiring an image of an object traveling at low speed on a general road, it is possible to prevent the information obtained from the acquired image from becoming too little. Also, by doing so, it is possible to suppress the situation where a plurality of second selection point candidates are too far apart or too close to each other.

[0017] Also, the surrounding information is information on the traffic jam situation, and the second selection point candidate display unit may set the second time interval to be larger when the information on the traffic jam situation is obtained, as compared with the case where the information on the traffic jam situation is not obtained. By doing so, when acquiring an image in a situation where it is difficult for an object to advance in the traveling direction due to the occurrence of a traffic jam, it is possible to prevent the information obtained from the acquired image from becoming too little.

[0018] Also, the information processing method according to the position embodiment of the present invention is an information processing method executed by a computer. In the trajectory point display step, the information processing method displays, on a map as the trajectory of an object, items representing the position of the object at each first time interval. Then, in the first selection point setting step, any one of the items is accepted as a selection and set as the first selection point. Then, in the second selection point candidate display step, a plurality of items representing the position of the object at each time separated by a second time interval longer than the first time interval from the time related to the set first selection point are extracted as second selection point candidates and displayed in a selectable state. Then, in the section setting step, any one of the second selection point candidates is accepted as a selection, the item related to the selected second selection point candidate is set as the second selection point, and a section determined by the item set as the first selection point and the item set as the second selection point is set as the designated section. In the section setting step, after setting the designated section, it is assumed that the correction of the first selection point to other items can be accepted in units of the first time interval and set as a new first selection point. When a new first selection point is set, a plurality of items representing the position at each time separated by the second time interval from the time related to the new first selection point are extracted again as second selection point candidates and displayed in a selectable state. By doing so, it is possible to finely adjust the section when specifying the section for video acquisition from among the movement trajectories of the object displayed on the map, while reducing the labor for the adjustment and improving the usability.

[0019] Further, the above-described information processing method may be executed by a computer as an information processing program. By doing so, it is possible to finely adjust the section when specifying the section for video acquisition from among the movement trajectories of the object displayed on the map using a computer. Also, at that time, the labor for the adjustment can be reduced and the usability can be improved.

[0020] Further, the above-described information processing program may be stored in a computer-readable storage medium. By doing so, the information processing program can be distributed not only when incorporated into a device but also as a single entity, and version updates and the like can be easily performed.

Embodiment

[0021] FIG. 1 is a diagram showing a video acquisition system 100 according to an embodiment of the present invention. The video acquisition system 100 includes a vehicle terminal 200, a server device 300, and a management terminal 400. The vehicle terminal 200 is, for example, a device installed in a vehicle (object) (e.g., a car navigation device) or a device carried by a person (e.g., a smartphone). The server device 300 is, for example, a device managed by a provider (e.g., a company) that provides the video acquisition system 100 as a service. The management terminal 400 is, for example, a device managed by a user (e.g., a vehicle administrator) who uses the video system 100. The server device 300 and the management terminal 400 are examples of the display device according to the above embodiment.

[0022] As shown in FIG. 1, the vehicle terminal 200 includes a control unit 210, a storage unit 220, and a communication unit 230. The control unit 210 is configured by, for example, a CPU (Central Processing Unit) or the like. The storage unit 220 is a hard disk or a memory. The communication unit 230 is a communication device for transmitting and receiving information to and from other devices.

[0023] The control unit 210 performs a process of storing information such as the trajectory point information 400 and the video information 500 acquired by the vehicle terminal 200 in the storage unit 220. Further, the control unit 210 performs a process of transmitting information such as the trajectory point information 400 and the video information 500 to the server device 300 using the communication unit 230.

[0024] The trajectory point information 400 mainly indicates the position (latitude and longitude) of the vehicle at each time, and includes time information such as date and time, position information indicating latitude and longitude, driving information including information on the traveling direction of the vehicle and the speed of the vehicle. This trajectory point information 400 may further include information on the vehicle type of the vehicle, driver information, weather information corresponding to time information, traffic jam situation information, place name information, gradient information, information indicating going or returning on the traveling route of the vehicle, etc.

[0025] The control unit 210 acquires these trajectory point information 400 from, for example, a GPS (Global Positioning System) receiver, various sensors such as a gyro sensor and an acceleration sensor, or an external device that transmits weather information and traffic information, etc., stores it in the storage unit 220 in sets of a predetermined time (for example, 3 seconds), and performs a process of transmitting multiple sets (for example, 300 seconds' worth) to the server device 300 at any time using the communication unit 230.

[0026] The video information 500 is information regarding video captured by an imaging device such as a camera mounted on the vehicle, and is composed of video data outside the vehicle and video data inside the vehicle that are constantly captured by the vehicle. The control unit 210 stores this video information 500 in the storage unit 220, and when there is a request from the server device 300, performs a process of transmitting the requested video information 500 to the server device 300 using the communication unit 230.

[0027] Also, when the control unit 210 stores one set of the above-described trajectory point information 400 in the storage unit 220, it also stores the video information 500 corresponding to this one set in the storage unit 220, and by transmitting it together when transmitting multiple sets to the server device 300, the video information 500 may be transmitted to the server device 300 even when there is no request.

[0028] As shown in FIG. 1, the server device 300 includes a control unit 310, a storage unit 320, and a communication unit 330. The control unit 310 is composed of, for example, a CPU (Central Processing Unit) or the like. The storage unit 320 is a hard disk or a memory. The communication unit 330 is a communication device for transmitting and receiving information to and from other devices.

[0029] The control unit 310 includes a trajectory point information acquisition unit 311, a trajectory point display unit 312, a start point setting unit 313 (first selection point setting unit), an end point candidate display unit 314 (second selection point candidate display unit), an interval setting unit 315, and a video acquisition unit 316.

[0030] The trajectory point information acquisition unit 311 performs a process of storing the trajectory point information 400 received by the communication unit 330 from the vehicle terminal 200 in the storage unit 320 as the driving history of the vehicle.

[0031] The trajectory point display unit 312 receives an operation from an input unit 410, which will be described later, via the communication unit 330 and a communication unit 430 of the management terminal 400, which will be described later. When the operation is received, the trajectory point information 400 corresponding to the driving history stored in the storage unit 320 is displayed on an output unit 420 of the management terminal 400, which will be described later, via the communication unit 330 and the communication unit 430. FIG. 2 is a diagram showing an example of the trajectory point information 400 displayed on the output unit 420 of the management terminal 400. Here, the position of the vehicle at each time is displayed on the map as a trajectory point item 401 (item) of the vehicle.

[0032] Each trajectory point item 401 represents the position of the vehicle every 3 seconds (first time interval). Also, each trajectory point item 401 is formed as an isosceles triangle, and the direction of the apex angle represents the traveling direction of the vehicle. Further, each trajectory point item 401 is color-coded according to the speed of the vehicle, and is configured such that changes in the vehicle speed can be visually recognized.

[0033] The start point setting unit 313 accepts the selection of any one of the trajectory point items 401 through the input unit 410 of the management terminal 400 via the communication unit 330 and the communication unit 430, and sets it as the start point 402. Note that the start point 402 in the present embodiment refers to a point selected before the end point 408 described later, and does not necessarily indicate a point at a time earlier than the end point 408. When selecting the start point 402, the cursor is overlapped with the target trajectory point item 401 using a mouse or the like, and is selected by clicking or the like. A pin-shaped start point pin s1 is displayed at the set start point 402, and a start point mark s2 marked with S in alphabetical letters is displayed in the vicinity thereof.

[0034] The start point pin s1 and the start point mark s2 can be moved to other trajectory point items 401. After the movement, the trajectory point item 401 where the start point pin s1 is displayed is set as the new start point 402. That is, after setting any one of the trajectory point items 401 as the start point 402, the start point setting unit 313 accepts the correction of the start point 402 to other trajectory point items 401 in units of the first time interval, and sets it as the new start point 402. In this way, the correction of the start point 402 once selected can be performed.

[0035] As shown in FIG. 3, when the start point setting unit 313 accepts the selection of any one of the trajectory point items 401 (that is, when the mouse hovers over the trajectory point item 401), if there are a plurality of trajectory point items 401 within a predetermined range, the plurality of trajectory point items 401 are displayed as a selectable list 403. In this embodiment, when a plurality of trajectory point items 401 are displayed overlapping on the map for reasons such as the vehicle having stopped for a certain period of time or having moved in different directions from the same position, the list 403 is displayed.

[0036] As shown in FIG. 3, list 403 may include at least one of the above-described trajectory point information 400 corresponding to each trajectory point item 401 (travel information including time information such as 2021 / 12 / 12, 10:00:06 and 2021 / 12 / 12, 15:00:00, position information indicating latitude and longitude, information on the traveling direction of the vehicle, and information on the speed of the vehicle). Further, as the trajectory point information 400 included in list 403, there may be further information on the vehicle type of the vehicle, information on the driver, weather information corresponding to the time information, information on the traffic jam situation, information on place names, information on gradients, information indicating going or returning in the traveling route of the vehicle, and the like. Also, as shown in FIG. 3, by expanding each trajectory point item 401 and displaying it in list 403, the above-described travel information, that is, the information on the traveling direction of the vehicle and the information on the speed of the vehicle may be visually recognized. Further, list 403 may include an image captured by the vehicle corresponding to the trajectory point item 401. This image may be, for example, a thumbnail image G created based on the video information 500 transmitted when there is no request from the above-described server device 300.

[0037] In addition, when there are a plurality of trajectory point items 401 corresponding to the time from the start of the vehicle stop to the end of the vehicle stop in list 403 (for example, when the trajectory point items are displayed overlapping on the map due to the vehicle stop), as shown in FIG. 4, the start point setting unit 313 may delete, from list 403, all but one of the plurality of trajectory point items 401 corresponding to the time from the start of the vehicle stop to the end of the vehicle stop in list 403.

[0038] Also, as shown in FIG. 5, the start point setting unit 313 may integrate the plurality of trajectory point items 401 corresponding to the time from the start of the vehicle stop to the end of the vehicle stop in list 403, and display it in list 403 as one trajectory point item 401 corresponding to a predetermined time from the start of the vehicle stop to the end of the vehicle stop. In this way, the server device 300 displays the trajectory point item 401 representing the position of the vehicle every 3 seconds on the map as the trajectory of the vehicle.

[0039] The end point candidate display unit 314 receives an operation from the input unit 410 of the management terminal 400 via the communication unit 330 and the communication unit 430, extracts a plurality of end point candidates 404 from other trajectory point items 401 based on the set start point 402, and displays them on the output unit 420 of the management terminal 400 in a selectable state. At this time, as shown in FIG. 6, the end point candidates 404 are a plurality of trajectory point items 401 representing the positions of the vehicle at each time separated by a second time interval longer than the first time interval from the time related to the set start point 402, and are extracted as the end point candidates 404.

[0040] As a premise, for example, in a transportation company, etc., compliance with various rules is required in specific locations such as level crossings, temporary stop positions, right and left turns, and in specific driving states such as at the start and during reverse driving. The administrator watches the actual video to check whether the driver thoroughly complies with the rules and confirms whether there is any rule violation by the driver.

[0041] Here, when the administrator who uses the video acquisition system 100 designates the start point 402 when designating the section of the video to be acquired, it is advisable to set the above-mentioned first time interval to a short unit of about 3 seconds, so that the vicinity of a specific location such as near an intersection, near a level crossing, near a temporary stop position, etc. can be specified in detail. By doing so, the confirmation of the driver's driving situation during video viewing can be carried out efficiently.

[0042] On the other hand, when specifying the end point 408, it is sufficient that the administrator can select an end point candidate 404 that includes the section the administrator wishes to view. Since a detailed specification of about the first time interval is not necessary, it is preferable to set a second time interval that is longer than the first time interval. For this reason, in this embodiment, as an example, the first time interval is set to 3 seconds and the second time interval is set to 60 seconds. Further, when the start point 402 is corrected as described above and a new start point 402 is set, the end point candidate display unit 314 extracts again, as end point candidates 404, a plurality of locus point items 401 representing positions at intervals of 60 seconds (the second time interval) from the time related to the new start point 402, and displays them in a selectable state. In this way, the end point candidates 404 are corrected in accordance with the correction of the start point 402.

[0043] When there are a plurality of end point candidates 404 within a predetermined range, the end point candidate display unit 314 displays an identification mark 405 indicating that there are a plurality of end point candidates 404. The identification mark 405 may be displayed in the vicinity of the plurality of end point candidates 404 within the predetermined range, or may be displayed in place of the display made when there are no plurality of end point candidates 404 within the predetermined range (that is, when the identification mark 405 is not displayed).

[0044] When setting the start point 402, "when there are a plurality of locus point items 401 within a predetermined range" is defined as "when a plurality of locus point items 401 are displayed overlapping on the map". That is, the predetermined range when setting the start point 402 is the range where the locus point items 401 are displayed overlapping on the map. However, this predetermined range is merely an example. The predetermined range may be, for example, a range in which a part of the preceding and succeeding locus point items 401 is displayed in contact with one locus point item 401, or a range in which a part of the preceding and succeeding locus point items 401 overlaps with one locus point item 401. And within this predetermined range, it may be different between the case of setting the start point 402 and the case of displaying the identification mark 405.

[0045] Also, when the trajectory point item 401 contacts or overlaps as described above, since the trajectory point item 401 that contacts or overlaps may change according to the scale of the map on which the trajectory point item 401 is displayed, the start point setting unit 313 and the end point candidate display unit 314 may confirm with the user of the management terminal 400 whether to display the list 403 and the identification mark 405 each time the scale of the map changes.

[0046] When there are a plurality of end point candidates 404 within a predetermined range (for example, when the trajectory point items 401 related to the plurality of end point candidates 404 are displayed overlapping on the map), the identification mark 405 assumes any one of a first state 4011, a second state 4012, and a third state 4013 based on the configuration of the plurality of trajectory point items 401.

[0047] The first state 4011 indicates that the plurality of trajectory point items 401 existing within the predetermined range are composed only of the trajectory point items 401 corresponding to a time earlier than the time corresponding to the trajectory point item 401 related to the set start point 402.

[0048] The second state 4012 indicates that the plurality of trajectory point items 401 existing within the predetermined range are composed only of the trajectory point items 401 corresponding to a time later than the time corresponding to the trajectory point item 401 related to the set start point 402.

[0049] The third state 4013 indicates that the plurality of trajectory point items 401 existing within the predetermined range are composed of both the trajectory point items 401 corresponding to a time earlier than the time corresponding to the trajectory point item 401 related to the set start point 402 and the trajectory point items 401 corresponding to a time later than the time corresponding to the trajectory point item 401 related to the set start point 402. Thus, the identification mark 405 is provided so as to be able to distinguish the first state 4011, the second state 4012, and the third state 4013.

[0050] Further, as shown in FIG. 6 for example, the identification mark 405 may be provided to include a candidate number mark 406 that can identify the number of end candidates 404 existing within a predetermined range. That is, the identification mark 405 is provided so as to be able to identify the number of end candidates 404 existing within a predetermined range.

[0051] When there are a plurality of end candidates 404 within a predetermined range, the end candidate display unit 314 may display the identification mark 405 in a state including the candidate number mark 406, or may display only the candidate number mark 406 among the identification marks 405. Further, when the end candidate display unit 314 displays the end candidates 404 in a selectable state, it may display a time interval mark 407 indicating how much time each end candidate 404 is separated from the time related to the start point 402. In this embodiment, the second time interval is set to 60 seconds, but this 60 seconds may be dynamically changed according to the situation.

[0052] Specifically, the end candidate display unit 314 may set the second time interval based on at least one of object information 600 indicating information of the vehicle corresponding to the trajectory point item 401 and surrounding information 700 indicating the situation around the vehicle corresponding to the trajectory point item 401. The object information 600 refers to, for example, running information (information on the traveling direction of the vehicle and information on the speed of the vehicle), information on the vehicle type of the vehicle, information on the driver, etc. among the trajectory point information 400 acquired from the vehicle terminal 200. This object information 600 is stored in, for example, the storage unit 320 of the server device 300. Then, the second time interval is dynamically set according to, for example, the information on the speed of the vehicle among the object information 600.

[0053] In this case, for example, the end candidate display unit 314 can set the second time interval to be smaller as the speed of the vehicle is higher, and set the second time interval to be larger as the speed of the vehicle is lower. By doing so, it is possible to suppress the situation where a plurality of end candidates 404 are too far apart or too close.

[0054] On the other hand, the end point candidate display unit 314 can set the second time interval to be larger as the speed of the vehicle is higher, and set the second time interval to be smaller as the speed of the vehicle is lower. By doing so, the user of the video acquisition system 100 can acquire a video for a longer time as the speed of the vehicle is higher, and acquire a video for a shorter time as the speed of the vehicle is lower.

[0055] The surrounding information 700 refers to information such as time information such as date and time, weather information corresponding to the time information, traffic jam situation information, place name information, gradient information, etc. among the trajectory point information 400 acquired from the vehicle terminal 200. This surrounding information 700 is stored, for example, in the storage unit 320 of the server device 300. Then, for example, when the surrounding information 700 is the traffic jam situation information, the end point candidate display unit 314 can set the second time interval to be larger when the traffic jam situation information is obtained, compared with the case where the traffic jam situation information is not obtained.

[0056] Also, as described above, when a plurality of trajectory point items 401 corresponding to the time from the start of the vehicle stop to the end of the vehicle stop in the list 403 are integrated, the end point candidate display unit 314, as shown in FIG. 5, among the trajectory point item 401 corresponding to the start time of the vehicle stop and the trajectory point item 401 corresponding to the end time of the vehicle stop, may extract the end point candidate 404 based on at least one of them and display it in a selectable state.

[0057] Specifically, the end point candidate display unit 314 extracts, as the end point candidate 404, at least one of the trajectory point item 401 representing a position before the start time of the vehicle stop separated at 60 - second intervals based on the start time of the vehicle stop (in FIG. 5, 10:00:00 on December 12, 2021), and the trajectory point item 401 representing a position after the end time of the vehicle stop separated at 60 - second intervals based on the end time of the vehicle stop (in FIG. 5, 10:00:12 on December 12, 2021).

[0058] The section setting unit 315 receives, via the communication unit 330 and the communication unit 430, a selection of any one of the end point candidates 404 by the input unit 410 of the management terminal 400, and sets the trajectory point item 401 related to the selected end point candidate 404 as the end point 408. Note that the end point 408 in the present embodiment refers to a point selected after the above-described start point 402, and does not necessarily indicate a point at a time later than the start point 402.

[0059] When selecting the end point 408, the cursor is placed over the target end point candidate 404 with a mouse or the like and selected by clicking or the like. As shown in FIG. 7, a pin-shaped end point pin e1 is displayed at the set end point 408, and an end point mark e2 marked with E in alphabet is displayed in the vicinity thereof. Then, the section setting unit 315 sets the section determined by the trajectory point item 401 set as the start point 402 and the trajectory point item 401 set as the end point 408 as the designated section 409.

[0060] When there are a plurality of end point candidates 404 within a predetermined range when the section setting unit 315 receives a selection of any one of the end point candidates 404 (for example, when the trajectory point items 401 related to the plurality of end point candidates 404 are displayed overlapping on the map), the plurality of end point candidates 404 are displayed as a list (not shown) in a selectable state.

[0061] This list is the same as the list 403 when selecting the above-described start point 402, and this list may include any one of the above-described trajectory point information 400, such as information on the traveling direction of the vehicle. Note that the above-described end point candidate display unit 314 may make the identification mark 405 distinguishable in the first state 4011, the second state 4012, and the third state 4013 only when this list is displayed.

[0062] The video acquisition unit 316 receives operations from the input unit 410 of the management terminal 400 via the communication unit 330 and the communication unit 430, and requests the vehicle terminal 200 to upload video information 500 corresponding to the specified section 409 designated by the section setting unit 315. Specifically, the video acquisition unit 316 identifies the section from the start to the end of the video to be acquired based on the above-mentioned time information related to the start point 402 of the specified section 409 and the time information related to the end point 408 of the specified section 409, and requests the vehicle terminal 200 for the video corresponding to that section. Then, the video acquisition unit 316 transmits the video information 500 transmitted from the vehicle terminal 200 in response to the request and received by the communication unit 330 to the communication unit 430 of the management terminal 400 and displays it on the output unit 420 of the management terminal 400. Also, the video acquisition unit 316 is stored together with one set of the trajectory point information 400 in the vehicle terminal 200 as described above. If there is video information 500 that is also transmitted to the server device 300 even when there is no request, the video acquisition unit 316 may acquire the video information 500 via the communication unit 330 and store it in the storage unit 320. The video information 500 stored in this storage unit 320 is used for the thumbnail image G etc. when displaying the list 403.

[0063] As shown in FIG. 1, the management terminal 400 includes an input unit 410, an output unit 420, and a communication unit 430. The input unit 410 is an input device such as a keyboard. The output unit 420 is an output device such as a display. The communication unit 430 is a communication device for transmitting and receiving information to and from other devices.

[0064] The input device 410 receives the input of the administrator who operates the management terminal 400. The output unit 420 displays the information received by the communication unit 430 from the server device 300. The communication unit 430 communicates with the communication unit 330 of the server device 300 and transmits the information input to the input unit 410 to the server device 300. Also, the communication unit 430 receives the information transmitted from the communication unit 330 of the server device 300.

[0065] Next, the operation (information processing method) of the video acquisition system 100 with the above-described configuration will be described with reference to the flowcharts of FIGS. 8 to 11. Note that the flowcharts of FIGS. 8 to 11 can be configured as a program executed by a computer including a CPU or the like to obtain a video acquisition program (information processing program). Further, this video acquisition program may be stored in a computer-readable storage medium.

[0066] First, as shown in FIG. 8, when the input unit 410 of the management terminal 400 receives an operation and a travel history of a vehicle for which a video is to be confirmed is selected by the operation, the locus point display unit 312 outputs locus point information 400 corresponding to the selected travel history to the output unit 420 for display (step S100). Step S100 corresponds to the locus point display step in the above-described embodiment.

[0067] Note that the travel history is created in advance based on the locus point information 400 that is transmitted from the vehicle terminal 200 to the server device 300 at any time as described above. In step S100, a locus point item 401 representing the position of the vehicle every 3 seconds is displayed on the map as the locus of the vehicle. Here, the user who operates the management terminal 400 visually confirms the passage route, traveling direction, vehicle speed, etc. of the vehicle by checking the locus point item 401.

[0068] Next, the input unit 410 of the management terminal 400 receives an operation, and the start point setting unit 313 sets any one of the locus point items 401 as a start point 402 (step S200). Step S200 corresponds to the first selection point setting step in the above-described embodiment.

[0069] As shown in FIG. 9, in step S200, first, on the map displayed on the output unit 420, a state is set to accept the selection of any one of the trajectory point items 401 (step S201). Here, the selection of the starting point 402 is performed by, for example, moving the cursor over the trajectory point item 401 or clicking the mouse with the cursor placed on the trajectory point item 401. Next, it is determined whether there are a plurality of trajectory point items 401 within a predetermined range (step S202). Here, for example, it may be based on the condition that the trajectory point items 401 partially or completely overlap. If the result of the determination is YES, the process proceeds to step S203; if NO, the process proceeds to step S204.

[0070] In step S203, the plurality of trajectory point items 401 determined to exist within the predetermined range are displayed as a list 403 on the output unit 420 in a selectable state. Since the list 403 includes the trajectory point information 400 and the video information 500 as described above, the user operating the management terminal 400 can select an arbitrary trajectory point item 401 with reference to the trajectory point information 400 etc. displayed in the list 403. When the display of this list 403 is completed, the process proceeds to step S204. Note that in this step S203, the trajectory point items 401 within the list 403 may be sorted.

[0071] For example, when there are a plurality of trajectory point items 401 corresponding to the time from the start of vehicle stop to the end of vehicle stop in the list 403 (for example, when the trajectory point items are displayed overlapping on the map due to vehicle stop), as shown in FIG. 4, among the plurality of trajectory point items 401 corresponding to the time from the start of vehicle stop to the end of vehicle stop within the list 403, those other than one trajectory point item 401 may be deleted from the list 403.

[0072] Further, as shown in FIG. 5, the start point setting unit 313 may integrate a plurality of trajectory point items 401 corresponding to the time from the start of the vehicle stop to the end of the vehicle stop in the list 403, and display them in the list 403 as one trajectory point item 401 corresponding to a predetermined time from the start of the vehicle stop to the end of the vehicle stop.

[0073] In step S204, the selection of any one of the trajectory point items 401 is received, and the selected trajectory point item 401 is set as the start point 402. When the start point 402 is set, on the map displayed on the output unit 420, a start point pin s1 and a start point mark s2 are displayed at the set start point 402. Thereby, step S200 ends and the process proceeds to step S300.

[0074] In step S300, a plurality of end point candidates 404 are extracted from the other trajectory point items 401 based on the set start point 402 and displayed in a selectable state on the output unit 420. This step S300 corresponds to the second selection point candidate display step in the above-described embodiment.

[0075] As shown in FIG. 10, in step S300, first, a plurality of trajectory point items 401 representing the vehicle positions at intervals of 60 seconds from the time related to the set start point 402 are extracted as end point candidates 404 and displayed on the output unit 420 (step S301).

[0076] At this time, when the plurality of trajectory point items 401 corresponding to the time from the start of the vehicle stop to the end of the vehicle stop in the list 403 are integrated in the above-described step S203, as shown in FIG. 5, at least one of the trajectory point item 401 corresponding to the start time of the vehicle stop and the trajectory point item 401 corresponding to the end time of the vehicle stop may be used as a reference to extract the end point candidate 404 and display it in a selectable state.

[0077] In addition, in this embodiment, it is assumed that the end point candidates 404 are extracted in units of 60 seconds, that is, the second time interval. However, as described above, this second time interval may be dynamically changed in accordance with at least one of the object information 600 and the surrounding information 700. For example, if the object information 600 is the speed information of the vehicle, the second time interval may be set smaller as the speed of the vehicle is faster, and the second time interval may be set larger as the speed of the vehicle is slower. Further, if the surrounding information 700 is the traffic jam situation information, when the traffic jam situation information is obtained, the second time interval may be set larger as compared with the case where the traffic jam situation information is not obtained.

[0078] Next, it is determined whether or not a plurality of the extracted end point candidates 404 exist within a predetermined range (step S302). If the determination result is YES, the process proceeds to step S303, and if NO, the process of step S300 ends.

[0079] In step S303, an identification mark 405 indicating that a plurality of end point candidates 404 exist within the predetermined range is displayed on the output unit 420. At this time, the identification mark 405 may be displayed in the vicinity of the end point candidate 404, or may be displayed so as to replace the display of the end point candidate 404 made when no end point candidate 404 exists within the predetermined range.

[0080] In addition, as described above, the identification mark 405 may be able to identify the first state 4011, the second state 4012, and the third state 4013. At this time, as described above, a candidate number mark 406 indicating the number of the plurality of end point candidates 404 may be displayed, or a time interval mark 407 indicating how much time each end point candidate 404 is separated from the time related to the start point 402 may be displayed. Next, the process proceeds to step S400.

[0081] In step S400, the input unit 410 of the management terminal 400 receives an operation, and the section setting unit 315 sets a designated section 409. This step S400 is a step corresponding to the section setting process in the present invention.

[0082] As shown in FIG. 11, in step S400, first, on the map displayed on the output unit 420, any one of the end point candidates 404 is set to an acceptable selection state (step S401). Next, it is determined whether there are a plurality of end point candidates 404 within a predetermined range (step S402). Here, for example, it may be conditional that the end point candidates 404 partially or entirely overlap. If the result of the determination is YES, the process proceeds to step S403, and if NO, the process proceeds to step S404.

[0083] In step S403, the plurality of end point candidates 404 determined to exist within the predetermined range are displayed as a list on the output unit 420 in a selectable state. As a result, the user operating the management terminal 400 can select an arbitrary end point candidate 404 with reference to the trajectory point information 400 etc. displayed in the list. At this time, the list may include the trajectory point information 400 such as the information on the traveling direction of the vehicle. Also, when the list is displayed, the above-described identification mark 405 may be in a state where the first state 4011, the second state 4012, and the third state 4013 are distinguishable. Then, when the display of the list is completed, the process proceeds to step S404.

[0084] In step S404, the selection of any one of the end point candidates 404 is accepted, and the selected end point candidate 404 is set as the end point 408. As a result, the end point 408 is determined. When the end point 408 is set, on the map displayed on the output unit 420, an end point pin e1 and an end point mark e2 are displayed at the set end point 408. Then, the process proceeds to step S405. In step S405, the section determined by the trajectory point item 401 set as the start point 402 and the trajectory point item 401 set as the end point 408 is set as the designated section 409. Next, the process proceeds to step S406.

[0085] In step S406, it is determined whether the correction of the start point 402 or the end point 408 is accepted. If it is determined in this state that the correction of the end point 408 is accepted, the end point candidates 404 become selectable again, and the process returns to step S404.

[0086] If it is determined that the modification of the starting point 402 is accepted, the process proceeds to step S407. In step S407, the starting point 402 is modified. Specifically, the starting point pin s1 is moved to another locus point item 401, and the destination of the movement is set as the new starting point 402. Next, the process proceeds to step S408.

[0087] In step S408, the recalculation of the end point candidate 404 is performed. When the recalculation is completed, the process returns to step S301. In step S301, based on the result of the recalculation, a plurality of locus point items 401 are extracted as the end point candidate 404 and displayed on the output unit 420. Then, the operation is performed as in step S300 described above, and the process proceeds to S400. Then, the operation is performed as in step S400 described above, and the process proceeds to step S406. As a result, the re - setting of the end point 408 is performed in step S404, and the re - setting of the specified section 409 is performed in step S405.

[0088] If it is not determined that the modification of the starting point 402 or the end point 408 is accepted in step S406 (that is, if it is determined that there is no change), step S400 is terminated. When step S400 is terminated, the process proceeds to step S500.

[0089] In step S500, the input unit 410 of the management terminal 400 accepts an operation, and the video acquisition unit 316 acquires video information 500 corresponding to the specified section 409. In this step S500, first, via the communication unit 330, the vehicle terminal 200 is requested to upload the video information 500 corresponding to the specified section 409 specified by the section setting unit 315 to the server device 300. Next, the video acquisition unit 316 stores the video information 500 transmitted from the vehicle terminal 200 in response to the request and received by the communication unit 330 in the storage unit 320, and then transmits it to the communication unit 430 and displays it on the output unit 420 of the management terminal 400. As a result, step S500 is terminated, and the video acquisition system 100 is terminated.

[0090] According to this embodiment, when the start point setting unit 313 receives a selection of any one of the trajectory point items 401 and there are a plurality of trajectory point items 401 within a predetermined range, the plurality of trajectory point items 401 are displayed as a list 403 in a selectable state. By doing so, the start point 402 can be selected while checking the list 403. Therefore, for example, even when there are a plurality of trajectory point items 401 within a predetermined range, such as when the trajectory point items 401 are dense or overlapping, the selection of the trajectory point items 401 can be easily performed.

[0091] In addition, the list 403 can include at least one of information on the time corresponding to the trajectory point item 401, weather information, traffic congestion status information, place name information, gradient information, information indicating going or returning in the vehicle's travel route, information on the vehicle's travel direction, and information on the vehicle's speed. By doing so, after checking the information such as the date and time, weather, traffic congestion status corresponding to the trajectory point item 401, and the vehicle's travel direction and speed, the trajectory point item 401 can be selected.

[0092] In addition, the list 403 can include an image captured by the vehicle corresponding to the trajectory point item 401. By doing so, the trajectory point item 401 can be selected after checking the image in the list 403.

[0093] In addition, the start point setting unit 313 can delete from the list 403 all but one of the plurality of trajectory point items 401 corresponding to the time from the start of the vehicle's stop to the end of the vehicle's stop within the list 403. By doing so, the trajectory point items 401 displayed as the list 403 can be sorted out and reduced. As a result, compared with a configuration in which all but one of the trajectory point items 401 are not deleted from the list 403, the labor of selecting one trajectory point item 401 from among the plurality of trajectory point items 401 when selecting the trajectory point item 401 in the list 403 can be reduced.

[0094] Further, the start point setting unit 313 can integrate a plurality of trajectory point items 401 corresponding to the time from the start of the vehicle stop to the end of the vehicle stop in the list 403, and display them in the list 403 as one trajectory point item 401 corresponding to a predetermined time from the start of the vehicle stop to the end of the vehicle stop. By doing so, the trajectory point items 401 displayed as the list 403 can be organized and reduced. As a result, when selecting the trajectory point item 401 in the list 403, it is possible to reduce the labor of selecting one trajectory point item 401 from among the plurality of trajectory point items 401 as compared with a configuration in which the plurality of trajectory point items 401 are not integrated.

[0095] Also, when the start point setting unit 313 integrates a plurality of trajectory point items 401 corresponding to the time from the start of the vehicle stop to the end of the vehicle stop in the list 403 and displays them in the list 403 as one trajectory point item 401 corresponding to a predetermined time from the start of the vehicle stop to the end of the vehicle stop, the end point candidate display unit 314 can extract the end point candidate 404 based on at least one of the trajectory point item 401 corresponding to the start time of the vehicle stop and the trajectory point item 401 corresponding to the end time of the vehicle stop, and display it in a selectable state. By doing so, when integrating a plurality of trajectory point items 401 corresponding to the time from the start of the vehicle stop to the end of the vehicle stop in the list 403, the end point candidate 404 can be extracted based on at least one of the trajectory point item 401 corresponding to the start time of the vehicle stop and the trajectory point item 401 corresponding to the end time of the vehicle stop.

[0096] In addition, after the start point setting unit 313 sets any one of the trajectory point items 401 as the start point 402, it accepts the correction of the start point 402 to other trajectory point items 401 in units of the first time interval and sets it as the new start point 402. The end point candidate display unit 314 extracts again, as end point candidates 404, a plurality of trajectory point items 401 representing positions at each time separated by the second time interval from the time related to the new start point 402, and displays them in a selectable state. By doing so, it is possible to reduce the labor of considering the trajectory point item 401 to be set as the end point 408 compared to the trajectory point item 401 to be set as the start point 402. Furthermore, when the start point 402 is corrected, since the end point candidates 404 are extracted again in units of the second time interval, it is possible to reduce the labor of considering the trajectory point item 401 to be selected while finely adjusting the specified section. Therefore, it is possible to finely adjust the section when specifying the section for video acquisition from among the movement trajectories of the objects displayed on the map, reduce the labor for the adjustment, and improve the usability.

[0097] In addition, the end point candidate display unit 314 can set the second time interval based on at least one of the object information 600 indicating the information of the vehicle corresponding to the trajectory point item 401 and the surrounding information 700 indicating the situation around the object corresponding to the trajectory point item 401. By doing so, the second time interval can be dynamically changed according to the state of the object corresponding to the trajectory point item 401 and the situation around the object corresponding to the trajectory point item 401.

[0098] Also, when the object information 600 is the vehicle speed information, the destination candidate display unit 314 can set the second time interval smaller as the vehicle speed is higher, and set the second time interval larger as the vehicle speed is lower. By doing so, for example, when acquiring an image while the vehicle is traveling at high speed on a highway, it is possible to prevent the information obtained from the acquired image from becoming too much. Also, for example, when acquiring an image while the vehicle is traveling at low speed on a general road, it is possible to prevent the information obtained from the acquired image from becoming too little. Also, by doing so, it is possible to suppress the situation where a plurality of destination candidates 404 are too far apart or too close to each other.

[0099] Also, when the surrounding information 700 is the traffic jam situation information, the destination candidate display unit 314 can set the second time interval larger when the traffic jam situation information is obtained compared to when the traffic jam situation information is not obtained. By doing so, when acquiring an image in a situation where it is difficult for the vehicle to move forward in the traveling direction due to a traffic jam, it is possible to prevent the information obtained from the acquired image from becoming too little.

[0100] Also, when there are a plurality of destination candidates 404 within a predetermined range, the destination candidate display unit 314 displays an identification mark 405 indicating that there are a plurality of destination candidates 404. By doing so, even when the destination candidates 404 extracted based on the starting point 402 are difficult to recognize or select, such as being dense or overlapping, the situation can be easily confirmed by checking the identification mark 405. Therefore, when there are a plurality of other trajectory point item 401 candidates within a predetermined range that are extracted based on the selected one trajectory point item 401, the recognition and selection of the trajectory point item 401 candidates can be easily performed.

[0101] In addition, when there are a plurality of end point candidates 404 within a predetermined range, the end point candidate display unit 314 can display an identification mark 405 instead of the display made when there are no plurality of end point candidates 404 within the predetermined range for the plurality of end point candidates 404. By doing so, when there are a plurality of end point candidates 404 within the predetermined range, instead of the display made when there are no plurality of end point candidates 404 within the predetermined range, that is, instead of the normal display, the identification mark 405 can be displayed, so that the presence of a plurality of end point candidates 404 can be emphasized, and the visibility of the user can be improved.

[0102] In addition, the identification mark 405 can be provided so as to be able to distinguish a first state 4011, a second state 4012, and a third state 4013 based on the configuration of a plurality of trajectory point items 401 existing within a predetermined range. By doing so, even without examining the type of the end point candidate 404 on which the identification mark 405 is displayed, it is possible to confirm which end point candidates 404 are concentrated or overlapping within the predetermined range only by checking the state of the identification mark 405. Therefore, the labor of consideration when selecting the end point 408 can be reduced.

[0103] In addition, when there are a plurality of end point candidates 404 within a predetermined range when accepting any selection among the end point candidates 404, the section setting unit 315 can display the plurality of end point candidates 404 as a list 403 in a selectable state. By doing so, while checking the list 403, the end point 408 can be selected. Therefore, when there are a plurality of other trajectory point item 401 candidates extracted based on the selected one trajectory point item 401 within the predetermined range, the recognition and selection of the trajectory point item 401 candidates can be easily performed.

[0104] In addition, since the identification mark 405 is provided so as to be able to distinguish the number of end point candidates 404 existing within a predetermined range, the number of end point candidates 404 existing within the predetermined range becomes clear, and the number of end point candidates 404 can be easily confirmed.

[0105] In addition, when there are a plurality of end point candidates 404 within a predetermined range when any selection among the end point candidates 404 is received, the section setting unit 315 displays the plurality of end point candidates 404 as a list in a selectable state. The identification mark 405 can be provided so as to be able to identify the above-described first state 4011, second state 4012, and third state 4013 based on the configuration of the plurality of trajectory point items 401 existing within the predetermined range when the list is displayed. By doing so, when the list 403 is displayed, the first state 4011, second state 4012, and third state 4013 of the identification mark 405 can be identified.

[0106] In addition, the identification mark 405 is provided to include a candidate number mark 406 capable of identifying the number of end point candidates 404 existing within a predetermined range. The end point candidate display unit 313 can display the candidate number mark 406 when there are a plurality of end point candidates 404 within a predetermined range. For this reason, the number of end point candidates 404 existing within a predetermined range becomes clear, and the number of end point candidates 404 can be easily confirmed. In this case, since only the candidate number mark 406 can be displayed as the identification mark 405, it is possible to suppress an excessive increase in the number of marks displayed on the map.

[0107] In addition, the end point candidate display unit 314 extracts a plurality of trajectory point items 401 representing the positions of the vehicle at each time separated by a predetermined time interval from the time related to the set start point 402 as end point candidates 404 and displays them in a selectable state. At the time of the display, a time interval mark 407 indicating how much time each end point candidate 404 is separated from the time related to the start point 402 can be displayed. By doing so, it becomes clear how much time each end point candidate 404 is separated from the time related to the start point 402, so that the labor of consideration when selecting the end point 408 can be reduced.

[0108] Note that the present invention is not limited to the above embodiments. That is, those skilled in the art can implement various modifications in accordance with conventionally known knowledge without departing from the gist of the present invention. As long as the display device of the present invention is still provided by such modifications, it is of course included in the scope of the present invention.

Explanation of Signs

[0109] 300 Server device (display device) 400 Management terminal (display device) 313 Start point setting unit (first selection point setting unit) 314 End point candidate display unit (second selection point candidate display unit) 315 Section setting unit 401 Locus point item (item) 402 Start point (first selection point) 403 List 404 End point candidate (second selection point candidate) 405 Identification mark 408 End point (second selection point) 409 Designated section

Claims

1. A display device that displays on a map, as a trajectory of an object, items representing the position of the object at each first time interval, a first selection point setting unit that accepts any selection among the items and sets it as a first selection point; a second selection point candidate display unit that extracts, as second selection point candidates, a plurality of the items representing the position of the object at each time separated by a second time interval longer than the first time interval from the time related to the set first selection point, and displays them in a selectable state; a section setting unit that accepts any selection among the second selection point candidates, sets the item related to the selected second selection point candidate as a second selection point, and sets, as a designated section, a section determined by the item set as the first selection point and the item set as the second selection point, and after the first selection point setting unit sets any of the items as the first selection point, it accepts correction of the first selection point to other items in units of the first time interval and sets it as a new first selection point, wherein the second selection point candidate display unit extracts again, as second selection point candidates, a plurality of the items representing the position at each time separated by the second time interval from the time related to the new first selection point, and displays them in a selectable state. The display device is characterized by this.

2. The display device according to claim 1, wherein the second selection point candidate display unit sets the second time interval based on at least one of object information indicating information of the object corresponding to the item and surrounding information indicating the situation around the object corresponding to the item.

3. The object information is information on the speed of the object, The display device according to claim 2, wherein the second selection point candidate display unit sets the second time interval to be smaller as the traveling speed of the object is faster, and sets the second time interval to be larger as the traveling speed of the object is slower.

4. The surrounding information is information on the traffic jam situation, The display device according to claim 2, wherein the second selection point candidate display unit sets the second time interval to be larger when the information on the traffic jam situation is obtained, compared to when the information on the traffic jam situation is not obtained.

5. An information processing method executed by a computer, a trajectory point display step of displaying items representing positions of the object for each first time interval on a map as a trajectory of the object; a first selection point setting step of accepting a selection of any one of the items and setting the selection as a first selection point; a second selection point candidate display step of extracting, as second selection point candidates, a plurality of items that represent the positions of the object at each time interval that is separated from a time related to the set first selection point by a second time interval that is longer than the first time interval, and displaying the items in a selectable state; a section setting step of accepting a selection of any one of the second selection point candidates, setting the item related to the selected second selection point candidate as a second selection point, and setting a section defined by the item set as the first selection point and the item set as the second selection point as a designated section, This information processing method is characterized in that, in the section setting process, after setting the specified section, modifications to the first selection point for other items are accepted in units of the first time interval, and set as a new first selection point, and a plurality of items representing time positions separated by units of the second time interval from the time related to the new first selection point are re-extracted as second selection point candidates, and displayed in a selectable state.

6. 6. An information processing program for causing a computer to execute the information processing method according to claim 5.

7. 7. A computer-readable storage medium storing the information processing program according to claim 6.

Images