Information processing system, information processing method, and program

An information processing system using sensors and cameras to score and compare escalator user behavior provides effective feedback for improving escalator usage manners, addressing the limitations of existing methods.

JP7704138B2Active Publication Date: 2025-07-08NEC CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2022508158
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-03-16
Filing Date
2021-02-19
Publication Date
2025-07-08
Estimated Expiration
2041-02-19

AI Technical Summary

Technical Problem

Existing methods for improving escalator usage manners, such as posters and physical enforcement, are ineffective and costly, and existing technologies for monitoring user behavior do not effectively manage the improvement status of these manners.

Method used

An information processing system that acquires user information through sensors and cameras, calculates a manner score based on predefined rules, compares past and current scores, and presents feedback to users to encourage improved behavior.

Benefits of technology

The system effectively manages and improves escalator usage manners by providing real-time feedback and incentives, enhancing user awareness and compliance.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007704138000001
    Figure 0007704138000001
  • Figure 0007704138000002
    Figure 0007704138000002
  • Figure 0007704138000003
    Figure 0007704138000003
Patent Text Reader

Abstract

The objective of the present invention is to manage the improvement status of usage manners of users. An information processing system (10) according to the present disclosure is provided with: a user information acquiring means (1) for acquiring user information related to usage manners of users; a manner score managing means (2) for calculating and accumulating manner scores corresponding to the user information; a manner score comparing means (3) for comparing a past manner score with the current manner score for each user, to generate a comparison result; and an information presenting means (4) for presenting information corresponding to the comparison result to the user.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a technology for managing the manners of users of transportation means, escalators, etc.

Background Art

[0002] In order to improve the usage manners of transportation means, escalators, etc., there is a method of prompting users by posting posters, etc., but at present, simply preaching about ethics has not been effective. Also, for example, a method of physically suppressing escalator manner violations (boarding outside, running up / running down) not only increases costs but also risks reducing boarding efficiency and causing unexpected accidents, so the possibility of adoption is small.

[0003] Patent Document 1 discloses a technique for performing escalator control based on an image processing result in order to ensure the safety of passengers using an escalator. In Patent Document 1, an image acquired by a camera is processed to detect unsteady behaviors of escalator passengers, and while alerting the passengers in case of abnormal boarding of passengers, adaptive control of the escalator is performed.

[0004] Also, Patent Document 2 discloses a technique for detecting the behavior of a user related to the manner when the user is using a service and the situation around the user, and controlling the quality of the service received by the user according to the manner points calculated according to the behavior of the user and the situation around the user.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Patent Document 2

Summary of the Invention

[0006] As described above, while there is a need to improve the usage manners of escalators and the like, simply enforcing rules has a limited effect on improving usage manners. In Patent Documents 1 and 2, although warnings are given to users according to their usage situations, the improvement status of the usage manners of customers cannot be managed.

[0007] An object of the present disclosure is to provide an information processing system, an information processing method, and a program that can manage the improvement status of the usage manners of customers in view of the above-described problems.

[0008] The information processing system according to the present disclosure includes a user information acquisition unit that acquires user information related to the usage manners of a user, a manner score management unit that calculates and accumulates a manner score according to the user information, a manner score comparison unit that compares the past manner score and the current manner score for each user and generates a comparison result, and an information presentation unit that presents information according to the comparison result to the user.

[0009] The information processing method according to the present disclosure acquires user information related to the usage manners of a user, calculates and accumulates a manner score according to the user information, compares the past manner score and the current manner score for each user, and presents information according to the comparison result to the user.

[0010] The program according to the present disclosure causes a computer to execute a process of acquiring user information related to the usage manners of a user, calculating and accumulating a manner score according to the user information, comparing the past manner score and the current manner score for each user, and presenting information according to the comparison result to the user.

[0011] According to the present disclosure, it is possible to provide an information processing system, an information processing method, and a program that can manage the improvement status of the usage manners of customers.

Brief Description of Drawings

[0012]

Figure 1

Figure 2

Figure 3

Mode for Carrying Out the Invention

[0013] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. For clarity of explanation, the following description and drawings are appropriately omitted and simplified.

[0014] The embodiment relates to a technology for managing the manners of users of transportation means, escalators, etc. FIG. 1 is a diagram representing an example of the configuration of an information processing system 10 according to the embodiment in functional blocks. As shown in FIG. 1, the information processing system 10 includes a user information acquisition means 1, a manner score management means 2, a manner score comparison means 3, and an information presentation means 4.

[0015] The user information acquisition means 1 acquires user information related to the usage manner of the user and transmits it to the manner score management means 2. The manner score management means 2 calculates and accumulates a manner score according to the user information input from the user information acquisition means 1. The manner score comparison means 3 compares the past manner score and the current manner score for each user and generates a comparison result. The generated comparison result is input to the information presentation means 4.

[0016] The information presentation means 4 presents information corresponding to the comparison result input from the manner score comparison means 3 to the user. In this way, by comparing the past and current manner scores for each user, it is possible to grasp the improvement status of the usage manner of escalators, etc., give awareness of manner improvement, and ultimately achieve manner improvement.

[0017] Next, with reference to FIG. 2, a specific example of the information processing system 10 will be described. FIG. 2 is a diagram showing an example of the configuration of the information processing system 10 according to the embodiment. Here, the information processing system 10 is assumed to manage the improvement status of the usage manners of users U who use the escalator E.

[0018] The information processing system 10 includes a camera 11, a sound sensor 12, a vibration sensor 13, a server 14, a storage device 15, and a display 16. Here, the camera 11, the sound sensor 12, and the vibration sensor 13 function as user information acquisition means 1 for acquiring user information related to the usage manners of users. Note that the user information acquisition means 1 only needs to include at least one of the camera 11, the sound sensor 12, and the vibration sensor 13, and may include other sensors such as a temperature sensor and a pressure sensor.

[0019] The camera 11, the sound sensor 12, and the vibration sensor 13 acquire the usage information of each of one or a plurality of users U. Specifically, the camera 11 photographs the user U moving using the escalator E and acquires an image. The image photographed by the camera 11 is transmitted to the server 14. Also, the sound sensor 12 collects the ambient sound including the sound emitted by the user U. The vibration sensor 13 detects the vibration of the tread plate, handrail, etc. of the escalator E caused by the movement of the user U. These sensor data are also transmitted to the server 14. Note that the installation locations of the camera 11, the sound sensor 12, and the vibration sensor 13 are not particularly limited as long as they are locations where the usage information of the user U can be acquired.

[0020] The server 14 serves as recognition means for recognizing users from the user information. For example, the server 14 can extract the characteristics of the user U (for example, the shape and position of the eyes, nose, etc.) from the image photographed by the camera and compare them with the characteristics of the users stored in advance to recognize the user. Note that the process of recognizing the user from the photographed image can also be executed by an image processing device incorporated inside the camera 11.

[0021] Server 14 grasps the position of user U from the received video, matches it with the time and position of the occurrence of noise and vibration, and grasps the behavior of each user U. In addition, server 14 refers to the manner evaluation rules stored in storage device 15, and calculates a manner score corresponding to the user information for each user U. The calculated manner score is associated with the recognized user U and stored in storage device 15.

[0022] In the manner evaluation rules, for example, when user U is standing upright on the tread of an escalator running at a constant speed and the movement of the tread and the movement of user U are in a steady state, it can be set as a plus score. On the other hand, for example, behaviors that violate manners, including prohibited behaviors such as leaning out on the handrail and bringing in items not allowed on the escalator such as baby strollers and suitcases, and dangerous behaviors such as running in reverse, running up forward, or running down forward on the tread, can be set as minus scores.

[0023] Then, server 14 compares the past manner score stored in storage device 15 with the current manner score for each user, and generates a comparison result. That is, in the embodiment, server 14 undertakes the functions of a recognition means, a manner score management means 2, and a manner score comparison means 3.

[0024] Display (digital signage) 16 is installed at a position visible to user U while using escalator E. Display 16 usually displays the video of escalator E captured by camera 11 that has been folded back by server 14.

[0025] Server 14 displays the value of the manner score from the start to the end of the use of escalator E, or a temporary prominent value, near the video of user U on display 16 at the timing immediately before or after user U gets off escalator E, when the manner score of user U is an extreme value (for example, when a prohibited behavior such as leaning out or a dangerous behavior such as running in reverse is detected), or at other predetermined timings.

[0026] In addition, the comparison result generated by the server 14 is input to the display 16. The display 16 performs an overlay process by CG to display warning information, commendation information (such as the evaluation word "GOOD!"), advice information for improving usage manners, etc., according to the comparison result, and can notify the user U himself and the surrounding users. Thereby, the user U can recognize how much the current riding manner has improved from the past riding manner.

[0027] Here, with reference to FIG. 3, the overall processing flow of the information processing system 10 will be described. FIG. 3 is a sequence diagram showing the overall processing flow of the information processing system 10. First, the camera 11, the sound sensor 12, and the vibration sensor 13 monitor the user U boarding the escalator E and acquire user information (S11). The acquired user information is transmitted to the server 14 (S12).

[0028] The server 14 analyzes the user information, refers to the manner evaluation rules stored in the storage device 15, and calculates a manner score (S13). In addition, the server 14 recognizes the user U from the user information, associates the calculated manner score with the recognized user U, and stores it in the storage device 15 (S14). Then, the calculated manner score value, warning information, commendation information, etc. corresponding to the manner score are displayed on the display 16 and presented to the user U (S15).

[0029] For example, the server 14 identifies the current position of the user U from the video input from the camera 11. Further, the server 14 identifies the relationship between the sound acquired by the sound sensor 12 and / or the vibration information acquired by the vibration sensor 13 in correspondence with the position of the user U and the positions where the sound sensor 12 and the vibration sensor 13 are installed.

[0030] Then, server 14 calculates a manner score using the manner evaluation rules stored in storage device 15. For example, server 14 determines whether the standing position on the footrest is safe, whether hands or head are not outside the escalator, whether not looking ahead, whether not running up or down at a dangerous speed, whether not running in reverse, whether not producing noise or vibration exceeding the allowable range, etc.

[0031] If the calculated manner score is extremely bad, that is, if user U significantly deviates from the boarding manner, server 14 will overlay and display warning information near the display position of user U on display 16. Also, at the timing immediately before or after user U gets off escalator E, server 14 can calculate the manner score of user U from the start to the end of use as a comprehensive score according to a predetermined rule and overlay and display it near the display position of the passengers on the display. The comprehensive score can be, for example, a score value aggregated in the form of the highest value, the lowest value, the average value, etc.

[0032] For user U with a high score exceeding a predetermined threshold, a commendation message or decoration can be sent to display 16 in CG to praise the good use of manner. Also, by further adding a speaker to information processing system 10, a commendation melody can be generated for good use of manner. Also, according to the manner score, a reward (discount, coupon distribution, etc.) can be attached to improve the motivation of user U for the improvement of the use manner.

[0033] In addition, when there are multiple users U on escalator E, the scoring of manner, the display of warning information, commendation information, etc. can be performed simultaneously and in parallel. Thereby, the behavior of user U with good manner is evaluated, and conversely, user U with bad manner is encouraged to improve. Also, for user U with bad manner, an image of potential risk and a better way of riding can be generated in CG and overlaid and displayed on display 16 to give advice on the improvement of the use manner.

[0034] Next, the case where the past manner score of the user U exists in the storage device 15 will be described. When the user information is transmitted to the server 14 (S21), the server 14 analyzes the current user information to calculate the manner score (S22). Further, the server 14 recognizes the user U from the user information and associates the calculated manner score with the recognized user U. When the user U recognized from the current user information matches the user associated with the past manner score, the server 14 compares the past manner score with the current manner score (S23).

[0035] Then, warning information, commendation information, etc. according to the comparison result are displayed on the display 16 and presented to the user U (S24). In this way, by comparing the past and current manner scores, it is possible to point out the improvement points and deterioration points from the past riding manners, give the user U an awareness of manner improvement, and ultimately achieve manner improvement.

[0036] Note that the specific hardware configuration of the information processing system 10 according to the embodiment includes various variations and is not limited to a specific configuration. For example, the device according to the present disclosure may be realized using software or may be configured to share various processes using a plurality of hardware. Each component may be configured by a single circuit (such as a processor) or may be configured by a combination of a plurality of circuits. The circuitry referred to here may be either dedicated or general-purpose.

[0037] The program according to this embodiment may be any program that causes a computer to execute the processing shown in FIG. 3. In the above example, the program can be stored using various types of non-transitory computer readable media and supplied to the computer. Non-transitory computer readable media include various types of tangible storage media. Examples of non-transitory computer readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROM (Read Only Memory), CD-R, CD-R / W, semiconductor memories (e.g., mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)). Also, the program may be supplied to the computer by various types of transitory computer readable media. Examples of transitory computer readable media include electrical signals, optical signals, and electromagnetic waves. Transitory computer readable media can supply the program to the computer via wired communication channels such as electric wires and optical fibers, or wireless communication channels.

[0038] As described above, in the embodiment, instead of forcing compliance with manners, the boarding situation of the escalator for each user U is monitored and scored by a camera or sensor and conveyed to the user U himself / herself (and surrounding users), thereby giving an awareness of manner improvement. Also, by incorporating game elements such as obtaining rewards according to the manner score, it becomes possible to improve the usage manners while having fun.

[0039] Note that the present invention is not limited to the above-described embodiments, and can be appropriately modified without departing from the spirit thereof. In the above-described embodiments, the improvement of the usage manner of the escalator is targeted. However, in principle, since it is used by a large number of users, it can be applied to those that require compliance with manners. For example, the present invention can be applied when promoting the improvement of the usage manners of transportation facilities and cafeterias.

[0040] When promoting the improvement of the driving manners of vehicles on the road, the driving status of the vehicle (for example, noises such as horns and engine sounds, waiting for signals at intersections, interruptions, high beams, etc.) can be monitored and scored. In this case, for the identification of the driver of the vehicle, the face of the driver may be recognized from the captured image. For example, the number of the vehicle number plate may be read to identify the vehicle, and the driver may be estimated.

[0041] The present invention has been described above with reference to the embodiments, but the present invention is not limited thereto. Various changes that can be understood by those skilled in the art within the scope of the invention can be made to the configuration and details of the present invention.

[0042] This application claims the priority based on Japanese Patent Application No. 2020-045223 filed on March 16, 2020, and incorporates the entire disclosure thereof herein.

Explanation of Reference Numerals

[0043] 1 User information acquisition means 2 Manners score management means 3 Manners score comparison means 4 Information presentation means 10 Information processing system 11 Camera 12 Sound sensor 13 Vibration sensor 14 Server 15 Storage device 16 Display U User E Escalator

Claims

1. User information acquisition means for acquiring user information related to the usage manners of users regarding a predetermined facility used by a plurality of users, manner score management means for calculating and accumulating a manner score corresponding to the user information, manner score comparison means for comparing the past manner score and the current manner score for each user and generating a comparison result, information presentation means for presenting information corresponding to the comparison result in a recognizable manner to a plurality of users using the facility, An information processing system comprising: An information processing system.

2. The information presentation means simultaneously presents information corresponding to the comparison results of each of the plurality of users. The information processing system according to Claim 1.

3. Further comprising recognition means for recognizing a user from the user information, The manner score management means accumulates the calculated manner score in association with the recognized user. The information processing system according to Claim 1.

4. The manner score comparison means performs a comparison between the past manner score and the current manner score when the user associated with the past manner score and the user associated with the current manner score match. The information processing system according to Claim 3.

5. The user information acquisition means includes at least one of a camera, a sound sensor, and a vibration sensor. The information processing system according to any one of Claims 1 to 4.

6. The user information acquisition means is a camera that acquires an image around the user, The recognition means recognizes a user from the image captured by the camera. The information processing system according to Claim 3 or 4.

7. The information presentation means presents at least one of warning information, commendation information, and advice information for improving the usage manner according to the comparison result. The information processing system according to any one of Claims 1 to 6.

8. A computer acquires user information related to the usage manners of users regarding a predetermined facility used by a plurality of users, calculates and accumulates a manner score corresponding to the user information, compares the past manner score and the current manner score for each user and presents information corresponding to the comparison result in a recognizable manner to a plurality of users using the facility. An information processing method.

9. Acquires user information related to the usage manners of users regarding a predetermined facility used by a plurality of users, calculates and accumulates a manner score corresponding to the user information, A program that causes a computer to execute a process of comparing the past manner score and the current manner score for each user and presenting information according to the comparison result in a recognizable manner to a plurality of users who use the facility. A program that causes a computer to execute the process.

Citation Information

Patent Citations

  • Escalator control device

    JP2009120327A

  • Driving manner cultivation device, system, and program

    JP2012150557A

  • Information processing system, information processing method and information processing program

    JP2015108854A

  • Information processing device, control method, and program

    JP2016103079A

  • Information processing device, information processing method, and information processing program

    JP2019168815A