Rail-mounted aged sightseeing tour management method and system

Abstract

The invention relates to the technical field of tourism management, in particular to a rail type aged sightseeing tourism management method and system. Firstly, high-angle images in a carriage are collected in real time through a camera to obtain a high-angle image sequence arranged according to the sequence of shooting moments, and the high-angle image sequence is sent to a server; the server also obtains the foot pressure values of the users collected by the pressure sensors in real time, and performs image recognition on the high-angle images to determine the head contour area values of the users in different high-angle images; the change of the head contour area value can reflect the actual body posture change condition of the user in the carriage, and the pressure borne by the feet when the user sits down is smaller than the pressure borne by the feet when the user stands, so that the server can judge whether the user is in a getting-up state currently based on the head contour area value, the foot pressure value and the high-angle image; when the user is in the getting-up state, reminding information is generated to remind a train driver to stop accelerating or decelerating.

Description

Technical Field

[0001] This invention relates to the field of tourism management technology, specifically to a track-based age-friendly sightseeing tourism management method and system. Background Technology

[0002] With the continuous development of transportation infrastructure, people's travel conditions have become more convenient and their travel modes more diverse, leading to a surge in tourism demand. More and more people are taking rail-based sightseeing tours, and the majority of these tour groups are elderly. Therefore, it is particularly important to ensure safety management during rail-based sightseeing tours to prevent problems. Summary of the Invention

[0003] The main objective of this invention is to provide a management method and system for age-friendly rail-based sightseeing tourism, aiming to solve the problem of how to conduct safety management during rail-based sightseeing tourism.

[0004] The technical solution proposed in this invention is as follows: A rail-based age-friendly sightseeing tourism management method is applied to a rail-based age-friendly sightseeing tourism management system. The system includes a management terminal, a monitoring module, and a server. The system is installed on a train. The management terminal and the monitoring module are both communicatively connected to the server. The monitoring module includes a camera installed on the ceiling inside the train carriage and a pressure sensor installed on the sole of one of the user's shoes. The method includes: The camera captures overhead images of the carriage in real time to obtain a sequence of overhead images arranged in chronological order of capture time, and sends them to the server. Each user in the carriage has an identification piece on their shoulder, and the color of the identification piece is different for different users. The overhead images are used to show the top of the head and shoulders of the users in the carriage. The server performs image recognition on each overhead image in the overhead image sequence to identify the same user in different overhead images based on the same color marker, so as to determine the head contour area value of each user in different overhead images. The pressure sensor collects the user's foot pressure value in real time and sends it to the server; The server determines whether the user is currently standing up based on the head contour area value, foot pressure value, and overhead image. If the user is currently standing up, the server generates a reminder message and sends it to the management terminal. The reminder message is used to remind the train driver to stop accelerating or decelerating.

[0005] Preferably, the sampling interval between two adjacent overhead images in the overhead image sequence is a first preset duration; the server determines whether the user is currently standing up based on the head contour area value, foot pressure value, and overhead images, including: The server performs image recognition on the overhead image to divide the interior of the carriage in the overhead image into a corridor area and a seating area. The seating area is located on both sides of the corridor area, and both the seating area and the corridor area are rectangular areas. The server calculates the average rate of change of the user's head contour area over a second preset time period, wherein the second preset time period is longer than the first preset time period. When the average rate of change of the head contour area corresponding to the user is greater than a first preset value, the server marks the user as the first target user; The server determines whether the center point of the head of the first target user has been within the seating area for the past second preset time period; If so, the server determines whether the first target user is currently standing up based on the foot pressure value of the first target user; If not, the server determines that the user to be analyzed is not currently getting up.

[0006] Preferably, the formula for calculating the average rate of change of the user's head contour area over the past second preset time period is as follows: (1), In the formula, The average rate of change of the head contour area corresponding to the user; The area of ​​the user's head outline in the i-th overhead image within the second preset time period of the overhead image sequence is 1≤i≤I, where I is the total number of overhead images included in the overhead image sequence within the second preset time period.

[0007] Preferably, the system further includes a tour guide terminal communicatively connected to the server; the server includes a storage module; the storage module stores user IDs corresponding to each user, and different user IDs correspond to different users; the storage module stores sensor IDs corresponding to each pressure sensor, and different pressure sensors correspond to different sensor IDs; the method further includes: The tour guide terminal obtains the user ID corresponding to each user from the storage module; The tour guide terminal obtains the color of the corresponding identifier block for each user, which is manually entered by the tour guide, as well as the sensor number of the pressure sensor set on each user's foot. The tour guide terminal establishes a correspondence between the color of the identifier block, the sensor number, and the user number corresponding to the same user, and sends it to the server. The server determines whether the first target user is currently standing up based on the foot pressure value of the first target user, including: The server obtains the color of the identifier block corresponding to the first target user based on the overhead image, so as to further determine the user number of the first target user; The server obtains the sensor number corresponding to the first target user based on the user number of the first target user, and arranges the foot pressure values ​​collected by the pressure sensor corresponding to the first target user in chronological order of generation time to mark them as the first pressure value sequence. The server calculates the average rate of change of the first pressure value sequence over the past second preset time period; When the average rate of change of the first pressure value sequence over the past second preset time period is greater than the second preset value, the server determines that the first target user is currently in a standing state.

[0008] Preferably, the sampling period of the pressure sensor is the first preset duration; the formula for calculating the average rate of change of the first pressure value sequence over the past second preset duration is as follows: (2), In the formula, The average rate of change of the first pressure value sequence over the past second preset time period; Let J be the j-th first pressure value in the first pressure value sequence within the past second preset time period, where 1≤j≤J, and J is the total number of first pressure values ​​included in the first pressure value sequence within the past second preset time period.

[0009] Preferably, the pressure sensor collects the user's foot pressure value in real time and sends it to the server, and then further includes: The server performs image recognition on the overhead images to divide the interior of the carriage into aisle and seating areas. The server performs image recognition on each aerial image in the aerial image sequence, and identifies the same user in different aerial images based on the same colored markers, so as to determine the center position of each user's head in different aerial images. The server determines whether the movement trajectory of the same user in the aerial image sequence meets the first preset condition: the center position of the user's head in the p-th aerial image sequence is within the seating area; the center position of the user's head in the (p+1) to (p+q)-th aerial images in the aerial image sequence is within the corridor area; the center position of the user's head in the (P+q)-th aerial image sequence is close to any short side of the corridor area; and there is no center position of the user's head in the (P+q+1)-th aerial image sequence, 1≤p≤P, where P is the total number of aerial images in the aerial image sequence that the server has received at the current time, and q is determined based on the first preset duration, and satisfies 1<p; If the first preset condition is met, the server will mark the user who meets the first preset condition as the second target user; The server determines the mobility impairment assessment level of the second target user based on the center position of the user's head in the (p+1) to (p+q)th overhead images in the overhead image sequence and the corresponding foot pressure value of the second target user. The mobility impairment assessment level is any one of high impairment, moderate impairment, and low impairment. The server marks the second target user, whose mobility impairment assessment level is high or moderate, as a key user; The server sends the user ID corresponding to the key user to the tour guide terminal.

[0010] Preferably, the server determines the mobility impairment assessment level of the second target user based on the center position of the user's head in the (p+1)th to (p+q)th overhead images in the overhead image sequence, and the corresponding foot pressure value of the second target user, including: The server obtains the line segment connecting the center position of the user's head of the second target in the (p+k)th and (p+k+1)th overhead images in the overhead image sequence, and marks it as the kth line segment. Then, it obtains the distance value between the center position of the user's head of the second target in the (p+k+1)th overhead image and the straight line containing the kth line segment, and marks it as the movement offset value corresponding to the (p+k+1)th overhead image in the overhead image sequence. Here, k starts from 1 and increments sequentially until k = q - 1. The server calculates the average value of the movement offset: (3), In the formula, This represents the average of the shifted offset values; It is the distance between the center point of the user's head in the (p+k+1)th overhead image in the overhead image sequence and the straight line containing the kth line segment. The server determines the mobility impairment assessment level of the second target user based on the average value of the movement offset and the foot pressure value corresponding to the second target user.

[0011] Preferably, the server determines the mobility impairment assessment level of the second target user based on the average value of the movement offset and the foot pressure value corresponding to the second target user, including: The server marks the generation time of the (p+1)th overhead image in the sequence of overhead images as the start time, and marks the generation time of the (p+q)th overhead image in the sequence of attached images as the end time. The server acquires the foot pressure values ​​collected by the pressure sensor corresponding to the second target user between the start time and the end time, and arranges and marks them as the second pressure value sequence according to the order of generation time. The server traverses each second pressure value in the second pressure value sequence to obtain a first special value and a second special value in the second pressure value sequence, wherein the first special value and the second special value are both 0, the second pressure value adjacent to the first special value is not 0, and the second pressure value adjacent to the second special value is not 0. The server obtains the interval between each first special value and the next adjacent second special value, and marks it as the duration of the foot lift. The server calculates the standard deviation of the duration of each foot lift and the average duration of each foot lift; When both the second and third preset conditions are met, the server determines that the second target user's mobility impairment assessment level is high impairment. The second preset condition is that the average value of the movement offset is greater than the third preset value. The third preset condition is that the ratio of the standard deviation of the duration of each foot lift to the average value of the duration of each foot lift is greater than the fourth preset value. When either the second or the third preset condition is met, the server determines that the second target user's mobility impairment assessment level is moderate. When neither the second nor the third preset condition is met, the server determines that the second target user's mobility impairment assessment level is low-level impairment.

[0012] This invention also proposes a rail-based age-friendly sightseeing tourism management system, applying a rail-based age-friendly sightseeing tourism management method; the system includes a management terminal, a monitoring module, and a server; the system is installed on a train; the management terminal and the monitoring module are both communicatively connected to the server; the monitoring module includes a camera installed on the ceiling inside the train carriage, and a pressure sensor installed on the sole of one of the user's shoes.

[0013] The above technical solution can achieve the following beneficial effects: The proposed rail-based age-friendly sightseeing tourism management method addresses the issue of safety management during rail-based sightseeing tours. This method first uses cameras to capture real-time overhead images of the train carriages, creating a sequence of images arranged chronologically by capture time, which is then sent to a server. The server also continuously monitors user foot pressure values ​​via pressure sensors. Subsequently, the server performs image recognition on the overhead images to determine the head contour area of ​​each user in different overhead images. Changes in the head contour area reflect the user's actual body posture changes within the carriage. When a user moves from their seat... During the process of standing up, because the user is closer to the camera than when sitting, the change in head outline area value in the overhead image is greater due to the principle that objects appear smaller when farther away and larger when closer. Furthermore, since the pressure on the user's feet is less when sitting than when standing, the server can determine whether the user is currently standing based on the head outline area value, foot pressure value, and the overhead image. When a user is standing, passengers on the train are prone to falling. To minimize such safety accidents, the server generates a reminder message to alert the train driver to stop accelerating or decelerating, thus greatly improving the safety of elderly passengers on the sightseeing train. Attached Figure Description

[0014] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on the structures shown in these drawings without creative effort.

[0015] Figure 1 This is a flowchart illustrating the first embodiment of a track-based age-friendly sightseeing tourism management method proposed in this invention. Figure 2 This is a schematic diagram of an overhead view image divided into seating areas and corridor areas, as presented in the second embodiment of a track-based age-friendly sightseeing tourism management method proposed in this invention. Detailed Implementation

[0016] It should be understood that the specific embodiments described herein are for illustrative purposes only and are not intended to limit the scope of the invention.

[0017] This invention proposes a track-based age-friendly sightseeing tourism management method and system.

[0018] As attached Figure 1As shown, in the first embodiment of the rail-based age-friendly sightseeing tourism management method proposed in this invention, the rail-based age-friendly sightseeing tourism management method is applied to a rail-based age-friendly sightseeing tourism management system; the system includes a management terminal, a monitoring module, and a server; the system is installed on a train; the management terminal and the monitoring module are both communicatively connected to the server; the monitoring module includes a camera installed on the top of the train carriage (located in the inner top of the middle of the carriage), and a pressure sensor installed on the sole of one of the user's shoes; this embodiment includes the following steps: Step S110: The camera captures overhead images of the carriage in real time to obtain a sequence of overhead images arranged in chronological order of capture time, and sends them to the server. Each user in the carriage has an identification tag on their shoulder, and the color of the tag is different for each user. The overhead images are used to display the top of the user's head and shoulders.

[0019] Specifically, by placing identification tags (such as Velcro patches that can be attached to the shoulder of clothing) on ​​the shoulders of users (i.e. tourists) and setting different colors for the tags of different users, the server can identify the same user in different overhead images when performing image recognition on the overhead images, thereby tracking the movement trajectory of each user separately.

[0020] Step S120: The server performs image recognition on each overhead image in the overhead image sequence to identify the same user in different overhead images based on the same color marker, so as to determine the head contour area value of each user in different overhead images.

[0021] Specifically, changes in the head contour area value can reflect changes in the user's actual body posture inside the carriage. When a user stands up from their seat, because they are closer to the camera than when they are sitting, based on the principle that things appear smaller when they are farther away and larger when they are closer, the change in the head contour area value in the overhead image is larger. Therefore, this can be used to determine whether the user is standing up.

[0022] Step S130: The pressure sensor collects the user's foot pressure value in real time and sends it to the server.

[0023] Specifically, when a user sits down, the pressure on their feet is less than when they are standing. Therefore, the pressure value on the user's feet can be used to determine whether the user is standing up.

[0024] Step S140: The server determines whether the user is currently standing up based on the head contour area value, foot pressure value, and overhead image.

[0025] Step S150: If the user is currently standing up, the server generates a reminder message and sends it to the management terminal. The reminder message is used to remind the train driver to stop accelerating or decelerating.

[0026] Specifically, when users are standing up, passengers on the train (especially elderly passengers) are more likely to fall than when they are sitting. In order to minimize such safety accidents, the server generates a reminder message to remind the train driver to stop accelerating or decelerating (i.e., maintain a constant speed).

[0027] The proposed rail-based age-friendly sightseeing tourism management method addresses the issue of safety management during rail-based sightseeing tours. This method first uses cameras to capture real-time overhead images of the train carriages, creating a sequence of images arranged chronologically by capture time, which is then sent to a server. The server also continuously monitors user foot pressure values ​​via pressure sensors. Subsequently, the server performs image recognition on the overhead images to determine the head contour area of ​​each user in different overhead images. Changes in the head contour area reflect the user's actual body posture changes within the carriage. When a user moves from their seat... During the process of standing up, because the user is closer to the camera than when sitting, the change in head outline area value in the overhead image is greater due to the principle that objects appear smaller when farther away and larger when closer. Furthermore, since the pressure on the user's feet is less when sitting than when standing, the server can determine whether the user is currently standing based on the head outline area value, foot pressure value, and the overhead image. When a user is standing, passengers on the train are prone to falling. To minimize such safety accidents, the server generates a reminder message to alert the train driver to stop accelerating or decelerating, thus greatly improving the safety of elderly passengers on the sightseeing train.

[0028] In a second embodiment of the track-based age-friendly sightseeing tourism management method proposed in this invention, based on the first embodiment, the sampling interval between two adjacent overhead images in the overhead image sequence is a first preset duration (e.g., 0.1 seconds); step S140 includes the following steps: Step S210: The server performs image recognition on the overhead image to divide the interior of the carriage in the overhead image into a corridor area and a seating area, wherein the seating area is located on both sides of the corridor area, and both the seating area and the corridor area are rectangular areas.

[0029] Specifically, a diagram showing the division of the train carriage interior into aisle and seating areas in the overhead image is attached. Figure 2 As shown.

[0030] Step S220: The server calculates the average rate of change of the user's head contour area over a second preset time period (the second preset time period is a general time for an elderly person to go from sitting to standing up, for example, 1.5 seconds), wherein the second preset time period is longer than the first preset time period.

[0031] Step S230: When the average rate of change of the head contour area corresponding to the user is greater than the first preset value, the server marks the user as the first target user.

[0032] Specifically, the average change rate of the head contour area is a pure numerical value without units; the larger the average change rate of the head contour area, the greater the change in the user's corresponding head contour area value over the past second preset time period; specifically, when the average change rate of the user's corresponding head contour area is greater than the first preset value (e.g., 0.05), it is presumed that the user is in a state of standing up (i.e., moving from sitting down to standing up), and is marked as the first target user.

[0033] Step S240: The server determines whether the center point of the head of the first target user has been within the seat area for the past second preset time period.

[0034] Specifically, the first target user needs to rule out one possible scenario before confirming that they are standing up. When the user moves within the corridor area, approaching the center of the carriage from the end, the area of ​​the user's head outline shown in the attached image gradually increases. This might meet the condition that the average rate of change of the user's head outline area is greater than the first preset value, as mentioned in the previous steps. However, in this case, the user is not actually standing up and needs to be excluded. Therefore, it is further determined whether the center point of the first target user's head has been within the seating area for the past second preset time period. Only when the head center point is within the seating area can it be further confirmed that the first target user is standing up.

[0035] If so, proceed to step S250: The server determines whether the first target user is currently standing up based on the foot pressure value of the first target user.

[0036] Specifically, to ensure the rigor and accuracy of the inference, it is necessary to further determine whether the first target user is indeed standing up based on the foot pressure value of the first target user.

[0037] If not, proceed to step S260: The server determines that the user to be analyzed is not currently getting up.

[0038] In a third embodiment of the track-based age-friendly sightseeing tourism management method proposed in this invention, based on the second embodiment, the formula for calculating the average rate of change of the user's head contour area within a past second preset time period is as follows: (1), In the formula, The average rate of change of the head contour area corresponding to the user; The area of ​​the user's head outline in the i-th overhead image within the second preset time period of the overhead image sequence is 1≤i≤I, where I is the total number of overhead images included in the overhead image sequence within the second preset time period.

[0039] Specifically, this embodiment provides a formula for calculating the average rate of change of the user's head contour area over the past second preset time period.

[0040] In a fourth embodiment of the track-based age-friendly sightseeing tourism management method proposed in this invention, based on the second embodiment, the system further includes a tour guide terminal (used by tour guides) communicatively connected to the server; the server includes a storage module (e.g., a flash memory module); the storage module stores user IDs corresponding to each user, and different users have different user IDs; the storage module stores sensor IDs corresponding to each pressure sensor, and different pressure sensors have different sensor IDs; this embodiment also includes the following steps: Step S410: The tour guide terminal obtains the user number corresponding to each user from the storage module.

[0041] Step S420: The tour guide terminal obtains the color of the corresponding identifier block for each user manually input by the tour guide, as well as the sensor number of the pressure sensor set on each user's foot.

[0042] Step S430: The tour guide terminal establishes a correspondence between the color of the identifier block, the sensor number, and the user number corresponding to the same user, and sends it to the server.

[0043] Specifically, by establishing a correspondence between the color of the marker block, the sensor number, and the user number, the server can then link the overhead images and foot pressure values ​​of the same user for calculation and analysis.

[0044] Step S250 includes the following steps: Step S440: The server obtains the color of the identifier block corresponding to the first target user based on the overhead image to further determine the user number of the first target user.

[0045] Step S450: The server obtains the sensor number corresponding to the first target user based on the user number of the first target user, and arranges the foot pressure values ​​collected by the pressure sensor corresponding to the first target user in chronological order of generation time to mark it as the first pressure value sequence.

[0046] Step S460: The server calculates the average rate of change of the first pressure value sequence over the past second preset time period.

[0047] Specifically, the sampling period for foot pressure values ​​is shorter than the second preset duration. In fact, it would be better if the sampling period for foot pressure values ​​were the same as the camera's shooting period.

[0048] Step S470: When the average rate of change of the first pressure value sequence over the past second preset time period is greater than the second preset value, the server determines that the first target user is currently in a standing state.

[0049] Specifically, during the process of standing up, the pressure value of the feet gradually increases; the average rate of change of the first pressure value sequence over the past second preset time period (a pure numerical value without units) can reflect the change of the foot pressure value of the first target user over the past second preset time period. The larger the average rate of change, the greater the increase in the foot pressure value of the first target user; therefore, when the average rate of change of the first pressure value sequence over the past second preset time period is greater than the second preset value (e.g., 1.3), the server completely determines that the first target user is currently in the standing state.

[0050] In the fifth embodiment of the track-based age-friendly sightseeing tourism management method proposed in this invention, based on the fourth embodiment, the sampling period of the pressure sensor is the first preset duration; the calculation formula for the server to calculate the average rate of change of the first pressure value sequence over the past second preset duration is: (2), In the formula, The average rate of change of the first pressure value sequence over the past second preset time period; Let J be the j-th first pressure value in the first pressure value sequence within the past second preset time period, where 1≤j≤J, and J is the total number of first pressure values ​​included in the first pressure value sequence within the past second preset time period.

[0051] Specifically, this embodiment provides a specific formula for calculating the rate of change of the first pressure value sequence over the past second preset time period.

[0052] In the sixth embodiment of the age-friendly sightseeing tourism management method proposed in this invention, based on the fourth embodiment, after step S130, the following steps are further included: Step S610: The server performs image recognition on the overhead image to divide the interior of the carriage in the overhead image into a corridor area and a seating area.

[0053] Specifically, this step is the same as step S210 in the second embodiment, and is introduced here for the purpose of subsequent analysis.

[0054] Step S620: The server performs image recognition on each overhead image in the overhead image sequence, and identifies the same user in different overhead images based on the same colored markers, so as to determine the head center position of each user in different overhead images.

[0055] Specifically, the head center point here is the geometric center point of the user's head outline area in the overhead image.

[0056] Step S630: The server determines whether the movement trajectory of the same user in the overhead image sequence meets the first preset condition: the center position of the user's head in the p-th overhead image in the overhead image sequence is within the seating area; the center position of the user's head in the (p+1) to (p+q)-th overhead images in the overhead image sequence is within the corridor area; the center position of the user's head in the (P+q)-th overhead image in the overhead image sequence is close to any short side of the corridor area; and there is no center position of the user's head in the (P+q+1)-th overhead image in the overhead image sequence, 1≤p≤P, where P is the total number of overhead images in the overhead image sequence that the server has received at the current time, and q is determined based on the first preset duration, and satisfies 1<p.

[0057] Specifically, the purpose of this embodiment is to determine whether a user is physically healthy by observing the walking path of a user walking in a corridor in an overhead image and the changes in foot pressure during the walking process (in this embodiment, the physical disability assessment level is used for evaluation). Therefore, in step S630, it is necessary to first select users who have walked in the corridor (i.e., those who meet the first preset condition) and mark the second target user.

[0058] Specifically, for a user who walks through the corridor (e.g., gets up from their seat and walks to the toilet area outside the carriage), it is presumed that: in the p-th overhead image sequence, the center point of the user's head is within the seating area (i.e., in the p-th overhead image, the user has just stood up and is preparing to enter the corridor area, and their head is still within the seating area), and in the (p+1) to (p+q)-th overhead images in the overhead image sequence, the center point of the user's head is within the corridor area (during this period, the user walks in the corridor; in this embodiment, it is assumed that the duration of the user's walk in the corridor area is...). If the sampling period is 5 seconds, then based on the overhead image sampling period, the value of q can be obtained as 50, meaning that there are 50 overhead images in the overhead image sequence that represent the user walking in the corridor area. When the user finally leaves the corridor area and enters the external area of ​​the carriage, the center position of the user's head can no longer be seen in the attached image. Therefore, the center position of the user's head does not exist in the P+q+1th overhead image in the overhead image sequence. The above is the whole process of verifying the first preset condition, thereby presuming that the user who meets the first preset condition is the user who has walked in the corridor area and is marked as the second target user.

[0059] Step S640: If the first preset condition is met, the server marks the user who meets the first preset condition as the second target user.

[0060] Step S650: The server determines the mobility impairment assessment level of the second target user based on the center position of the user's head in the (p+1) to (p+q)th overhead images in the overhead image sequence and the corresponding foot pressure value of the second target user. The mobility impairment assessment level is any one of high impairment, moderate impairment, and low impairment.

[0061] Specifically, the changes in the center position of the second target user's head in the (p+1) to (p+q) images of the overhead image sequence can reflect whether the second target user is walking steadily in the corridor area and whether the corresponding foot pressure value of the second target user is stable. Therefore, the mobility impairment assessment level of the second target user can be determined based on the above two data.

[0062] Step S660: The server marks the second target user, whose mobility impairment assessment level is high or moderate, as a key user.

[0063] Step S670: The server sends the user ID corresponding to the key user to the tour guide terminal.

[0064] Specifically, because key users are assessed as having high or moderate mobility impairments, they are more prone to falls on trains and therefore require special supervision from tour guides.

[0065] In the seventh embodiment of the age-friendly sightseeing tourism management method proposed in this invention, based on the sixth embodiment, step S650 includes the following steps: Step S710: The server obtains the line segment connecting the center position point of the user's head of the second target in the (p+k)th and (p+k+1)th overhead images in the overhead image sequence, and marks it as the kth line segment. Then, it obtains the distance value between the center position point of the user's head of the second target in the (p+k+2)th overhead image in the overhead image sequence and the straight line containing the kth line segment, and marks it as the movement offset value corresponding to the (p+k+2)th overhead image in the overhead image sequence. Here, k starts from 1 and increments sequentially until k = q - 2.

[0066] Specifically, once the second target user is determined, the corresponding q value is also determined (for example, it is set to 50 in the fifth embodiment). In order to calculate the changes in the movement path of the second target user when walking in the corridor, this embodiment needs a new variable to calculate the movement offset value of each overhead image. Therefore, this embodiment introduces a new variable k, 1≤k≤q-2.

[0067] Analysis shows that the line segment connecting the center point of the user's head in the (p+k)th and (p+k+1)th overhead images in the sequence reflects the direction of the user's movement trajectory in those images. Given a stable walking posture, the deviation (expressed as distance) between the center point of the user's head in the next overhead image (the (p+k+2)th image) and the line segment containing the aforementioned continuous line segment should be small. Therefore, we can label this deviation as the movement offset value corresponding to the (p+k+2)th overhead image in the sequence. In other words, as k increases sequentially from 1 until k = q-2, we obtain q-2 (48) movement offset values. By calculating the average of these q-2 values, we can represent the overall path deviation of the user walking through the corridor. The larger the average movement offset value, the greater the path change during the user's walking, and thus the less stable their movement.

[0068] Step S720: The server calculates the average value of the movement offset: (3), In the formula, This represents the average of the shifted offset values; It represents the distance between the center point of the user's head in the (p+k+1)th overhead image in the sequence of overhead images and the straight line containing the kth line segment.

[0069] Step S730: The server determines the mobility impairment assessment level of the second target user based on the average value of the movement offset value and the foot pressure value corresponding to the second target user.

[0070] Specifically, the assessment level of the second target user's mobility impairment will be determined by taking into account the foot pressure value of the second target user.

[0071] In the eighth embodiment of the age-friendly sightseeing tourism management method proposed in this invention, based on the seventh embodiment, step S730 includes the following steps: Step S810: The server marks the generation time of the (p+1)th overhead image in the sequence of overhead images as the start time, and marks the generation time of the (p+q)th overhead image in the sequence of attached images as the end time.

[0072] Specifically, the start time here is actually the moment when the second target user begins walking in the corridor area, and the end time here is actually the moment when the second target user ends walking in the corridor area.

[0073] Step S820: The server obtains the foot pressure values ​​collected by the pressure sensor corresponding to the second target user between the start time and the end time, and arranges and marks them as the second pressure value sequence according to the order of generation time.

[0074] Step S830: The server traverses each second pressure value in the second pressure value sequence to obtain a first special value and a second special value in the second pressure value sequence, wherein the first special value and the second special value are both 0, the second pressure value adjacent to the first special value is not 0, and the second pressure value adjacent to the second special value is not 0.

[0075] Specifically, since the pressure sensor is only installed on one of the user's shoe soles, and when a person walks, their feet always alternately touch the ground, the second pressure value collected by the pressure sensor should be intermittently and continuously 0. That is, when the foot with the pressure sensor is lifted, the second pressure value collected during that time period is 0, and when the foot with the pressure sensor touches the ground, the second pressure value collected during that time period is greater than 0. Based on this, it can be known that the number of the first special value and the second special value mentioned above should both be multiple (because the user must have taken multiple steps when walking in the corridor). The first special value corresponds to the second pressure value collected at the moment when the foot is just lifted, and the second special value is the second pressure value collected at the sampling moment before the foot touches the ground. Therefore, it can be known that the interval between the first special value and the next adjacent second special value is the duration of the lifted foot's movement in the air (i.e., the duration of the lifted foot).

[0076] Step S840: The server obtains the interval between each first special value and the next adjacent second special value, and marks it as the duration of the foot lift.

[0077] Step S850: The server calculates the standard deviation of the duration of each foot lift and the average duration of each foot lift.

[0078] Specifically, when a person walks steadily, the higher the consistency of the gait rhythm, that is, the closer the duration of each foot lift should be for the second target user. Therefore, the standard deviation of each foot lift duration and the average duration of each foot lift duration can be calculated. Subsequently, the ratio of the standard deviation of each foot lift duration to the average duration of each foot lift duration can be calculated. The smaller the ratio, the closer the duration of each foot lift duration should be, thus proving that the second target user's gait is more stable. Conversely, the larger the ratio, the less stable the second target user's gait is.

[0079] Step S860: When both the second and third preset conditions are met, the server determines that the second target user's mobility impairment assessment level is high impairment. The second preset condition is that the average value of the movement offset value is greater than the third preset value (e.g., 0.03). The third preset condition is that the ratio of the standard deviation of each foot lifting duration to the average value of each foot lifting duration is greater than the fourth preset value (e.g., 0.05).

[0080] Specifically, based on the seventh embodiment, the larger the average value of the movement offset, the more unstable the second target user's walking is; based on the eighth embodiment, the larger the ratio of the standard deviation of each foot lifting duration to the average value of each foot lifting duration, the more unstable the second target user's gait is; therefore, when both the second and third preset conditions are met, the server determines the second target user's movement obstacle assessment level as high obstacle.

[0081] Step S870: When either the second preset condition or the third preset condition is met, the server determines that the second target user's mobility impairment assessment level is moderate impairment.

[0082] Step S880: When neither the second preset condition nor the third preset condition is met, the server determines that the second target user's mobility impairment assessment level is low-level impairment.

[0083] This invention also proposes a rail-based age-friendly sightseeing tourism management system, applying a rail-based age-friendly sightseeing tourism management method; the system includes a management terminal, a monitoring module, and a server; the system is installed on a train; the management terminal and the monitoring module are both communicatively connected to the server; the monitoring module includes a camera installed on the ceiling inside the train carriage, and a pressure sensor installed on the sole of one of the user's shoes.

[0084] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0085] The embodiments of the present invention have been described above with reference to the accompanying drawings. However, the present invention is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of the present invention without departing from the spirit and scope of the claims. All of these forms are within the protection scope of the present invention.

Claims

1. A track-based age-friendly sightseeing tourism management method, characterized in that, An application to a rail-based age-friendly sightseeing tourism management system; the system includes a management terminal, a monitoring module, and a server; the system is installed on a train; both the management terminal and the monitoring module are communicatively connected to the server; the monitoring module includes a camera installed on the ceiling inside the train carriage and a pressure sensor installed on the sole of one of the user's shoes; the method includes: The camera captures overhead images of the carriage in real time to obtain a sequence of overhead images arranged in chronological order of capture time, and sends them to the server. Each user in the carriage has an identification piece on their shoulder, and the color of the identification piece is different for different users. The overhead images are used to show the top of the head and shoulders of the users in the carriage. The server performs image recognition on each overhead image in the overhead image sequence to identify the same user in different overhead images based on the same color marker, so as to determine the head contour area value of each user in different overhead images. The pressure sensor collects the user's foot pressure value in real time and sends it to the server; The server determines whether the user is currently standing up based on the head contour area value, foot pressure value, and overhead image. If the user is currently standing up, the server generates a reminder message and sends it to the management terminal. The reminder message is used to remind the train driver to stop accelerating or decelerating.

2. The method for managing age-friendly sightseeing tourism based on a track, as described in claim 1, is characterized in that... The sampling interval between two adjacent overhead images in the overhead image sequence is a first preset duration; The server determines whether the user is currently standing up based on the head contour area value, foot pressure value, and overhead image, including: The server performs image recognition on the overhead image to divide the interior of the carriage in the overhead image into a corridor area and a seating area. The seating area is located on both sides of the corridor area, and both the seating area and the corridor area are rectangular areas. The server calculates the average rate of change of the user's head contour area over a second preset time period, wherein the second preset time period is longer than the first preset time period. When the average rate of change of the head contour area corresponding to the user is greater than a first preset value, the server marks the user as the first target user; The server determines whether the center point of the head of the first target user has been within the seating area for the past second preset time period; If so, the server determines whether the first target user is currently standing up based on the foot pressure value of the first target user; If not, the server determines that the user to be analyzed is not currently getting up.

3. The track-based age-friendly sightseeing tourism management method according to claim 2, characterized in that, The server calculates the average rate of change of the user's head contour area over the past second preset time period using the following formula: （1）， In the formula, The average rate of change of the head contour area corresponding to the user; The area of ​​the user's head outline in the i-th overhead image within the second preset time period of the overhead image sequence is 1≤i≤I, where I is the total number of overhead images included in the overhead image sequence within the second preset time period.

4. The track-based age-friendly sightseeing tourism management method according to claim 2, characterized in that, The system further includes a tour guide terminal communicatively connected to the server; the server includes a storage module; the storage module stores user IDs corresponding to each user, and different user IDs correspond to different users; the storage module stores sensor IDs corresponding to each pressure sensor, and different pressure sensors correspond to different sensor IDs; the method further includes: The tour guide terminal obtains the user ID corresponding to each user from the storage module; The tour guide terminal obtains the color of the corresponding identifier block for each user, which is manually entered by the tour guide, as well as the sensor number of the pressure sensor set on each user's foot. The tour guide terminal establishes a correspondence between the color of the identifier block, the sensor number, and the user number corresponding to the same user, and sends it to the server. The server determines whether the first target user is currently standing up based on the foot pressure value of the first target user, including: The server obtains the color of the identifier block corresponding to the first target user based on the overhead image, so as to further determine the user number of the first target user; The server obtains the sensor number corresponding to the first target user based on the user number of the first target user, and arranges the foot pressure values ​​collected by the pressure sensor corresponding to the first target user in chronological order of generation time to mark them as the first pressure value sequence. The server calculates the average rate of change of the first pressure value sequence over the past second preset time period; When the average rate of change of the first pressure value sequence over the past second preset time period is greater than the second preset value, the server determines that the first target user is currently in a standing state.

5. The track-based age-friendly sightseeing tourism management method according to claim 4, characterized in that, The sampling period of the pressure sensor is the first preset duration; the formula for calculating the average rate of change of the first pressure value sequence over the past second preset duration is as follows: （2）， In the formula, The average rate of change of the first pressure value sequence over the past second preset time period; Let J be the j-th first pressure value in the first pressure value sequence within the past second preset time period, where 1≤j≤J, and J is the total number of first pressure values ​​included in the first pressure value sequence within the past second preset time period.

6. The track-based age-friendly sightseeing tourism management method according to claim 4, characterized in that, The pressure sensor collects the user's foot pressure value in real time and sends it to the server. The system also includes: The server performs image recognition on the overhead images to divide the interior of the carriage into aisle and seating areas. The server performs image recognition on each aerial image in the aerial image sequence, and identifies the same user in different aerial images based on the same colored markers, so as to determine the center position of each user's head in different aerial images. The server determines whether the movement trajectory of the same user in the aerial image sequence meets the first preset condition: the center position of the user's head in the p-th aerial image sequence is within the seating area; the center position of the user's head in the (p+1) to (p+q)-th aerial images in the aerial image sequence is within the corridor area; the center position of the user's head in the (P+q)-th aerial image sequence is close to any short side of the corridor area; and there is no center position of the user's head in the (P+q+1)-th aerial image sequence, 1≤p≤P, where P is the total number of aerial images in the aerial image sequence that the server has received at the current time, and q is determined based on the first preset duration, and satisfies 1<p; If the first preset condition is met, the server will mark the user who meets the first preset condition as the second target user; The server determines the mobility impairment assessment level of the second target user based on the center position of the user's head in the (p+1) to (p+q)th overhead images in the overhead image sequence and the corresponding foot pressure value of the second target user. The mobility impairment assessment level is any one of high impairment, moderate impairment, and low impairment. The server marks the second target user, whose mobility impairment assessment level is high or moderate, as a key user; The server sends the user ID corresponding to the key user to the tour guide terminal.

7. The track-based age-friendly sightseeing tourism management method according to claim 6, characterized in that, The server determines the mobility impairment assessment level of the second target user based on the center position of the user's head in the (p+1)th to (p+q)th overhead images in the overhead image sequence, and the corresponding foot pressure value of the second target user, including: The server obtains the line segment connecting the center position of the user's head of the second target in the (p+k)th and (p+k+1)th overhead images in the overhead image sequence, and marks it as the kth line segment. Then, it obtains the distance value between the center position of the user's head of the second target in the (p+k+1)th overhead image and the straight line containing the kth line segment, and marks it as the movement offset value corresponding to the (p+k+1)th overhead image in the overhead image sequence. Here, k starts from 1 and increments sequentially until k = q - 1. The server calculates the average value of the movement offset: （3）， In the formula, This represents the average of the shifted offset values; It is the distance between the center point of the user's head in the (p+k+1)th overhead image in the overhead image sequence and the straight line containing the kth line segment. The server determines the mobility impairment assessment level of the second target user based on the average value of the movement offset and the foot pressure value corresponding to the second target user.

8. The method for managing age-friendly sightseeing tourism based on a track, as described in claim 7, is characterized in that... The server determines the mobility impairment assessment level of the second target user based on the average value of the movement offset and the foot pressure value corresponding to the second target user, including: The server marks the generation time of the (p+1)th overhead image in the sequence of overhead images as the start time, and marks the generation time of the (p+q)th overhead image in the sequence of attached images as the end time. The server acquires the foot pressure values ​​collected by the pressure sensor corresponding to the second target user between the start time and the end time, and arranges and marks them as the second pressure value sequence according to the order of generation time. The server traverses each second pressure value in the second pressure value sequence to obtain a first special value and a second special value in the second pressure value sequence, wherein the first special value and the second special value are both 0, the second pressure value adjacent to the first special value is not 0, and the second pressure value adjacent to the second special value is not 0. The server obtains the interval between each first special value and the next adjacent second special value, and marks it as the duration of the foot lift. The server calculates the standard deviation of the duration of each foot lift and the average duration of each foot lift; When both the second and third preset conditions are met, the server determines that the second target user's mobility impairment assessment level is high impairment. The second preset condition is that the average value of the movement offset is greater than the third preset value. The third preset condition is that the ratio of the standard deviation of the duration of each foot lift to the average value of the duration of each foot lift is greater than the fourth preset value. When either the second or the third preset condition is met, the server determines that the second target user's mobility impairment assessment level is moderate. When neither the second nor the third preset condition is met, the server determines that the second target user's mobility impairment assessment level is low-level impairment.

9. A track-based age-friendly sightseeing and tourism management system, characterized in that, The system employs the age-friendly sightseeing tourism management method described in any one of claims 1-8; the system includes a management terminal, a monitoring module, and a server; the system is installed on a train; the management terminal and the monitoring module are both communicatively connected to the server; the monitoring module includes a camera installed on the ceiling inside the train carriage and a pressure sensor installed on the sole of one of the user's shoes.

Images