Application method, device, equipment and medium for fully intelligent flip pedal for disabled persons

Abstract

The present invention provides a fully intelligent application method, device, equipment, and medium for flipping a pedal for disabled persons, which is applied to buses. The method includes: obtaining a scene image of the boarding door at the current bus stop; performing wheelchair recognition based on the scene image to obtain a recognition result; if the recognition result indicates that the scene image includes a wheelchair, determining the wheelchair type and the height of the wheelchair user based on the scene image; determining whether a predetermined pedal reservation usage information summary includes pedal reservation usage information for the type and height; if the pedal reservation usage information includes pedal reservation usage information for the type and height, performing facial recognition on the user to obtain a facial recognition result; determining a pedal adjustment method based on the facial recognition result; and adjusting the pedal based on the pedal adjustment method. In this method, the pedal adjustment method is determined based on the wheelchair type, the wheelchair user's height, and the pedal reservation usage information, thereby meeting different needs and improving the user experience.

Description

Technical Field

[0001] The present invention relates to the field of pedal control technology, and in particular to an application method, device, equipment and medium for a fully intelligent flip pedal for disabled persons. Background Art

[0002] At present, disabled pedals are mainly used in urban buses to facilitate disabled people to get on and off the bus. There are two main types of disabled pedals. One is a manual disabled pedal, which mainly relies on manpower to flip out the disabled pedal at the door of the bus for disabled people to get on and off the bus; the other is an automatic disabled pedal, which can automatically open or close the disabled pedal for disabled people to get on and off the bus.

[0003] However, with the increasing development and popularization of driverless technology for on-board vehicles, in the near future, driverless buses will become common on urban buses with relatively stable routes and regular schedules. At this time, the manual disabled pedals will lose their original value and will gradually be replaced by automatic disabled pedals. However, in the application of automatic disabled pedals in related technologies, after detecting a wheelchair, the preset pedals will be flipped, which cannot meet the needs of different types of wheelchairs and different users, greatly reducing the user experience. Summary of the Invention

[0004] In view of this, the purpose of the present invention is to provide an application method, device, equipment and medium for a fully intelligent flip pedal for the disabled, which determines the pedal adjustment method based on the type of wheelchair, the height of the wheelchair user, and the pedal reservation usage information, thereby meeting different needs and improving the user experience.

[0005] In the first aspect, an embodiment of the present invention provides an application method, device, equipment and medium for a fully intelligent flip pedal for disabled people, which is applied to a bus. The method includes: obtaining a scene image of the boarding door at the current bus stop; performing wheelchair recognition based on the scene image to obtain a recognition result; if the recognition result is that the scene image includes a wheelchair, determining the category of the wheelchair and the height of the user corresponding to the wheelchair based on the scene image; determining whether the pedal reservation use information of the category and height is included in the predetermined pedal reservation use information summary; if the pedal reservation use information of the category and height is included, performing facial recognition on the user to obtain a facial recognition result; determining a pedal adjustment method based on the facial recognition result; and adjusting the pedal based on the pedal adjustment method.

[0006] In a preferred embodiment of the present invention, the above-mentioned determination of the pedal adjustment method based on the face recognition result includes: if the face recognition result is that the user's face is consistent with the face of the reserved user in the pedal reservation usage information, then calling the user's reserved pedal information based on the pedal reservation usage information; and determining the pedal adjustment method based on the reserved pedal information.

[0007] In a preferred embodiment of the present invention, the above-mentioned determination of the pedal adjustment method based on the face recognition result also includes: if the face recognition result is that the user's face is inconsistent with the face of the reserved user in the pedal reservation usage information, then determining the pedal adjustment type based on the category; determining the pedal adjustment angle based on the height; and using the pedal adjustment type and the pedal adjustment angle as the pedal adjustment method.

[0008] In a preferred embodiment of the present invention, the method also includes: determining whether the reservation site in the reservation usage information of the reserved user is the current site; if the reservation site is not the current site, determining the order of the reservation site and the current site; if the current site is before the reservation site, determining the current shift time of the current site based on the predetermined site shift summary; determining whether the difference between the current shift time and the reservation shift time corresponding to the reservation site meets the preset boarding time threshold; if the difference does not meet the boarding time threshold, deleting the reservation usage information of the reserved user from the pedal reservation usage information summary of the day.

[0009] In a preferred embodiment of the present invention, before determining the pedal adjustment type based on the category, the method also includes: obtaining voice information within the range of the upper door; identifying whether the voice information contains pedal adjustment method information; if the voice information contains pedal adjustment method information, determining the pedal adjustment method based on the pedal adjustment method information.

[0010] In a preferred embodiment of the present invention, before determining the pedal adjustment type based on the category, the method also includes: obtaining gesture information within the range of the upper door; identifying whether the gesture information contains pedal control information; if the gesture information contains pedal control information, determining the pedal adjustment method based on the pedal control information.

[0011] In a preferred embodiment of the present invention, the pedal is adjusted based on the pedal adjustment method, including: determining the adjustment angle and adjustment direction of the pedal based on the pedal adjustment method; determining a first time for adjusting the angle and a second time for adjusting the direction based on the scene image; adjusting the angle of the pedal after the first time, and adjusting the direction of the pedal after the second time.

[0012] In a second aspect, an embodiment of the present invention further provides an application device for a fully intelligent flip-up pedal for disabled persons, which is applied in buses, and the device includes: a scene image acquisition module, for acquiring a scene image of the boarding door at the current stop of the bus; a wheelchair recognition module, for performing wheelchair recognition based on the scene image to obtain a recognition result; a category and height determination module, for determining the category of the wheelchair and the height of the user corresponding to the wheelchair based on the scene image if the recognition result is that the scene image includes a wheelchair; a judgment module, for determining whether the pedal reservation usage information of the category and height is included in the predetermined pedal reservation usage information summary; a face recognition module, for performing face recognition on the user to obtain a face recognition result if the pedal reservation usage information of the category and height is included; a pedal adjustment method determination module, for determining the pedal adjustment method based on the face recognition result; and a pedal adjustment module, for adjusting the pedal based on the pedal adjustment method.

[0013] In a third aspect, an embodiment of the present invention further provides an electronic device comprising a processor and a memory, wherein the memory stores computer-executable instructions that can be executed by the processor, and the processor executes the computer-executable instructions to implement the application method of the fully intelligent flip pedal for the disabled of the first aspect mentioned above.

[0014] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are called and executed by a processor, the computer-executable instructions prompt the processor to implement the application method of the fully intelligent flip pedal for the disabled according to the first aspect above.

[0015] The embodiments of the present invention bring the following beneficial effects:

[0016] The embodiments of the present invention provide an application method, device, equipment, and medium for a fully intelligent flip-up pedal for disabled persons, which is applied in buses. The method obtains a scene image of the boarding door at the current bus stop, performs wheelchair recognition based on the scene image, and obtains an identification result. If the recognition result shows that the scene image includes a wheelchair, the wheelchair category and the height of the wheelchair user are determined based on the scene image. A determination is made as to whether a predetermined pedal reservation usage information summary contains pedal reservation usage information for the category and height. If pedal reservation usage information for the category and height is contained, facial recognition is performed on the user to obtain a facial recognition result. A pedal adjustment method is determined based on the facial recognition result, and the pedal is adjusted based on the pedal adjustment method. In this method, the pedal adjustment method is determined based on the wheelchair category, the wheelchair user's height, and the pedal reservation usage information, thereby meeting different needs and improving the user experience.

[0017] Other features and advantages of the present disclosure will be set forth in the following description, or some features and advantages may be inferred or unambiguously determined from the description, or may be learned by practicing the above-mentioned technology of the present disclosure.

[0018] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the specific embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0020] Figure 1 A flowchart of an application method of a fully intelligent flip pedal for people with disabilities provided by an embodiment of the present invention;

[0021] Figure 2 A flowchart of another application method of a fully intelligent flip pedal for disabled persons provided by an embodiment of the present invention;

[0022] Figure 3 A schematic structural diagram of an application device for a fully intelligent flip pedal for people with disabilities provided by an embodiment of the present invention;

[0023] Figure 4 A schematic structural diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0024] To make the objectives, technical solutions, and advantages of the embodiments of the present invention more clear, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of them. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0025] At present, disabled pedals are mainly used in urban buses to facilitate disabled people to get on and off the bus. There are two main types of disabled pedals. One is a manual disabled pedal, which mainly relies on manpower to flip out the disabled pedal at the door of the bus for disabled people to get on and off the bus; the other is an automatic disabled pedal, which can automatically open or close the disabled pedal for disabled people to get on and off the bus.

[0026] However, with the increasing development and popularization of driverless technology for on-board vehicles, in the near future, driverless buses will become common on urban buses with relatively stable routes and regular schedules. At this time, the manual disabled pedals will lose their original value and will gradually be replaced by automatic disabled pedals. However, in the application of automatic disabled pedals in related technologies, after detecting a wheelchair, the preset pedals will be flipped, which cannot meet the needs of different types of wheelchairs and different users, greatly reducing the user experience.

[0027] Based on this, the embodiments of the present invention provide an application method, device, equipment, and medium for a fully intelligent flip pedal for people with disabilities. This method can obtain a scene image of the boarding door at the current bus stop, perform wheelchair recognition based on the scene image to obtain a recognition result. If the recognition result shows that the scene image includes a wheelchair, the category of the wheelchair and the height of the user corresponding to the wheelchair are determined based on the scene image. It is determined whether the pedal reservation use information of the category and height is included in the predetermined pedal reservation use information summary. If the pedal reservation use information of the category and height is included, facial recognition is performed on the user to obtain a facial recognition result. The pedal adjustment method is determined based on the facial recognition result, and the pedal is adjusted based on the pedal adjustment method. In this method, the pedal adjustment method is determined based on the wheelchair category, the height of the wheelchair user, and the pedal reservation use information, thereby meeting different needs and improving the user experience.

[0028] To facilitate understanding of this embodiment, the application method of a fully intelligent flip pedal for the disabled disclosed in an embodiment of the present invention is first introduced in detail.

[0029] Example 1

[0030] The embodiment of the present invention provides an application method of a fully intelligent flip-up disabled pedal, which is applied in buses. Figure 1 This is a flow chart of an application method of a fully intelligent flip pedal for disabled persons provided by an embodiment of the present invention. Figure 1 As shown, the application method of the fully intelligent flip pedal for the disabled may include the following steps:

[0031] Step S101: Acquire a scene image of the boarding door of the current bus stop.

[0032] Among them, the scene image can be collected through an image sensor, such as a camera.

[0033] Step S102: performing wheelchair recognition based on the scene image to obtain a recognition result.

[0034] The recognition result may be determined by comparing the wheelchair in the scene image based on a predetermined wheelchair outline. The recognition result may include whether the wheelchair is included in the scene image or not included in the scene image.

[0035] Step S103: If the recognition result is that the scene image includes a wheelchair, the type of the wheelchair and the height of the user corresponding to the wheelchair are determined based on the scene image.

[0036] Among them, the model can be trained through multiple types of wheelchair outline pictures and corresponding wheelchair category labels, as well as wheelchair trademark pictures and corresponding wheelchair category labels, so that the wheelchair type can be quickly identified through the trained model.

[0037] Among them, the user's height can be determined by the length sensor, and specifically the user's leg length, upper body length, etc. can be determined to estimate the pedal adjustment method.

[0038] Step S104: determining whether the predetermined pedal reservation use information summary includes pedal reservation use information of category and height.

[0039] Among them, the reservation usage information summary may include multiple reservation usage information, and the reservation usage information may be the information filled in when making a pedal reservation on the application, and may include the user's height, face, reservation shift, pedal adjustment method, etc.

[0040] Step S105: If the pedal reservation information includes the category and height, face recognition is performed on the user to obtain a face recognition result.

[0041] Among them, if the pedal reservation usage information includes category and height, it can be considered that the user may have reserved a pedal, so further face recognition is required.

[0042] Step S106: Determine a pedal adjustment method based on the face recognition result.

[0043] The face recognition result may be that the user's face is consistent with the face of the user who has made a reservation in the pedal reservation use information, or that the user's face is inconsistent with the face of the user who has made a reservation in the pedal reservation use information.

[0044] Among them, if they are consistent, it can be determined that the user is a reserved user, and the corresponding pedal adjustment can be performed for the reserved user according to the requirements at the time of reservation. If they are inconsistent, the pedal adjustment method is determined based on the type of the user's wheelchair and the user's height.

[0045] Step S107: Adjust the pedal based on the pedal adjustment method.

[0046] Since there may be problems such as pedal foot pressure caused by personnel obstruction and incorrect pedal adjustment timing due to insufficient light during the pedal adjustment process, adjusting the pedal based on the pedal adjustment method may include: determining the adjustment angle and adjustment direction of the pedal based on the pedal adjustment method; determining the first time for adjusting the angle and the second time for adjusting the direction based on the scene image; adjusting the angle of the pedal after the first time, and adjusting the direction of the pedal after the second time.

[0047] The person's motivation can be predicted through scene images to make more accurate pedal adjustments.

[0048] The application method of the fully intelligent flip pedal for disabled persons provided in the embodiment of the present invention can obtain a scene image of the boarding door at the current bus stop, perform wheelchair recognition based on the scene image to obtain a recognition result, and if the recognition result shows that the scene image includes a wheelchair, then determine the category of the wheelchair and the height of the user corresponding to the wheelchair based on the scene image, determine whether the pedal reservation use information of the category and height is included in the predetermined pedal reservation use information summary, and if the pedal reservation use information of the category and height is included, perform facial recognition on the user to obtain a facial recognition result, determine the pedal adjustment method based on the facial recognition result, and adjust the pedal based on the pedal adjustment method. In this method, the pedal adjustment method is determined based on the wheelchair category, the height of the wheelchair user, and the pedal reservation use information, thereby meeting different needs and improving the user experience.

[0049] Example 2

[0050] An embodiment of the present invention also provides another application method for fully intelligent flipping pedals for people with disabilities; this method is implemented based on the method of the above embodiment; this method focuses on describing the specific implementation method of determining the pedal adjustment method based on face recognition results.

[0051] Figure 2 A flowchart of another fully intelligent application method for flipping a disabled pedal provided by an embodiment of the present invention is shown as follows: Figure 2 As shown, the method of determining the pedal adjustment method based on the face recognition result may include the following steps:

[0052] Step S201 , determining whether the face of the user obtained by face recognition is consistent with the face of the reserved user in the pedal reservation information.

[0053] Among them, the user's face can be compared with the faces of the users who have been reserved in the pedal reservation usage information. If the user's face is one of the faces of the users who have been reserved in at least one pedal reservation usage information, it is determined to be consistent. If the user's face is not among the faces of the users who have been reserved in at least one pedal reservation usage information, it is determined to be inconsistent.

[0054] Exemplarily, if the answer is yes, that is, the face recognition result is that the user's face is consistent with the face of the user who has made a reservation in the pedal reservation usage information, then step S202 is executed; if the answer is no, that is, the face recognition result is that the user's face is inconsistent with the face of the user who has made a reservation in the pedal reservation usage information, then step S204 is executed.

[0055] Step S202: Retrieve the user's reserved pedal information based on the pedal reservation usage information.

[0056] Step S203: determining a pedal adjustment method based on the reserved pedal information.

[0057] Among them, the pedal adjustment methods may include: pedal lifting method for disabled people, pedal flipping method for disabled people, and users who have made reservations can adjust the angle, etc. on this basis.

[0058] Step S204: Determine the pedal adjustment type based on the category.

[0059] Step S205: Determine the pedal adjustment angle based on the height.

[0060] Step S206: Using the pedal adjustment type and the pedal adjustment angle as the pedal adjustment method.

[0061] It should be noted that, without prior reservation, the pedal adjustment method is not limited to category and height, but can also be customized by the user. Therefore, before determining the pedal adjustment type based on category, the method may also include: obtaining voice information within the range of the upper door; identifying whether the voice information contains pedal adjustment method information; if the voice information contains pedal adjustment method information, determining the pedal adjustment method based on the pedal adjustment method information.

[0062] As an implementation method, before determining the pedal adjustment type based on the category, the method may also include: obtaining gesture information within the range of the upper door; identifying whether the gesture information contains pedal control information; if the gesture information contains pedal control information, determining the pedal adjustment method based on the pedal control information.

[0063] Specifically, a set of high-definition cameras or depth sensors, such as Microsoft Kinect or Leap Motion, can be installed near the pedals to capture the passenger's gestures.

[0064] Specifically, a gesture library can be developed, which contains a series of predefined gestures, such as "open", "close", "stop", etc., each gesture corresponds to a specific action of the pedal.

[0065] Specifically, machine learning algorithms, such as convolutional neural networks or recurrent neural networks, can be used to train and recognize captured gesture images.

[0066] Specifically, it can ensure that the algorithm can process image data captured by the camera in real time, quickly recognize gestures and respond.

[0067] Specifically, the gesture recognition system can be integrated into the pedal control module and connected to the pedal motor and control unit via a standard communication protocol (such as CAN bus or USB).

[0068] Specifically, control logic can be designed to ensure that the pedal will perform the corresponding action only when the system recognizes a specific gesture.

[0069] Specifically, a display screen or LED indicator light can be set inside the vehicle to provide passengers with visual feedback of gesture operations, indicating whether the gesture is correctly recognized.

[0070] Specifically, after the gesture recognition is successful, the system may issue a sound prompt to inform the passenger that the pedal is about to move.

[0071] Specifically, in order to improve safety, a double verification mechanism can be set up, such as the passenger pressing a button at the same time as making a gesture to ensure the accuracy of the pedal action.

[0072] Specifically, when the system fails or fails to recognize gestures, the pedal should automatically enter safety mode to prevent accidental injuries.

[0073] Step S207: determining whether the reservation site in the reservation usage information of the reserved user is the current site.

[0074] Step S208: If the reserved site is not the current site, the order of the reserved site and the current site is determined.

[0075] Step S209: If the current station is before the scheduled station, the current shift time of the current station is determined based on the predetermined station shift summary.

[0076] Step S210: Determine whether the difference between the current bus time and the scheduled bus time corresponding to the scheduled stop meets a preset boarding time threshold.

[0077] Step S211: If the difference does not meet the boarding time threshold, the reservation usage information of the user who has made a reservation is deleted from the pedal reservation usage information summary of the day.

[0078] Among them, since the users who have made reservations may have temporary changes in plans, which may result in the boarding schedule being different from the reserved schedule, the difference between the current schedule time and the reserved schedule time corresponding to the reserved station can be determined, and then it can be determined whether the user who has made reservations has adjusted the plan or added a planned trip, thereby determining whether to delete the pedal reservation usage information.

[0079] Furthermore, if the user who has made a reservation arrives at the designated bus stop after the user has made the reservation and has not yet arrived to board the bus, a phone call or text message will be sent to provide assistance.

[0080] The application method of the fully intelligent flip pedal for disabled people provided by the embodiment of the present invention can customize the adjustment of the pedal in a variety of ways or adjust the pedal in an optimal way, thereby improving the user experience.

[0081] Example 3

[0082] Corresponding to the above method embodiment, the embodiment of the present invention provides an application device for a fully intelligent flip pedal for disabled persons, which is applied in buses. Figure 3 This is a schematic diagram of the structure of an application device for a fully intelligent flip pedal for people with disabilities provided by an embodiment of the present invention. Figure 3 As shown, the application device of the fully intelligent flip pedal for disabled people may include:

[0083] The scene image acquisition module 301 is used to acquire the scene image of the boarding door of the current bus stop.

[0084] The wheelchair recognition module 302 performs wheelchair recognition based on the scene image to obtain a recognition result.

[0085] The category and height determination module 303 is configured to determine the category of the wheelchair and the height of the user corresponding to the wheelchair based on the scene image if the recognition result shows that the scene image includes a wheelchair.

[0086] The judgment module 304 is used to determine whether the predetermined pedal reservation use information summary includes pedal reservation use information of category and height.

[0087] The face recognition module 305 is configured to perform face recognition on the user to obtain a face recognition result if the pedal reservation usage information includes category and height.

[0088] The pedal adjustment mode determining module 306 is configured to determine a pedal adjustment mode based on the face recognition result.

[0089] The pedal adjustment module 307 is configured to adjust the pedal based on the pedal adjustment method.

[0090] The fully intelligent flip-up pedal application device provided by the embodiment of the present invention can obtain a scene image of the boarding door at the current bus stop, perform wheelchair recognition based on the scene image to obtain a recognition result, and if the recognition result shows that the scene image includes a wheelchair, then determine the type of wheelchair and the height of the wheelchair user based on the scene image, determine whether the pedal reservation use information of the type and height is included in the predetermined pedal reservation use information summary, and if the pedal reservation use information of the type and height is included, perform facial recognition on the user to obtain a facial recognition result, determine the pedal adjustment method based on the facial recognition result, and adjust the pedal based on the pedal adjustment method. In this method, the pedal adjustment method is determined based on the wheelchair type, the wheelchair user's height, and the pedal reservation use information, thereby meeting different needs and improving the user experience.

[0091] In some embodiments, the pedal adjustment method determination module is also used to call the user's reserved pedal information based on the pedal reservation usage information if the face recognition result shows that the user's face is consistent with the face of the reserved user in the pedal reservation usage information; and determine the pedal adjustment method based on the reserved pedal information.

[0092] In some embodiments, the pedal adjustment method determination module is also used to determine the pedal adjustment type based on the category if the face recognition result shows that the user's face is inconsistent with the face of the reserved user in the pedal reservation usage information; determine the pedal adjustment angle based on the height; and use the pedal adjustment type and pedal adjustment angle as the pedal adjustment method.

[0093] In some embodiments, the pedal adjustment mode determination module is also used to determine whether the reservation site in the reservation usage information of the reserved user is the current site; if the reservation site is not the current site, the order of the reservation site and the current site is determined; if the current site is before the reservation site, the current shift time of the current site is determined based on the predetermined site shift summary; determine whether the difference between the current shift time and the reservation shift time corresponding to the reservation site meets the preset boarding time threshold; if the difference does not meet the boarding time threshold, the reservation usage information of the reserved user will be deleted from the pedal reservation usage information summary of the day.

[0094] In some embodiments, the pedal adjustment method determination module is also used to obtain voice information within the range of the upper door; identify whether the voice information contains pedal adjustment method information; if the voice information contains pedal adjustment method information, determine the pedal adjustment method based on the pedal adjustment method information.

[0095] In some embodiments, the pedal adjustment method determination module is also used to obtain gesture information within the range of the upper door; identify whether the gesture information contains pedal control information; if the gesture information contains pedal control information, determine the pedal adjustment method based on the pedal control information.

[0096] In some embodiments, the pedal adjustment module is also used to determine the adjustment angle and adjustment direction of the pedal based on the pedal adjustment method; determine the first time for adjusting the angle and the second time for adjusting the direction based on the scene image; adjust the angle of the pedal after the first time, and adjust the direction of the pedal after the second time.

[0097] The device provided in the embodiment of the present invention has the same implementation principle and technical effects as those in the aforementioned method embodiment. For the sake of brief description, for matters not mentioned in the device embodiment, reference can be made to the corresponding content in the aforementioned method embodiment.

[0098] Example 4

[0099] The embodiment of the present invention also provides an electronic device for running the above-mentioned application method of fully intelligent flip pedal for disabled people; see Figure 4 The figure shows a structural diagram of an electronic device, which includes a memory 400 and a processor 401, wherein the memory 400 is used to store one or more computer instructions, and the one or more computer instructions are executed by the processor 401 to realize the application method of the above-mentioned fully intelligent flip pedal for the disabled.

[0100] Further, Figure 4 The electronic device shown further includes a bus 402 and a communication interface 403 , and the processor 401 , the communication interface 403 and the memory 400 are connected via the bus 402 .

[0101] The memory 400 may include high-speed random access memory (RAM) and may also include non-volatile memory, such as at least one disk storage. The communication connection between the system network element and at least one other network element is achieved through at least one communication interface 403 (which may be wired or wireless), and the Internet, wide area network, local area network, metropolitan area network, etc. may be used. The bus 402 may be an ISA bus, a PCI bus, or an EISA bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 4 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or one type of bus.

[0102] The processor 401 may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed by hardware integrated logic circuits in the processor 401 or by software instructions. The above processor 401 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present invention. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in conjunction with the embodiments of the present invention can be directly implemented and executed by a hardware decoding processor, or by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium well-known in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc. The storage medium is located in memory 400, and processor 401 reads the information in memory 400 and, in conjunction with its hardware, completes the steps of the method of the aforementioned embodiment.

[0103] An embodiment of the present invention also provides a computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are called and executed by a processor, the computer-executable instructions prompt the processor to implement the above-mentioned application method of the fully intelligent flip pedal for the disabled. The specific implementation can be found in the method embodiment and will not be repeated here.

[0104] The computer program product of the application method of the fully intelligent flipping pedal for the disabled provided in the embodiment of the present invention includes a computer-readable storage medium storing non-volatile program code executable by a processor. The instructions included in the program code can be used to execute the method described in the previous method embodiment. The specific implementation can be found in the method embodiment and will not be repeated here.

[0105] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0106] In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. There may be other division methods in actual implementation. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed may be through some communication interface, indirect coupling or communication connection of devices or units, which may be electrical, mechanical or other forms.

[0107] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0108] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0109] If the functions are implemented as software functional units and sold or used as independent products, they can be stored in a processor-executable, non-volatile, computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the portion that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage media include various media capable of storing program code, such as USB flash drives, mobile hard drives, read-only memories (ROMs), random access memories (RAMs), magnetic disks, or optical disks.

[0110] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present invention, which are used to illustrate the technical solutions of the present invention, rather than to limit them. The scope of protection of the present invention is not limited thereto. Although the present invention has been described in detail with reference to the above-described embodiments, those skilled in the art should understand that any person skilled in the art can modify or easily conceive of changes to the technical solutions described in the above-described embodiments within the technical scope disclosed by the present invention, or replace some of the technical features therein with equivalents. Such modifications, changes, or replacements do not deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be based on the scope of protection of the claims.

Claims

1. A fully intelligent application method for turning over a disabled pedal, characterized in that: Applied in buses, the method includes: Acquire a scene image of the boarding door of the bus at the current stop; Performing wheelchair recognition based on the scene image to obtain a recognition result; If the recognition result is that the scene image includes a wheelchair, determining the type of the wheelchair and the height of the user corresponding to the wheelchair based on the scene image; determining whether the predetermined pedal reservation usage information summary includes pedal reservation usage information of the category and the height; If the pedal reservation use information includes the category and the height, performing facial recognition on the user to obtain a facial recognition result; determining a pedal adjustment method based on the face recognition result; Adjusting the pedal based on the pedal adjustment method; Determine whether the reservation site in the reservation usage information of the reserved user is the current site; If the reserved site is not the current site, determining the order of the reserved site and the current site; If the current station is before the scheduled station, determining the current shift time of the current station based on a predetermined station shift summary; Determine whether the difference between the current bus time and the scheduled bus time corresponding to the scheduled stop meets a preset boarding time threshold; If the difference does not meet the boarding time threshold, the reservation usage information of the reserved user is deleted from the pedal reservation usage information summary of the day.

2. The method according to claim 1, characterized in that The determining of the pedal adjustment method based on the face recognition result includes: If the face recognition result shows that the user's face is consistent with the face of the user who has made a reservation in the pedal reservation information, calling the user's reserved pedal information based on the pedal reservation information; A pedal adjustment method is determined based on the reserved pedal information.

3. The method according to claim 2, characterized in that The determining of the pedal adjustment method based on the face recognition result further includes: If the face recognition result shows that the face of the user is inconsistent with the face of the reserved user in the pedal reservation use information, determining the pedal adjustment type based on the category; determining a pedal adjustment angle based on the height; The pedal adjustment type and the pedal adjustment angle are used as the pedal adjustment method.

4. The method according to claim 3, characterized in that Before determining the pedal adjustment type based on the category, the method further includes: Acquiring voice information within the range of the boarding door; identifying whether the voice information includes pedal adjustment mode information; If the voice information includes pedal adjustment mode information, the pedal adjustment mode is determined based on the pedal adjustment mode information.

5. The method according to claim 3, characterized in that Before determining the pedal adjustment type based on the category, the method further includes: Acquiring gesture information within the range of the vehicle entrance door; identifying whether the gesture information includes pedal control information; If the gesture information includes pedal control information, a pedal adjustment method is determined based on the pedal control information.

6. The method according to claim 1, characterized in that The step of adjusting the pedal based on the pedal adjustment method includes: Determining an adjustment angle and an adjustment direction of the pedal based on the pedal adjustment method; determining a first time for adjusting the angle and a second time for adjusting the direction based on the scene image; The angle of the pedal is adjusted after the first time, and the direction of the pedal is adjusted after the second time.

7. An electronic device, characterized in that: It includes a processor and a memory, the memory stores computer-executable instructions that can be executed by the processor, and the processor executes the computer-executable instructions to implement the application method of the fully intelligent flip pedal for the disabled as described in any one of claims 1 to 6.

8. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer-executable instructions. When the computer-executable instructions are called and executed by the processor, the computer-executable instructions prompt the processor to implement the application method of the fully intelligent flip pedal for the disabled as described in any one of claims 1 to 6.

Images