Application method, device and equipment for turning over pedal of disabled person in full-intelligent mode and medium

Abstract

The invention provides an application method, device, equipment and medium for turning over pedals for the disabled in a full-intelligent mode, the application method is applied to a bus, and the method comprises the steps that a scene image of a get-on door of a current station of the bus is obtained; wheelchair identification is performed based on the scene image to obtain an identification result; if the recognition result is that the scene image comprises the wheelchair, determining the type of the wheelchair and the height of a user corresponding to the wheelchair based on the scene image; determining whether a predetermined pedal appointment use information summary contains the pedal appointment use information of the category and the height or not; if the pedal appointment use information contains the pedal appointment use information of the category and the height, performing face recognition on the user to obtain a face recognition result; determining a pedal adjustment mode based on the face recognition result; and adjusting the pedal based on the pedal adjusting mode. In the mode, the pedal adjusting mode is determined according to the type of the wheelchair, the height of the wheelchair user and the pedal appointment use information, so that different requirements are met, and the user experience is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of pedal control, and in particular to an application method, device, equipment and medium for a fully intelligent flip pedal for disabled persons. Background Art

[0002] At present, disabled pedals are mainly used in urban buses to facilitate disabled people to get on and off the bus. There are two main types of disabled pedals. One is a manual disabled pedal, which mainly relies on manpower to flip out the disabled pedal at the door of the bus for disabled people to get on and off the bus; the other is an automatic disabled pedal, which can automatically open or close the disabled pedal for disabled people to get on and off the bus.

[0003] However, with the increasing development and popularization of driverless technology for on-board vehicles, driverless buses will become common in urban buses with relatively stable routes and regular operating times in the near future. At this time, the manual disabled pedal will lose its original value and will be gradually replaced by automatic disabled pedals. However, in the application of automatic disabled pedals in related technologies, after detecting a wheelchair, the preset pedal will be flipped, which cannot meet the needs of different types of wheelchairs and different users, greatly reducing the user experience. Summary of the invention

[0004] In view of this, the purpose of the present invention is to provide an application method, device, equipment and medium for a fully intelligent flip pedal for the disabled, which determines the pedal adjustment method according to the type of wheelchair, the height of the wheelchair user, and the pedal reservation usage information, thereby meeting different needs and improving the user experience.

[0005] In the first aspect, an embodiment of the present invention provides an application method, device, equipment and medium for a fully intelligent flip pedal for the disabled, which is applied in a bus, and the method includes: obtaining a scene image of the boarding door at the current bus stop; performing wheelchair recognition based on the scene image to obtain a recognition result; if the recognition result is that the scene image includes a wheelchair, determining the category of the wheelchair and the height of the user corresponding to the wheelchair based on the scene image; determining whether a predetermined pedal reservation use information summary includes pedal reservation use information of category and height; if the pedal reservation use information includes category and height, performing face recognition on the user to obtain a face recognition result; determining a pedal adjustment method based on the face recognition result; and adjusting the pedal based on the pedal adjustment method.

[0006] In a preferred embodiment of the present invention, the above-mentioned determination of the pedal adjustment method based on the face recognition result includes: if the face recognition result is that the user's face is consistent with the face of the reserved user in the pedal reservation usage information, then calling the user's reserved pedal information based on the pedal reservation usage information; and determining the pedal adjustment method based on the reserved pedal information.

[0007] In a preferred embodiment of the present invention, the above-mentioned determination of the pedal adjustment method based on the face recognition result also includes: if the face recognition result is that the user's face is inconsistent with the face of the reserved user in the pedal reservation usage information, then determining the pedal adjustment type based on the category; determining the pedal adjustment angle based on the height; and using the pedal adjustment type and the pedal adjustment angle as the pedal adjustment method.

[0008] In a preferred embodiment of the present invention, the method also includes: determining whether the reservation site in the reservation usage information of the reserved user is the current site; if the reservation site is not the current site, determining the order of the reservation site and the current site; if the current site is before the reservation site, determining the current shift time of the current site based on the predetermined site shift summary; determining whether the difference between the current shift time and the reservation shift time corresponding to the reservation site meets the preset boarding time threshold; if the difference does not meet the boarding time threshold, deleting the reservation usage information of the reserved user from the pedal reservation usage information summary of the day.

[0009] In a preferred embodiment of the present invention, before determining the pedal adjustment type based on the category, the method also includes: obtaining voice information within the range of the upper door; identifying whether the voice information contains pedal adjustment method information; if the voice information contains pedal adjustment method information, determining the pedal adjustment method based on the pedal adjustment method information.

[0010] In a preferred embodiment of the present invention, before determining the pedal adjustment type based on the category, the method also includes: obtaining gesture information within the range of the upper door; identifying whether the gesture information contains pedal control information; if the gesture information contains pedal control information, determining the pedal adjustment method based on the pedal control information.

[0011] In a preferred embodiment of the present invention, the pedal is adjusted based on the pedal adjustment method, including: determining the adjustment angle and adjustment direction of the pedal based on the pedal adjustment method; determining a first time for adjusting the angle and a second time for adjusting the direction based on the scene image; adjusting the angle of the pedal after the first time, and adjusting the direction of the pedal after the second time.

[0012] In a second aspect, an embodiment of the present invention further provides an application device for a fully intelligent flip pedal for the disabled, which is applied in a bus, and the device includes: a scene image acquisition module, which is used to obtain a scene image of the boarding door at the current stop of the bus; a wheelchair recognition module, which performs wheelchair recognition based on the scene image to obtain a recognition result; a category and height determination module, which is used to determine the category of the wheelchair and the height of the user corresponding to the wheelchair based on the scene image if the recognition result is that the scene image includes a wheelchair; a judgment module, which is used to determine whether the pedal reservation use information of the category and height is included in the predetermined pedal reservation use information summary; a face recognition module, which is used to perform face recognition on the user to obtain a face recognition result if the pedal reservation use information of the category and height is included; a pedal adjustment mode determination module, which is used to determine the pedal adjustment mode based on the face recognition result; and a pedal adjustment module, which is used to adjust the pedal based on the pedal adjustment mode.

[0013] In a third aspect, an embodiment of the present invention further provides an electronic device, including a processor and a memory, wherein the memory stores computer executable instructions that can be executed by the processor, and the processor executes the computer executable instructions to implement the application method of the fully intelligent flip pedal for the disabled of the first aspect mentioned above.

[0014] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are called and executed by a processor, the computer-executable instructions prompt the processor to implement the application method of the fully intelligent flip pedal for the disabled according to the first aspect mentioned above.

[0015] The embodiments of the present invention bring the following beneficial effects:

[0016] The embodiment of the present invention provides an application method, device, equipment and medium for a fully intelligent flip pedal for the disabled, which is applied in a bus, by obtaining a scene image of the boarding door at the current stop of the bus, performing wheelchair recognition based on the scene image to obtain a recognition result, if the recognition result is that the scene image includes a wheelchair, then determining the category of the wheelchair and the height of the user corresponding to the wheelchair based on the scene image, determining whether the pedal reservation use information of the category and height is included in the predetermined pedal reservation use information summary, if the pedal reservation use information of the category and height is included, performing face recognition on the user to obtain a face recognition result, determining a pedal adjustment method based on the face recognition result, and adjusting the pedal based on the pedal adjustment method. In this method, the pedal adjustment method is determined by the category of the wheelchair, the height of the wheelchair user, and the pedal reservation use information, thereby meeting different needs and improving the user experience.

[0017] Other features and advantages of the present disclosure will be set forth in the following description, or some features and advantages may be inferred or unambiguously determined from the description, or may be learned by implementing the above-mentioned technology of the present disclosure.

[0018] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0020] Figure 1 A flow chart of an application method of a fully intelligent flip pedal for a disabled person provided by an embodiment of the present invention;

[0021] Figure 2 A flowchart of another application method of a fully intelligent flip pedal for a disabled person provided by an embodiment of the present invention;

[0022] Figure 3 A schematic diagram of the structure of an application device for a fully intelligent flip pedal for a disabled person provided by an embodiment of the present invention;

[0023] Figure 4 A schematic structural diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0024] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0025] At present, disabled pedals are mainly used in urban buses to facilitate disabled people to get on and off the bus. There are two main types of disabled pedals. One is a manual disabled pedal, which mainly relies on manpower to flip out the disabled pedal at the door of the bus for disabled people to get on and off the bus; the other is an automatic disabled pedal, which can automatically open or close the disabled pedal for disabled people to get on and off the bus.

[0026] However, with the increasing development and popularization of driverless technology for on-board vehicles, driverless buses will become common in urban buses with relatively stable routes and regular operating times in the near future. At this time, the manual disabled pedal will lose its original value and will be gradually replaced by automatic disabled pedals. However, in the application of automatic disabled pedals in related technologies, after detecting a wheelchair, the preset pedal will be flipped, which cannot meet the needs of different types of wheelchairs and different users, greatly reducing the user experience.

[0027] Based on this, the application method, device, equipment and medium of a fully intelligent flip pedal for the disabled provided by the embodiment of the present invention can obtain the scene image of the boarding door at the current stop of the bus, perform wheelchair recognition based on the scene image to obtain the recognition result, if the recognition result is that the scene image includes a wheelchair, then determine the category of the wheelchair and the height of the user corresponding to the wheelchair based on the scene image, determine whether the pedal reservation use information of the category and height is included in the predetermined pedal reservation use information summary, if it contains the pedal reservation use information of the category and height, then perform face recognition on the user to obtain the face recognition result, determine the pedal adjustment method based on the face recognition result, and adjust the pedal based on the pedal adjustment method. In this method, the pedal adjustment method is determined by the category of the wheelchair and the height of the wheelchair user, as well as the pedal reservation use information, so as to meet different needs and improve the user experience.

[0028] To facilitate understanding of this embodiment, first, a method for applying a fully intelligent flip pedal for the disabled disclosed in an embodiment of the present invention is introduced in detail.

[0029] Example 1

[0030] The embodiment of the present invention provides an application method of a fully intelligent flip pedal for disabled persons, which is applied in buses. Figure 1 The flowchart of the application method of a fully intelligent flip pedal for disabled persons provided by the embodiment of the present invention. Figure 1 As shown, the application method of the fully intelligent flip pedal for the disabled may include the following steps:

[0031] Step S101, obtaining a scene image of the boarding door of the current bus stop.

[0032] Among them, the scene image can be collected through an image sensor, such as a camera.

[0033] Step S102: performing wheelchair recognition based on the scene image to obtain a recognition result.

[0034] Among them, a comparison can be performed in the scene image based on a predetermined wheelchair outline to determine a recognition result, and the recognition result can include whether the scene image includes a wheelchair or whether the scene image does not include a wheelchair.

[0035] Step S103: If the recognition result is that the scene image includes a wheelchair, the type of the wheelchair and the height of the user corresponding to the wheelchair are determined based on the scene image.

[0036] Among them, the model can be trained through multiple types of wheelchair outline pictures and corresponding wheelchair category labels, as well as wheelchair trademark pictures and corresponding wheelchair category labels, so as to quickly identify the type of wheelchair through the trained model.

[0037] Among them, the height of the user can be determined by the length sensor, and specifically the leg length, upper body length, etc. of the user can be determined, so as to estimate the pedal adjustment method.

[0038] Step S104, determining whether the predetermined pedal reservation use information summary includes pedal reservation use information of category and height.

[0039] Among them, the reservation usage information summary may include multiple reservation usage information, and the reservation usage information may be the information filled in when making a pedal reservation on the application, and may include the user's height, face, reservation shift, pedal adjustment method, etc.

[0040] Step S105: If the pedal reservation use information includes the category and height, face recognition is performed on the user to obtain a face recognition result.

[0041] Among them, if the pedal reservation usage information includes category and height, it can be considered that the user may have reserved a pedal, so further face recognition is required.

[0042] Step S106, determining a pedal adjustment method based on the face recognition result.

[0043] The face recognition result may be that the user's face is consistent with the face of the user who has been reserved in the pedal reservation use information, or that the user's face is inconsistent with the face of the user who has been reserved in the pedal reservation use information.

[0044] If they are consistent, it can be determined that the user is a reserved user, and the corresponding pedal adjustment can be performed for the reserved user according to the requirements during the reservation. If they are inconsistent, the pedal adjustment method is determined based on the type of the user's wheelchair and the user's height.

[0045] Step S107, adjusting the pedal based on the pedal adjustment method.

[0046] Since there may be problems such as pedal foot pressure caused by human obstruction and incorrect pedal adjustment timing caused by insufficient light during the pedal adjustment process, adjusting the pedal based on the pedal adjustment method may include: determining the adjustment angle and adjustment direction of the pedal based on the pedal adjustment method; determining a first time for adjusting the angle and a second time for adjusting the direction based on the scene image; adjusting the angle of the pedal after the first time, and adjusting the direction of the pedal after the second time.

[0047] The motivation of the person can be predicted through scene images to make more accurate pedal adjustments.

[0048] The application method of the fully intelligent flip pedal for the disabled provided in the embodiment of the present invention can obtain the scene image of the boarding door at the current stop of the bus, perform wheelchair recognition based on the scene image to obtain the recognition result, if the recognition result is that the scene image includes a wheelchair, then determine the category of the wheelchair and the height of the user corresponding to the wheelchair based on the scene image, determine whether the pedal reservation use information of the category and height is included in the predetermined pedal reservation use information summary, if it contains the pedal reservation use information of the category and height, then perform face recognition on the user to obtain the face recognition result, determine the pedal adjustment method based on the face recognition result, and adjust the pedal based on the pedal adjustment method. In this method, the pedal adjustment method is determined by the category of the wheelchair, the height of the wheelchair user, and the pedal reservation use information, so as to meet different needs and improve the user experience.

[0049] Example 2

[0050] The embodiment of the present invention also provides another application method of fully intelligent flip pedal for disabled people; this method is implemented on the basis of the method of the above embodiment; this method focuses on describing the specific implementation method of determining the pedal adjustment method based on the face recognition result.

[0051] Figure 2 A flowchart of another fully intelligent application method for flipping a disabled pedal provided by an embodiment of the present invention, such as Figure 2 As shown, the method of determining the pedal adjustment method based on the face recognition result may include the following steps:

[0052] Step S201, determining whether the face of the user obtained by face recognition is consistent with the face of the reserved user in the pedal reservation use information.

[0053] Among them, the user's face can be compared with the faces of the users who have been reserved in the pedal reservation usage information. If the user's face is one of the faces of the users who have been reserved in at least one pedal reservation usage information, it is determined to be consistent. If the user's face is not among the faces of the users who have been reserved in at least one pedal reservation usage information, it is determined to be inconsistent.

[0054] Exemplarily, if the answer is yes, that is, the face recognition result is that the user's face is consistent with the face of the user who has been reserved in the pedal reservation usage information, then step S202 is executed; if the answer is no, that is, the face recognition result is that the user's face is inconsistent with the face of the user who has been reserved in the pedal reservation usage information, then step S204 is executed.

[0055] Step S202: calling the user's reserved pedal information based on the pedal reservation usage information.

[0056] Step S203, determining a pedal adjustment method based on the reserved pedal information.

[0057] Among them, the pedal adjustment methods may include: pedal lifting and lowering method for disabled people, pedal flipping method for disabled people, and the users who have made an appointment can adjust the angle, etc. on this basis.

[0058] Step S204, determining the pedal adjustment type based on the category.

[0059] Step S205, determining the pedal adjustment angle based on the body height.

[0060] Step S206: Using the pedal adjustment type and the pedal adjustment angle as the pedal adjustment method.

[0061] It should be noted that, without prior reservation, the pedal adjustment method is not limited to category and height, but can also be customized by the user. Therefore, before determining the pedal adjustment type based on category, the method may also include: obtaining voice information within the range of the upper door; identifying whether the voice information contains pedal adjustment method information; if the voice information contains pedal adjustment method information, determining the pedal adjustment method based on the pedal adjustment method information.

[0062] As an implementation method, before determining the pedal adjustment type based on the category, the method may also include: obtaining gesture information within the range of the upper door; identifying whether the gesture information contains pedal control information; if the gesture information contains pedal control information, determining the pedal adjustment method based on the pedal control information.

[0063] Specifically, a set of high-definition cameras or depth sensors, such as Microsoft Kinect or Leap Motion, can be installed near the pedals to capture the passenger's gestures.

[0064] Specifically, a gesture library can be developed, which contains a series of predefined gestures, such as "open", "close", "stop", etc., each gesture corresponds to a specific action of the pedal.

[0065] Specifically, a machine learning algorithm, such as a convolutional neural network or a recurrent neural network, can be used to train and recognize the captured gesture images.

[0066] Specifically, it can ensure that the algorithm can process image data captured by the camera in real time, quickly recognize gestures and respond.

[0067] Specifically, the gesture recognition system can be integrated into the pedal control module and connected to the pedal motor and the control unit via a standard communication protocol (such as CAN bus or USB).

[0068] Specifically, the control logic can be designed to ensure that the pedal will perform the corresponding action only when the system recognizes a specific gesture.

[0069] Specifically, a display screen or LED indicator light may be provided inside the vehicle to provide passengers with visual feedback of gesture operations, indicating whether the gesture is correctly recognized.

[0070] Specifically, after the gesture recognition is successful, the system may issue a sound prompt to inform the passenger that the pedal is about to move.

[0071] Specifically, in order to improve safety, a double verification mechanism can be set up, such as the passenger pressing a button at the same time as making a gesture to ensure the accuracy of the pedal action.

[0072] Specifically, when the system fails or fails to recognize gestures, the pedal should automatically enter safety mode to prevent accidental injuries.

[0073] Step S207, determining whether the reservation site in the reservation usage information of the reserved user is the current site.

[0074] Step S208: If the reserved site is not the current site, determine the order of the reserved site and the current site.

[0075] Step S209: If the current station is before the scheduled station, the current shift time of the current station is determined based on the predetermined station shift summary.

[0076] Step S210, determining whether the difference between the current shift time and the scheduled shift time corresponding to the scheduled station meets a preset boarding time threshold.

[0077] Step S211: If the difference does not meet the boarding time threshold, the reservation usage information of the reserved user is deleted from the pedal reservation usage information summary of the day.

[0078] Among them, since the reserved user may have temporary plan changes, which may result in the boarding shift being different from the reserved shift, the difference between the current shift time and the reserved shift time corresponding to the reserved station can be determined, and then it can be determined whether the reserved user has adjusted the plan or added a planned trip, thereby determining whether to delete the pedal reservation usage information.

[0079] Furthermore, after the designated bus of the user who has made a reservation arrives, if it is not detected that the user has made a reservation and has arrived at the designated bus, a phone call or text message will be made to inquire and provide assistance.

[0080] The application method of the fully intelligent flip pedal for the disabled provided in the embodiment of the present invention can customize the adjustment of the pedal in a variety of ways or adjust the pedal in an optimal way, thereby improving the user experience.

[0081] Example 3

[0082] Corresponding to the above method embodiment, the embodiment of the present invention provides an application device for a fully intelligent flip pedal for disabled persons, which is applied in buses. Figure 3 A schematic diagram of the structure of a fully intelligent application device for turning over a disabled pedal provided by an embodiment of the present invention is shown in FIG. Figure 3 As shown, the application device of the fully intelligent flip pedal for the disabled may include:

[0083] The scene image acquisition module 301 is used to acquire the scene image of the boarding door of the current bus stop.

[0084] The wheelchair recognition module 302 performs wheelchair recognition based on the scene image to obtain a recognition result.

[0085] The category and height determination module 303 is used to determine the category of the wheelchair and the height of the user corresponding to the wheelchair based on the scene image if the recognition result is that the scene image includes a wheelchair.

[0086] The judgment module 304 is used to determine whether the predetermined pedal reservation use information summary contains pedal reservation use information of category and height.

[0087] The face recognition module 305 is used to perform face recognition on the user to obtain a face recognition result if the pedal reservation use information includes category and height.

[0088] The pedal adjustment mode determination module 306 is used to determine the pedal adjustment mode based on the face recognition result.

[0089] The pedal adjustment module 307 is used to adjust the pedal based on the pedal adjustment mode.

[0090] The fully intelligent application device for flipping the pedal for the disabled provided by the embodiment of the present invention can obtain the scene image of the boarding door at the current stop of the bus, perform wheelchair recognition based on the scene image to obtain the recognition result, if the recognition result is that the scene image includes a wheelchair, then determine the category of the wheelchair and the height of the user corresponding to the wheelchair based on the scene image, determine whether the pedal reservation use information of the category and height is included in the predetermined pedal reservation use information summary, if it contains the pedal reservation use information of the category and height, then perform face recognition on the user to obtain the face recognition result, determine the pedal adjustment method based on the face recognition result, and adjust the pedal based on the pedal adjustment method. In this method, the pedal adjustment method is determined by the category of the wheelchair and the height of the wheelchair user, as well as the pedal reservation use information, so as to meet different needs and improve the user experience.

[0091] In some embodiments, the pedal adjustment method determination module is also used to call the user's reserved pedal information based on the pedal reservation usage information if the face recognition result is that the user's face is consistent with the face of the reserved user in the pedal reservation usage information; and determine the pedal adjustment method based on the reserved pedal information.

[0092] In some embodiments, the pedal adjustment method determination module is also used to determine the pedal adjustment type based on the category if the face recognition result shows that the user's face is inconsistent with the face of the reserved user in the pedal reservation usage information; determine the pedal adjustment angle based on the height; and use the pedal adjustment type and the pedal adjustment angle as the pedal adjustment method.

[0093] In some embodiments, the pedal adjustment mode determination module is also used to determine whether the reservation site in the reservation usage information of the reserved user is the current site; if the reservation site is not the current site, determine the order of the reservation site and the current site; if the current site is before the reservation site, determine the current shift time of the current site based on the predetermined site shift summary; determine whether the difference between the current shift time and the reservation shift time corresponding to the reservation site meets the pre-set ride time threshold; if the difference does not meet the ride time threshold, delete the reservation usage information of the reserved user from the pedal reservation usage information summary of the day.

[0094] In some embodiments, the pedal adjustment method determination module is also used to obtain voice information within the range of the upper door; identify whether the voice information contains pedal adjustment method information; if the voice information contains pedal adjustment method information, determine the pedal adjustment method based on the pedal adjustment method information.

[0095] In some embodiments, the pedal adjustment method determination module is also used to obtain gesture information within the range of the upper door; identify whether the gesture information contains pedal control information; if the gesture information contains pedal control information, determine the pedal adjustment method based on the pedal control information.

[0096] In some embodiments, the pedal adjustment module is also used to determine the adjustment angle and adjustment direction of the pedal based on the pedal adjustment method; determine the first time for adjusting the angle and the second time for adjusting the direction based on the scene image; adjust the angle of the pedal after the first time, and adjust the direction of the pedal after the second time.

[0097] The device provided in the embodiment of the present invention has the same implementation principle and technical effects as those of the aforementioned method embodiment. For the sake of brief description, for matters not mentioned in the device embodiment, reference may be made to the corresponding contents in the aforementioned method embodiment.

[0098] Example 4

[0099] The embodiment of the present invention also provides an electronic device for running the above-mentioned fully intelligent application method of flipping the disabled pedal; see Figure 4 A structural schematic diagram of an electronic device is shown, which includes a memory 400 and a processor 401, wherein the memory 400 is used to store one or more computer instructions, and the one or more computer instructions are executed by the processor 401 to realize the above-mentioned application method of the fully intelligent flip pedal for the disabled.

[0100] Further, Figure 4 The electronic device shown further includes a bus 402 and a communication interface 403 , and the processor 401 , the communication interface 403 and the memory 400 are connected via the bus 402 .

[0101] The memory 400 may include a high-speed random access memory (RAM), and may also include a non-volatile memory, such as at least one disk storage. The communication connection between the system network element and at least one other network element is realized through at least one communication interface 403 (which may be wired or wireless), and the Internet, wide area network, local area network, metropolitan area network, etc. may be used. The bus 402 may be an ISA bus, a PCI bus, or an EISA bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 4 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0102] The processor 401 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit or software instructions in the processor 401. The above processor 401 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present invention can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present invention can be directly embodied as a hardware decoding processor for execution, or a combination of hardware and software modules in the decoding processor for execution. The software module may be located in a storage medium mature in the art, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 400, and the processor 401 reads the information in the memory 400 and completes the steps of the method of the above embodiment in combination with its hardware.

[0103] An embodiment of the present invention also provides a computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are called and executed by a processor, the computer-executable instructions prompt the processor to implement the above-mentioned application method of the fully intelligent flip pedal for the disabled. The specific implementation can be found in the method embodiment, which will not be repeated here.

[0104] The computer program product of the application method of the fully intelligent flipping pedal for the disabled provided in the embodiment of the present invention includes a computer-readable storage medium storing a non-volatile program code executable by a processor. The instructions included in the program code can be used to execute the method described in the previous method embodiment. The specific implementation can be found in the method embodiment, which will not be repeated here.

[0105] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0106] In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.

[0107] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0108] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0109] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0110] Finally, it should be noted that the above-described embodiments are only specific implementations of the present invention, which are used to illustrate the technical solutions of the present invention, rather than to limit them. The protection scope of the present invention is not limited thereto. Although the present invention is described in detail with reference to the above-mentioned embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-mentioned embodiments within the technical scope disclosed by the present invention, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be based on the protection scope of the claims.

Claims

1. A fully intelligent application method for turning over a disabled pedal, characterized in that: Applied in a bus, the method comprises: Acquire a scene image of the boarding door of the bus at the current stop; Performing wheelchair recognition based on the scene image to obtain a recognition result; If the recognition result is that the scene image includes a wheelchair, determining the type of the wheelchair and the height of the user corresponding to the wheelchair based on the scene image; determining whether the pedal reservation use information of the category and the height is included in the predetermined pedal reservation use information summary; If the pedal reservation use information includes the category and the height, performing face recognition on the user to obtain a face recognition result; Determining a pedal adjustment method based on the face recognition result; The pedal is adjusted based on the pedal adjustment method.

2. The method according to claim 1, characterized in that The determining of the pedal adjustment method based on the face recognition result includes: If the face recognition result is that the face of the user is consistent with the face of the reserved user in the pedal reservation use information, calling the user's reserved pedal information based on the pedal reservation use information; A pedal adjustment method is determined based on the reserved pedal information.

3. The method according to claim 2, characterized in that The step of determining the pedal adjustment method based on the face recognition result further includes: If the face recognition result shows that the face of the user is inconsistent with the face of the reserved user in the pedal reservation use information, determining the pedal adjustment type based on the category; determining a pedal adjustment angle based on the height; The pedal adjustment type and the pedal adjustment angle are used as the pedal adjustment method.

4. The method according to claim 3, characterized in that The method further comprises: Determine whether the reservation site in the reservation usage information of the reserved user is the current site; If the reserved site is not the current site, determining the order of the reserved site and the current site; If the current station is before the scheduled station, determining the current shift time of the current station based on a pre-determined station shift summary; Determine whether the difference between the current shift time and the scheduled shift time corresponding to the scheduled station meets a preset boarding time threshold; If the difference does not meet the boarding time threshold, the reservation usage information of the reserved user is deleted from the pedal reservation usage information summary of the day.

5. The method according to claim 3, characterized in that: Before determining the pedal adjustment type based on the category, the method further includes: Acquiring voice information within the range of the boarding door; Identifying whether the voice information contains pedal adjustment method information; If the voice information includes pedal adjustment method information, the pedal adjustment method is determined based on the pedal adjustment method information.

6. The method according to claim 3, characterized in that Before determining the pedal adjustment type based on the category, the method further includes: Acquiring gesture information within the range of the upper door; Identifying whether the gesture information includes pedal control information; If the gesture information includes pedal control information, a pedal adjustment method is determined based on the pedal control information.

7. The method according to claim 1, characterized in that The step of adjusting the pedal based on the pedal adjustment method includes: Determining an adjustment angle and an adjustment direction of the pedal based on the pedal adjustment method; Determining a first time for adjusting the angle and a second time for adjusting the direction based on the scene image; The angle of the pedal is adjusted after the first time, and the direction of the pedal is adjusted after the second time.

8. A fully intelligent application device for turning over the pedal for the disabled, characterized in that: Applied in buses, the device comprises: A scene image acquisition module, used to acquire a scene image of the boarding door at the current stop of the bus; A wheelchair recognition module, which performs wheelchair recognition based on the scene image to obtain a recognition result; a category and height determination module, configured to determine the category of the wheelchair and the height of the user corresponding to the wheelchair based on the scene image if the recognition result is that the scene image includes a wheelchair; A judgment module, used to determine whether the predetermined pedal reservation use information summary contains the pedal reservation use information of the category and the height; A face recognition module, for performing face recognition on the user to obtain a face recognition result if the pedal reservation use information includes the category and the height; A pedal adjustment mode determination module, used to determine a pedal adjustment mode based on the face recognition result; The pedal adjustment module is used to adjust the pedal based on the pedal adjustment method.

9. An electronic device, characterized in that: It comprises a processor and a memory, wherein the memory stores computer executable instructions that can be executed by the processor, and the processor executes the computer executable instructions to implement the application method of the fully intelligent flip pedal for the disabled as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions. When the computer-executable instructions are called and executed by the processor, the computer-executable instructions prompt the processor to implement the application method of the fully intelligent flip pedal for the disabled as described in any one of claims 1 to 7.

Images