Designated occluding object wearing detection method and related device based on human-computer interaction

Abstract

The present application provides a method and related device for detecting the wearing of designated obstructions based on human-computer interaction, wherein the method includes: receiving a designated obstruction detection request sent by a server, and generating a detection guidance interface; wherein the designated obstruction detection request is generated by the server under the condition of receiving negative evaluation information fed back by a passenger terminal; the negative evaluation information indicates that the driver is not wearing the designated obstruction; in response to the operation of the detection guidance interface, the driver's face image is sent to the server, so that the server performs designated obstruction wearing detection based on the face image. The present application triggers designated obstruction detection after the passenger feeds back negative evaluation information, and obtains the driver's face image for designated obstruction detection through interactive operation of the driver terminal, which can solve the problem of driver cheating in the prior art and achieve the effect of verifying whether the driver wears a mask throughout the entire journey.

Description

Technical Field

[0001] The present application relates to the technical field of online car-hailing, and more specifically, to a method and related device for detecting the wearing of a designated obstruction based on human-computer interaction. Background Art

[0002] At present, when it is necessary to monitor whether the driver wears a mask throughout the journey as required, the existing monitoring method is to verify by identifying the pictures uploaded by the driver. If the mask is recognized, the driver is considered to have passed the verification and can perform the vehicle dispatch task. However, under this monitoring method, it is easy for the driver to cheat, and it cannot be verified whether the driver wears a mask throughout the journey as required. Summary of the invention

[0003] In view of this, the purpose of this application is to provide a designated obstruction wearing detection method and related device based on human-computer interaction, which can perform designated obstruction spot check tasks on drivers through negative evaluation information feedback from passengers to solve the problem of driver cheating in the prior art, and achieve the effect of verifying whether the driver wears a mask throughout the entire journey.

[0004] In the first aspect, the present invention provides a designated obstruction wearing detection method based on human-computer interaction, which is applied to a driver terminal, and the method includes: when receiving a designated obstruction detection request sent by a server, generating a detection guidance interface; wherein the designated obstruction detection request is generated by the server under the condition of receiving negative evaluation information feedback from a passenger terminal; the negative evaluation information indicates that the driver is not wearing the designated obstruction; in response to the operation of the detection guidance interface, sending the driver's facial image to the server, so that the server performs designated obstruction wearing detection based on the facial image.

[0005] In the second aspect, the present application also provides a designated obstruction wearing detection method based on human-computer interaction, which is applied to a server, and the method includes: when receiving negative evaluation information sent by a passenger terminal, sending a designated obstruction detection request to a driver terminal corresponding to the negative evaluation information; the negative evaluation information indicates that the driver is not wearing a designated obstruction; receiving a facial image fed back by the driver terminal, and performing designated obstruction wearing detection based on the facial image.

[0006] In the third aspect, the present application also provides a designated obstruction wearing detection device based on human-computer interaction, including: a generation module, used to receive a designated obstruction detection request sent by a server, and generate a detection guidance interface; wherein, the designated obstruction detection request is generated by the server under the condition of receiving negative evaluation information feedback from a passenger terminal; the negative evaluation information represents that the driver is not wearing the designated obstruction; a sending module, used to send the driver's facial image to the server in response to the operation of the detection guidance interface, so that the server performs designated obstruction wearing detection based on the facial image.

[0007] In the fourth aspect, the present application also provides a designated obstruction wearing detection device based on human-computer interaction, including: a sending module, which is used to send a designated obstruction detection request to a driver terminal corresponding to the negative evaluation information when receiving negative evaluation information sent by a passenger terminal; the negative evaluation information indicates that the driver is not wearing a designated obstruction; a detection module, which is used to receive a facial image fed back by the driver terminal, and perform designated obstruction wearing detection based on the facial image.

[0008] In a fifth aspect, the present application also provides an electronic device, comprising: a processor, a storage medium and a bus, wherein the storage medium stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor communicates with the storage medium through the bus, and the processor executes the machine-readable instructions to execute the method described in the first aspect or the method described in the second aspect.

[0009] In a sixth aspect, the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the method described in the first aspect or the method described in the second aspect is executed.

[0010] In a seventh aspect, the present application further provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the method as described in the first aspect or the method as described in the second aspect is executed.

[0011] Based on any of the above aspects, the present application can achieve the following beneficial effects:

[0012] The present application provides a designated obstruction wearing detection method and related device based on human-computer interaction, wherein the method comprises: receiving a designated obstruction detection request sent by a server, and generating a detection guidance interface; wherein the designated obstruction detection request is generated by the server under the condition of receiving negative evaluation information fed back by a passenger terminal; the negative evaluation information indicates that the driver does not wear the designated obstruction; in response to the operation of the detection guidance interface, the driver's face image is sent to the server, so that the server performs designated obstruction wearing detection according to the face image. The difference from the prior art is that the prior art only detects whether the driver wears a mask in accordance with regulations through the photos uploaded by the driver before the driver leaves the car, which is prone to driver cheating. The present application triggers the server to send a designated obstruction detection request to the driver terminal through the evaluation information fed back by the passenger after the trip that the driver does not wear the designated obstruction, and then obtains the driver's face image for designated obstruction detection through the driver's interactive operation, which can solve the problem of driver cheating in the prior art and achieve the effect of verifying whether the driver wears a mask throughout the trip. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0014] Figure 1 A schematic diagram of the architecture of a designated obstruction wearing detection system provided in an embodiment of the present application is shown;

[0015] Figure 2 A flowchart of a method for detecting wearing of a designated obstruction based on human-computer interaction provided in Example 1 of the present application;

[0016] Figure 3 A schematic diagram of a human-computer interaction interface scenario provided in Example 1 of the present application;

[0017] Figure 4 This is one of the schematic diagrams of a driver terminal interaction interface scenario provided in Embodiment 1 of the present application;

[0018] Figure 5 One of the schematic flow charts of another method for detecting wearing of a designated obstruction based on human-computer interaction provided in Embodiment 1 of the present application;

[0019] Figure 6 A second schematic diagram of a driver terminal interaction interface scenario provided in the first embodiment of the present application;

[0020] Figure 7 A second schematic flow chart of another method for detecting wearing of a designated obstruction based on human-computer interaction provided in the first embodiment of the present application;

[0021] Figure 8 A third schematic diagram of a driver terminal interaction interface scenario provided in the first embodiment of the present application;

[0022] Fig. 9 A fourth schematic diagram of a driver terminal interaction interface scenario provided in the first embodiment of the present application;

[0023] Fig.10 A fifth schematic diagram of a driver terminal interaction interface scenario provided in the first embodiment of the present application;

[0024] Fig.11 A sixth schematic diagram of a driver terminal interaction interface scenario provided in the first embodiment of the present application;

[0025] Fig.12 A flowchart of another method for detecting wearing of a designated obstruction based on human-computer interaction provided in Embodiment 2 of the present application;

[0026] Fig.13 A schematic diagram of a designated obstruction wearing detection device based on human-computer interaction provided in Example 1 of the present application;

[0027] Fig.14 A schematic diagram of a designated obstruction wearing detection device based on human-computer interaction provided in Embodiment 2 of the present application;

[0028] Fig.15 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0029] To make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. It should be understood that the drawings in the present application only serve the purpose of explanation and description and are not used to limit the scope of protection of the present application. In addition, it should be understood that the schematic drawings are not drawn in real proportion. The flowchart used in this application shows the operations implemented according to some embodiments of the present application. It should be understood that the operations of the flowchart can be implemented out of sequence, and the steps without logical context can be reversed in order or implemented simultaneously. In addition, those skilled in the art can add one or more other operations to the flowchart under the guidance of the content of the present application, or remove one or more operations from the flowchart.

[0030] In addition, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0031] In order to enable those skilled in the art to use the content of this application, the following implementation is given in combination with the specific application scenario "detection of wearing designated obstructions after travel". For those skilled in the art, the general principles defined here can be applied to other embodiments and application scenarios without departing from the spirit and scope of this application. Although this application is mainly described around the random inspection of masks after travel, it should be understood that this is only an exemplary embodiment.

[0032] It should be noted that the term "comprising" will be used in the embodiments of the present application to indicate the existence of the features declared thereafter, but does not exclude the addition of other features.

[0033] The terms "passenger", "requester", "service requester" and "customer" in this application are used interchangeably to refer to individuals, entities or tools that can request or order services. The terms "driver", "provider", "service provider" and "supplier" in this application are used interchangeably to refer to individuals, entities or tools that can provide services. The term "user" in this application may refer to an individual, entity or tool that requests a service, orders a service, provides a service, or facilitates the provision of a service. For example, a user may be a passenger, a driver, an operator, etc., or any combination thereof. In this application, "passenger" and "passenger terminal" are used interchangeably, and "driver" and "driver terminal" are used interchangeably.

[0034] The terms "service request" and "order" in this application are used interchangeably to refer to a request initiated by a passenger, a service requester, a driver, a service provider, a supplier, etc., or any combination thereof. The "service request" or "order" may be accepted by a passenger, a service requester, a driver, a service provider, a supplier, etc., or any combination thereof. A service request may be charged or free of charge.

[0035] The positioning technology used in this application can be based on the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the Compass Navigation System (COMPASS), the Galileo Positioning System, the Quasi-Zenith Satellite System (QZSS), the Wireless Fidelity (WiFi) positioning technology, etc., or any combination thereof. One or more of the above positioning systems can be used interchangeably in this application.

[0036] At present, in order to respond to the epidemic control policy, online car-hailing platforms require drivers to wear masks throughout the process of executing orders, and need to monitor in real time whether the drivers wear masks throughout the journey as required. The existing monitoring method is to verify by identifying pictures uploaded by the driver. If a mask is recognized, the driver is considered to have passed the verification and can perform the vehicle dispatch task. However, under this monitoring method, it is easy for drivers to cheat, and it cannot be verified whether the driver has worn a mask throughout the journey as required.

[0037] In order to solve the above technical problems, the present invention provides a designated obstruction wearing detection method based on human-computer interaction, which can achieve the purpose of monitoring whether the driver wears a mask in accordance with regulations. The present invention will be described in detail below with reference to the accompanying drawings.

[0038] See also Figure 1 , Figure 1 1 is a schematic diagram of the architecture of a designated obstruction detection system 100 provided in an embodiment of the present application. For example, the designated obstruction detection system 100 can be used in scenarios such as online car-hailing travel where designated obstructions on a person's face need to be detected. The designated obstruction detection system 100 may include a server 110, a network 120, a passenger terminal 130, and a driver terminal 140. The server 110 may communicate with the passenger terminal 130 and the driver terminal 140 through the network 120, respectively.

[0039] In some embodiments, the server 110 may include a processor. The processor may process information and / or data related to the service request to perform one or more functions described in the present application. For example, the processor may be based on obtaining evaluation information for the driver fed back from the passenger terminal 130.

[0040] In some embodiments, the processor may include one or more processing cores (e.g., a single-core processor (S) or a multi-core processor (S)). By way of example only, the processor may include a central processing unit (CPU), an application specific integrated circuit (ASIC), an application specific instruction set processor (ASIP), a graphics processing unit (GPU), a physical processing unit (PPU), a digital signal processor (DSP), a field programmable gate array (FPGA), a programmable logic device (PLD), a controller, a microcontroller unit, a reduced instruction set computer (RISC), or a microprocessor, or any combination thereof.

[0041] In some embodiments, the device types corresponding to the passenger terminal 130 and the driver terminal 140 may be mobile devices, such as smart home devices, wearable devices, smart mobile devices, virtual reality devices, or augmented reality devices, etc., or they may be tablet computers, laptop computers, or built-in devices in motor vehicles, etc.

[0042] In order to achieve the purpose of monitoring whether the driver wears the designated covering as required, the above-mentioned server 110 can push an inquiry prompt page to the passenger terminal 130 after receiving the trip end information feedback from the driver terminal 140 to guide the passenger to evaluate whether the driver wears a mask. Once the server 110 receives negative evaluation information, it will trigger the random inspection process of the driver's designated covering. If it is detected during the random inspection that the driver is not wearing the designated covering, the driver's vehicle will be controlled to prompt the driver to wear a mask, thereby achieving the purpose of monitoring and urging the driver.

[0043] It should be noted that the designated obstructing object involved in the embodiments of the present invention may be a mask, a face shield, a gas mask, etc.

[0044] The following example takes the designated obstruction as a mask. Figure 1 The contents described in the designated obstruction detection system 100 are used to describe in detail the designated obstruction wearing detection method based on human-computer interaction provided in an embodiment of the present application.

[0045] Embodiment 1

[0046] See also Figure 2 , Figure 2 A flowchart of a designated obstruction wearing detection method based on human-computer interaction provided in the first embodiment of the present application is provided. The method can be executed by the driver terminal 140 in the designated obstruction detection system 100. The specific execution process is as follows:

[0047] S210: When a designated obstruction detection request sent by the server is received, a detection guidance interface is generated.

[0048] The above-mentioned designated obstruction detection request is generated by the server under the condition of receiving negative evaluation information fed back by the passenger terminal, and the negative evaluation information indicates that the driver does not wear the designated obstruction.

[0049] In some embodiments, passengers can provide negative evaluation information through the operation logo on the passenger terminal display interface, or through the customer service telephone. For these two evaluation methods, passengers can choose any one of them to evaluate the driver, or they can use both evaluation methods at the same time to enable the server to trigger random inspections after receiving the negative evaluation information.

[0050] In one scenario, when a passenger chooses to feedback negative evaluation information using any of the above-mentioned evaluation methods, the server will determine whether to trigger random inspection based on the timeliness characteristics of the feedback negative evaluation information. For example, for a certain order, from the end time of the order, if the passenger feedbacks negative evaluation information within a preset time period, the negative evaluation information is time-sensitive. Then, after receiving the negative evaluation information, the server can trigger a random inspection and generate a detection request. On the contrary, if the passenger does not feedback negative evaluation information within the preset time period, the negative evaluation information is invalid. Then, the server will not initiate a random inspection after receiving the negative evaluation information. The above-mentioned preset time period can be calculated in days. For example, if a passenger evaluates an order of the previous day on the same day, the evaluation information is invalid, and the server will not initiate a random inspection after receiving the evaluation information.

[0051] In another scenario, when the passenger chooses both of the above evaluation methods to provide negative evaluation information, but the operation timing of the two evaluation methods is different, in order to prevent multiple spot checks from being triggered for the same order and waste resources, an implementation method is given below: For the same order, the server triggers a spot check when it receives negative evaluation information for the first time and the negative evaluation information has not expired.

[0052] For example, after the order is completed, the passenger feedbacks negative evaluation information through the operation identifier on the display interface of the passenger terminal. The moment when the server receives the evaluation information is t1. At the moment t2, where t1 < t2, the passenger feedbacks the evaluation information again through the customer service phone, resulting in the server receiving two consecutive negative evaluation information. To prevent triggering multiple random inspections for the same order and wasting resources, the server can trigger a random inspection after receiving the negative evaluation information feedback by the passenger through the operation identifier on the display interface of the passenger terminal for the first time. For subsequent evaluation information feedback by the passenger through the customer service phone, no random inspection will be triggered, thus solving the problem of triggering multiple random inspections for the same order and wasting resources.

[0053] S220. In response to an operation on the detection guidance interface, send the driver's face image to the server so that the server performs specified occluder wearing detection based on the face image.

[0054] It can be understood that the detection guidance interface contains information for guiding the driver into the specified occluder random inspection process, such as identifiers like buttons and sliders for prompting the driver. After the driver performs a series of interaction operations on the identifier, the driver terminal can obtain the driver's face image at the current moment, and then feedback the face image to the server for specified occluder recognition. The server can use any existing specified occluder recognition detection method to detect whether there is specified occluder graphic information in the driver's face image, thereby completing the specified occluder random inspection of the driver.

[0055] For ease of understanding, taking a mask as an example, a man-machine interaction scenario example is given below to elaborate on the above implementation process.

[0056] See Figure 3 , Figure 3 FIG. is a schematic diagram of a man-machine interaction interface scenario provided in the first embodiment of the present invention. First, see the passenger terminal 130. The display interface of the passenger terminal 130 displays evaluation prompt information for guiding the passenger to evaluate whether the driver wears a mask throughout the journey. The display interface of the passenger terminal 130 can be generated by the server 110 and pushed to the passenger terminal 130 after receiving the journey end information sent by the driver terminal 140 after the journey is completed, or the server 110 can send the evaluation prompt information to the passenger terminal 130 after receiving the journey end information to instruct the passenger terminal 130 to generate this display interface according to the evaluation prompt information.

[0057] In some embodiments, when a passenger touches, clicks, slides, or performs any other operation on the "No" icon on the display interface of the passenger terminal 130, it indicates that the driver did not wear a mask throughout the entire journey. The passenger terminal 130 generates negative evaluation information based on the operation and feeds it back to the server 110. After receiving the negative evaluation information, the server 110 triggers the mask sampling process and then sends a mask detection request to the driver terminal.

[0058] Continue to see Figure 3 In the driver terminal 140, the driver terminal 140 receives the mask detection request sent by the server 110 and generates a detection guidance interface. It can be seen that the detection guidance interface may include a start sampling mark for guiding the driver to start the mask sampling task. The start sampling mark can be any interactive mark such as a button or a slider. The driver can touch, click, slide, or perform any other operation on the start sampling mark so that the driver terminal 140 can finally obtain the driver's facial image and perform the mask detection task based on the obtained facial image.

[0059] An embodiment of the present invention provides a designated obstruction wearing detection method based on human-computer interaction, which triggers a server to execute a designated obstruction detection process through negative evaluation information fed back by a passenger terminal "after the trip". During the execution of the process, the driver terminal generates a detection guidance interface after receiving the request to guide the driver to perform interactive operations until the driver's facial image is obtained, and then the facial image is fed back to the server so that the server executes designated obstruction detection, thereby realizing monitoring of whether the driver is wearing the designated obstruction at the current moment.

[0060] Optionally, in order to obtain the driver's face image, the following continues to take the mask as an example to give a human-computer interaction scenario example to illustrate the above implementation process. Figure 4 , Figure 4 This is one of the schematic diagrams of a driver terminal interaction interface scenario provided in Embodiment 1 of the present invention.

[0061] like Figure 4As shown, when the driver operates the "start random inspection" mark on the detection guidance interface, the driver terminal 140 is triggered to generate an image acquisition interface. The image acquisition interface may have a shooting preview area, and the driver can aim the camera of the driver terminal 140 and adjust the face to be located in the shooting preview area to obtain a complete facial image; there may also be shooting example information to remind the driver to shoot according to the character image in the example; the image acquisition interface also has a shooting start mark, and the driver can operate the shooting start mark on the image acquisition interface to start the shooting module to perform the face image acquisition task. After the driver terminal 140 obtains the face image, it can send the face image to the server 110 so that the server 110 can perform a specific obstruction detection based on the face image.

[0062] In some embodiments, the facial image obtained above may be one or more. When there are multiple facial images taken, the image with the clearest resolution or the most complete facial parts can be selected for detection to improve the detection accuracy.

[0063] In some embodiments, if the driver is not wearing a mask, mask graphic information will not be detected in the captured facial image. At this time, it can be determined that the driver is not wearing a mask as required, and the driver's vehicle can be controlled. The driver cannot receive new order information during the vehicle control period; if the driver is wearing a mask, mask graphic information can be detected in the captured facial image. At this time, it can be determined that the driver is wearing a mask as required, and new order information can continue to be received.

[0064] Optionally, in some possible scenarios, the passenger does not provide feedback immediately after the trip, but provides feedback after a period of time. The driver may have already executed a new order, causing the driver to receive a mask sampling request for historical orders during the trip, and the driver needs to take a face image to complete the sampling. In order to avoid the safety hazards caused by taking images during driving, a possible implementation method is given below. See Figure 5 , Figure 5 One of the schematic flow charts of another method for detecting wearing of a designated obstruction based on human-computer interaction provided in Embodiment 1 of the present invention, the method further includes:

[0065] S230: In response to the operation on the interface logout mark, generate an exit detection prompt sub-interface.

[0066] S240: In response to the operation of the confirmation mark on the exit detection prompt sub-interface, generate unexecuted detection information.

[0067] S250: Send the unexecuted detection information to the server so that the server marks the driver's vehicle and sends a designated obstruction detection request to the driver terminal of the marked vehicle within a preset time interval until a face image is obtained.

[0068] To facilitate understanding of steps S230 to S250, a scene diagram is given below. Figure 6 , Figure 6 The present invention provides a second schematic diagram of a driver terminal interaction interface scenario according to the first embodiment of the present invention.

[0069] like Figure 6 As shown in (a), the image acquisition interface may have an interface logout mark. If the driver receives a mask sampling request during driving and needs to take an image, in order to ensure driving safety, the driver may not perform the mask sampling, but operate the interface logout mark. At this time, the driver terminal 140 generates an exit detection prompt sub-interface after receiving the operation instruction, such as Figure 5 As shown in (ii), the driver can operate the "OK" icon on the exit detection prompt sub-interface to avoid executing the mask sampling process.

[0070] In some embodiments, in order to successfully obtain the driver's facial image, when the driver terminal 140 detects the driver's operation instruction on the "OK" mark on the exit detection prompt sub-interface, it can generate unexecuted detection information and send the unexecuted detection information to the server 110, so that the server 110 marks the driver's vehicle and sends a specified obstruction detection request to the driver terminal of the marked vehicle within a preset time interval until the facial image is obtained.

[0071] It is understandable that for the sake of driving safety, the driver can choose not to execute the mask sampling process temporarily, but in order to achieve the supervision function and ultimately complete the mask sampling task for the driver, for the marked drivers, mask sampling requests can be sent regularly at preset time intervals. For example, a sampling request is sent every 10 minutes. Once the driver is not driving, he can cooperate with the server to perform mask sampling in time, thereby achieving the purpose of monitoring.

[0072] Optionally, in some embodiments, because the driver does not adjust his face to be located in the shooting browsing area as required, the face part is not captured, and the server cannot detect the face based on the captured image, and thus cannot complete the mask detection. In order to compensate for this error, a possible implementation method is given below. Figure 7 , Figure 7 A second schematic flow chart of another method for detecting wearing of a designated obstruction based on human-computer interaction provided in the first embodiment of the present invention.

[0073] S260: When the face-not-detected information sent by the server is received, a reshooting prompt sub-interface is generated.

[0074] S270, responding to the operation of the reshoot mark on the shooting prompt sub-interface, returning to the display image acquisition interface, executing the operation in response to the shooting start mark, and triggering the shooting module to shoot the face image located in the shooting preview area.

[0075] To facilitate understanding of steps S260 to S270, a scenario example diagram is given below. Figure 8 , Figure 8 The third schematic diagram of a driver terminal interaction interface scenario provided in the first embodiment of the present invention.

[0076] like Figure 8 As shown, if the driver terminal 140 receives the facial information that no face is detected sent by the server 110, a reshooting prompt sub-interface can be generated. The interface can have prompt information to guide the driver to reshoot the image and an operation mark to return to the image acquisition interface. The driver can operate the reshoot mark of the shooting prompt sub-interface. After receiving the operation instruction, the driver terminal 140 returns to the image acquisition interface, and after the driver operates the shooting start mark, the shooting module is triggered to shoot the facial image located in the shooting preview area, so that the captured image can detect the facial part.

[0077] Optionally, in some embodiments, after receiving the facial image sent by the driver terminal 140, the server 110 may perform a designated obstruction detection task and feed back prompt information to the driver terminal based on the detection result.

[0078] In one scenario, Fig. 9 As shown, Fig. 9 This is a fourth schematic diagram of a driver terminal interaction interface scenario provided in the first embodiment of the present invention. If the server 110 detects a specified obstruction, it can feedback detection success information to the driver terminal 140. After receiving the detection success information, the driver terminal 140 generates a detection completion prompt interface to remind the driver that the detection has passed. The driver can operate the "OK" icon on the interface to continue to receive new order tasks.

[0079] In another scenario, Fig.10 As shown, Fig.10 The fifth schematic diagram of a driver terminal interaction interface scene provided in the first embodiment of the present invention is that if the server 110 fails to detect the specified obstruction, the detection failure information can be fed back to the driver terminal 140. After receiving the detection failure information, the driver terminal 140 generates a reminder interface for wearing the specified obstruction to remind the driver to wear the specified obstruction.

[0080] Optionally, in some embodiments, for drivers who do not wear the specified cover as required, their corresponding driver terminals will receive vehicle control instructions sent by the server, and the driver terminals can generate a vehicle collection prompt interface to guide the driver to put on the specified cover again and re-verify the vehicle dispatch process. For ease of understanding, please refer to Fig.11 , Fig.11 This is a sixth schematic diagram of a driver terminal interaction interface scenario provided in the first embodiment of the present invention.

[0081] like Fig.11 As shown, after the server 110 sends a vehicle control instruction to the driver terminal 140, the driver terminal 140 will generate a vehicle collection prompt interface, which may have a "vehicle departure" mark. Before the driver operates the "vehicle departure" mark, the driver terminal 140 will not receive new order information; after the driver operates the "vehicle departure" mark, it is necessary to re-verify whether it meets the vehicle departure conditions. Therefore, the driver terminal 140 will generate a vehicle departure verification interface, which has an area for uploading photos of wearing masks, an area for uploading photos of vehicle disinfection, an area for uploading letters of commitment, and an input box for instructing the driver to enter body temperature. After the driver uploads the corresponding photos of wearing masks, vehicle disinfection photos, letters of commitment, and body temperature in each area, the driver terminal 140 will send this information to the server 110 for verification. If the verification is passed, the driver is allowed to leave.

[0082] It can be understood that in one implementation, after the server generates the vehicle control instruction, it can send it to the driver terminal after the driver's vehicle has just completed the previous order, or, if the server determines that the vehicle is executing a new order task, it will send the vehicle control instruction to the driver terminal after the new order task is completed. At this time, the driver terminal can output a vehicle collection prompt interface after receiving the instruction to control the vehicle. In another implementation, the server can also send it to the driver terminal immediately after generating the vehicle control instruction. At this time, the driver terminal can generate a vehicle collection prompt interface after the vehicle has just completed the previous order to control the vehicle, or, if the driver terminal determines that the vehicle is executing a new order task, it will output a vehicle collection prompt interface after the new order task is completed. Controlling the vehicle can avoid the driver's vehicle being collected during the driving process and causing safety accidents.

[0083] Embodiment 2

[0084] Based on the same inventive concept, the embodiment of the present application also provides a method for detecting wearing of a designated obstruction based on human-computer interaction. Fig.12 A flowchart of another method for detecting the wearing of a designated obstruction based on human-computer interaction provided in an embodiment of the present application is provided. The method can be executed by the server 110 in the designated obstruction detection system 100. The specific execution process is as follows:

[0085] S310: When receiving negative evaluation information sent by the passenger terminal, sending a designated obstruction detection request to the driver terminal corresponding to the negative evaluation information.

[0086] The negative evaluation information mentioned above indicates that the driver does not wear the designated shielding material.

[0087] S320: Receive a facial image fed back by the driver terminal, and perform designated obstruction wearing detection according to the facial image.

[0088] The present application provides a method for detecting the wearing of designated obstructions based on human-computer interaction, which is applied to a server. The difference from the prior art is that the prior art only detects whether the driver wears a mask as required through photos uploaded by the driver before the driver drives out, which is prone to driver cheating. The present application triggers the server to send a designated obstruction detection request to the driver terminal through the evaluation information of the passenger's feedback that the driver does not wear the designated obstruction, and then obtains the driver's facial image through the driver's interactive operation for designated obstruction detection. This can solve the problem of driver cheating in the prior art and achieve the effect of verifying whether the driver wears a mask throughout the entire journey.

[0089] In one possible implementation, if the driver does not perform the detection task temporarily, the server 110 may receive the unexecuted detection information sent from the driver terminal 140. At this time, the server 110 may mark the driver's vehicle and resend the specified obstruction detection request to the driver terminal of the marked vehicle within a preset time interval until the driver's facial image is obtained to complete the random inspection task.

[0090] In a possible implementation, when the server 110 fails to detect a face in the acquired face image, indicating that the driver has not correctly adjusted the face position and the shooting preview area, the server 110 may send information indicating that the face has not been detected to the driver terminal 140, so that the driver terminal 140 generates a reshooting prompt sub-interface, responds to the operation of the reshooting mark on the shooting prompt sub-interface, returns to the image acquisition interface, and executes the operation in response to the shooting start mark, triggering the shooting module to shoot the face image located in the shooting preview area until an image containing a face is obtained for finger occlusion detection.

[0091] In one possible implementation, when the server 110 fails to detect a designated obstruction in the acquired facial image, designated obstruction detection failure information may be sent to the driver terminal 140, so that the driver terminal 140 generates a designated obstruction wearing prompt interface to remind the driver to wear the designated obstruction; or, when the server 110 detects a designated obstruction in the acquired facial image, designated obstruction detection success information may be sent to the driver terminal 140, so that the driver terminal 140 generates a detection completion prompt interface to remind the driver to pass the random inspection.

[0092] In a possible implementation, when the server 110 does not detect a specified obstruction in the acquired facial image, a vehicle control instruction may be generated and sent to the driver terminal 140 so that the driver terminal 140 generates a vehicle collection prompt interface.

[0093] Based on the same inventive concept, the embodiment of the present application also provides a designated obstruction wearing detection device 40 based on human-computer interaction. The designated obstruction wearing detection device 40 based on human-computer interaction corresponds to the designated obstruction wearing detection method based on human-computer interaction applied on the driver terminal 140. Please refer to Fig.13 As shown, it is a schematic diagram of a designated obstruction wearing detection device based on human-computer interaction provided in Embodiment 5 of the present application, and the device includes: a generating module 410 and a sending module 420.

[0094] The generating module 410 is used to receive the designated obstruction detection request sent by the server and generate a detection guidance interface; wherein the designated obstruction detection request is generated by the server under the condition of receiving negative evaluation information fed back by the passenger terminal; the negative evaluation information indicates that the driver does not wear the designated obstruction;

[0095] The sending module 420 is used to send the driver's face image to the server in response to the operation of the detection guidance interface, so that the server performs designated obstruction wearing detection according to the face image.

[0096] In a possible implementation, the generation module 410 is also used to: generate an image acquisition interface in response to an operation on the detection guidance interface; the sending module 420 is also used to: acquire a facial image in response to an operation on the image acquisition interface, and send the facial image to the server, so that the server performs a designated obstruction wearing detection based on the facial image.

[0097] In one possible implementation, the sending module 420 is specifically used to respond to the operation of the shooting start mark, trigger the shooting module to shoot the face image located in the shooting preview area; and send the face image to the server so that the server performs a designated obstruction wearing detection based on the face image.

[0098] In a possible implementation, the generation module 410 is further used to: generate an exit detection prompt sub-interface in response to an operation on the interface logout mark; generate unexecuted detection information in response to an operation on the confirmation mark on the exit detection prompt sub-interface; the sending module 420 is further used to: send the unexecuted detection information to the server so that the server marks the driver's vehicle and sends a specified obstruction detection request to the driver terminal of the marked vehicle within a preset time interval until a facial image is obtained.

[0099] In one possible implementation, the generation module 410 is further used to generate a reshooting prompt sub-interface if no facial information is detected and sent by the server; the sending module 420 is further used to respond to the operation of the reshooting mark on the shooting prompt sub-interface, return to the image acquisition interface, and execute the operation in response to the shooting start mark, triggering the shooting module to shoot the facial image located in the shooting preview area.

[0100] In a possible implementation, the generation module 410 is further used to generate a detection completion prompt interface upon receiving a designated obstruction detection success message sent by the server; or to generate a designated obstruction wearing prompt interface upon receiving a designated obstruction detection failure message sent by the server.

[0101] In a possible implementation, the generation module 410 is also used to generate a vehicle collection prompt interface upon receiving a vehicle control instruction sent by the server; the vehicle control instruction is generated by the server when it detects that the driver is not wearing a specified covering.

[0102] For descriptions of the processing flow of each module in the device and the interaction flow between each module, reference may be made to the relevant descriptions in the above method embodiment, which will not be described in detail here.

[0103] The present application provides a device for detecting the wearing of designated obstructions based on human-computer interaction, which includes: a generating module for receiving a designated obstruction detection request sent by a server and generating a detection guidance interface; wherein the designated obstruction detection request is generated by the server under the condition of receiving negative evaluation information fed back by a passenger terminal; the negative evaluation information indicates that the driver does not wear the designated obstruction; a sending module for responding to the operation of the detection guidance interface, sending the driver's face image to the server, so that the server performs designated obstruction wearing detection according to the face image. The difference from the prior art is that the prior art only detects whether the driver wears a mask in accordance with regulations through the photos uploaded by the driver before the driver leaves the car, which is prone to driver cheating. The present application triggers the server to send a designated obstruction detection request to the driver terminal through the evaluation information fed back by the passenger after the trip that the driver does not wear the designated obstruction, and then obtains the driver's face image for designated obstruction detection through the driver's interactive operation, which can solve the problem of driver cheating in the prior art and achieve the effect of verifying whether the driver wears a mask throughout the trip.

[0104] Based on the same inventive concept, another designated obstruction wearing detection device 50 based on human-computer interaction is also provided in the embodiment of the present application. The designated obstruction wearing detection device 50 based on human-computer interaction corresponds to the designated obstruction wearing detection method based on human-computer interaction applied on the server 110, and the designated obstruction wearing detection method based on human-computer interaction is described in detail in the embodiment of the present application. Fig.14 As shown, it is a schematic diagram of another designated obstruction wearing detection device based on human-computer interaction provided in an embodiment of the present application, and the device includes: a sending module 510 and a detection module 520.

[0105] The sending module 510 is used to send a designated obstruction detection request to the driver terminal corresponding to the negative evaluation information when receiving the negative evaluation information sent by the passenger terminal; the negative evaluation information indicates that the driver does not wear the designated obstruction.

[0106] The detection module 520 is used to receive the face image fed back by the driver terminal and perform designated obstruction wearing detection according to the face image.

[0107] In a possible implementation, the detection module 520 is further configured to: generate a vehicle control instruction when no designated obstruction is detected in the face image. The sending module 510 is further configured to: send the vehicle control instruction to the driver terminal so that the driver terminal generates a vehicle collection prompt interface.

[0108] In a possible implementation, a marking module is further included, which is specifically used to: mark the driver's vehicle when unexecuted detection information is received; send a specified obstruction detection request to the driver terminal of the marked vehicle within a preset time interval until the driver's facial image is obtained.

[0109] The present application provides a device for detecting the wearing of designated obstructions based on human-computer interaction, which includes: a sending module, which is used to send a designated obstruction detection request to the driver terminal corresponding to the negative evaluation information when receiving negative evaluation information sent by the passenger terminal; the negative evaluation information indicates that the driver does not wear the designated obstruction; a detection module, which is used to receive the face image fed back by the driver terminal, and perform the designated obstruction wearing detection according to the face image. The difference from the prior art is that the prior art only detects whether the driver wears a mask in accordance with the regulations through the photos uploaded by the driver before the driver leaves the car, which is prone to the phenomenon of driver cheating. The present application triggers the server to send a designated obstruction detection request to the driver terminal through the evaluation information fed back by the passenger after the trip that the driver does not wear the designated obstruction, and then obtains the driver's face image for designated obstruction detection through the driver's interactive operation, which can solve the problem of driver cheating in the prior art and achieve the effect of verifying whether the driver wears a mask throughout the journey.

[0110] The present application embodiment also provides an electronic device 60, such as Fig.15 , which is a schematic diagram of the structure of an electronic device 60 provided in an embodiment of the present application, includes: a processor 61, a memory 62, and a bus 63. The memory 62 stores machine-readable instructions executable by the processor 61 (for example, Fig.13 Generates the execution instructions corresponding to the module and sends the module in the device or Fig.14 In one embodiment, the electronic device may be Figure 1 In the driver terminal 140 shown, when the electronic device 60 is running, the processor 61 communicates with the memory 62 through the bus 63, and the following processing is performed when the machine-readable instructions are executed by the processor 61: when receiving a designated obstruction detection request sent by the server, a detection guidance interface is generated; wherein the designated obstruction detection request is generated by the server under the condition of receiving negative evaluation information feedback from the passenger terminal; the negative evaluation information indicates that the driver is not wearing the designated obstruction; in response to the operation of the detection guidance interface, the driver's facial image is sent to the server, so that the server performs a designated obstruction wearing detection based on the facial image.

[0111] In another embodiment, the electronic device may be Figure 1In the server 110 shown, when the electronic device 60 is running, the processor 61 and the memory 62 communicate through the bus 63, and the following processing is performed when the machine-readable instructions are executed by the processor 61: when negative evaluation information sent by the passenger terminal is received, a designated obstruction detection request is sent to the driver terminal corresponding to the negative evaluation information; the negative evaluation information indicates that the driver is not wearing the designated obstruction; a facial image fed back by the driver terminal is received, and a designated obstruction wearing detection is performed based on the facial image.

[0112] An embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the designated obstruction wearing detection method based on human-computer interaction corresponding to the above-mentioned embodiment 1 or the steps of the designated obstruction wearing detection method based on human-computer interaction corresponding to the above-mentioned embodiment 2 are executed.

[0113] Specifically, the storage medium can be a general storage medium, such as a mobile disk, a hard disk, etc. When the computer program on the storage medium is run, it can execute the above-mentioned human-computer interaction-based designated obstruction wearing detection method, thereby solving the problem of driver cheating in the prior art and achieving the effect of verifying whether the driver wears a mask throughout the entire journey.

[0114] An embodiment of the present application also provides a computer program product, including a computer program, which, when executed by a processor, executes the steps of the designated obstruction wearing detection method based on human-computer interaction corresponding to the above-mentioned embodiment 1 or the steps of the designated obstruction wearing detection method based on human-computer interaction corresponding to embodiment 2.

[0115] In summary, the present application provides a designated obstruction wearing detection method and related device based on human-computer interaction, wherein the method comprises: receiving a designated obstruction detection request sent by a server, and generating a detection guidance interface; wherein the designated obstruction detection request is generated by the server under the condition of receiving negative evaluation information fed back by a passenger terminal; the negative evaluation information indicates that the driver does not wear the designated obstruction; in response to the operation of the detection guidance interface, the driver's face image is sent to the server, so that the server performs designated obstruction wearing detection according to the face image. The difference from the prior art is that the prior art only detects whether the driver wears a mask in accordance with regulations through the photos uploaded by the driver before the driver leaves the car, which is prone to driver cheating. The present application triggers the server to send a designated obstruction detection request to the driver terminal through the evaluation information fed back by the passenger after the trip that the driver does not wear the designated obstruction, and then obtains the driver's face image for designated obstruction detection through the driver's interactive operation, which can solve the problem of driver cheating in the prior art and achieve the effect of verifying whether the driver wears a mask throughout the trip.

[0116] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A method for detecting the wearing of a designated obstruction based on human-computer interaction, characterized in that: Applied to a driver terminal, the method comprises: When receiving a designated obstruction detection request sent by the server, a detection guidance interface is generated; wherein the designated obstruction detection request is generated by the server under the condition of receiving negative evaluation information fed back by the passenger terminal; the negative evaluation information indicates that the driver does not wear the designated obstruction; In response to an operation on the detection guidance interface, a facial image of the driver is sent to the server, so that the server performs designated obstruction wearing detection according to the facial image.

2. The method according to claim 1, characterized in that In response to the driver's operation on the detection guidance interface, feeding back the face image to the server so that the server performs designated obstruction wearing detection according to the face image, including: In response to an operation on the detection guide interface, generating an image acquisition interface; In response to the operation of the image acquisition interface, the face image is acquired, and the face image is sent to the server, so that the server performs designated obstruction wearing detection according to the face image.

3. The method according to claim 2, characterized in that The image acquisition interface includes a shooting preview area, shooting example information and a shooting start mark; the shooting example information is used to guide the driver to wear the specified shielding object; the shooting preview area is used to guide the driver to adjust the face to be located in the shooting preview area; In response to the operation of the image acquisition interface, the face image is acquired, and the face image is sent to the server so that the server performs designated obstruction wearing detection according to the face image, including: In response to the operation of the shooting start mark, triggering the shooting module to shoot the face image located in the shooting preview area; The face image is sent to the server, so that the server performs designated obstruction wearing detection according to the face image.

4. The method according to claim 3, characterized in that The image acquisition interface also includes an interface logout mark, and the method further includes: In response to the operation of the interface logout mark, generating an exit detection prompt sub-interface; In response to an operation on a confirmation mark on the exit detection prompt sub-interface, generating unexecuted detection information; The unexecuted detection information is sent to the server so that the server marks the driver's vehicle and sends a designated obstruction detection request to the driver terminal of the marked vehicle within a preset time interval until the face image is obtained.

5. The method according to claim 3, after sending the face image to the server so that the server performs designated obstruction wearing detection according to the face image, further comprises: If the face-undetected information sent by the server is received, a reshoot prompt sub-interface is generated; In response to the operation of the re-shooting mark on the shooting prompt sub-interface, the image acquisition interface is returned to display, and the operation in response to the shooting start mark is executed to trigger the shooting module to shoot the face image located in the shooting preview area.

6. The method according to claim 1, further comprising: When receiving the designated obstruction detection success information sent by the server, generating a detection completion prompt interface; or, When the designated obstruction detection failure information sent by the server is received, a reminder interface for wearing the designated obstruction is generated.

7. The method according to claim 1, further comprising: When receiving the vehicle control instruction sent by the server, generating a vehicle collection prompt interface; The vehicle control instruction is generated by the server under the condition that it is detected that the driver is not wearing the designated covering.

8. A method for detecting the wearing of a designated obstruction based on human-computer interaction, characterized in that: Applied to a server, the method comprises: When receiving negative evaluation information sent by the passenger terminal, sending a designated obstruction detection request to the driver terminal corresponding to the negative evaluation information; the negative evaluation information indicates that the driver is not wearing the designated obstruction; Receive the facial image fed back by the driver terminal, and perform designated obstruction wearing detection according to the facial image.

9. The method according to claim 8, further comprising: When the designated obstruction is not detected in the face image, generating a vehicle control instruction; A vehicle control instruction is sent to the driver terminal so that the driver terminal generates a vehicle collection prompt interface.

10. The method according to claim 8, further comprising: When receiving the unperformed detection information, marking the driver's vehicle; A designated obstruction detection request is sent to the driver terminal of the marked vehicle within a preset time interval until a facial image of the driver is obtained.

11. A designated obstruction wearing detection device based on human-computer interaction, characterized in that: include: A generating module, configured to receive a designated obstruction detection request sent by a server and generate a detection guidance interface; wherein the designated obstruction detection request is generated by the server under the condition that the server receives negative evaluation information fed back by a passenger terminal; the negative evaluation information indicates that the driver does not wear the designated obstruction; The sending module is used to send the driver's face image to the server in response to the operation of the detection guidance interface, so that the server performs designated obstruction wearing detection according to the face image.

12. A designated obstruction wearing detection device based on human-computer interaction, characterized in that: include: A sending module, configured to send a designated obstruction detection request to a driver terminal corresponding to the negative evaluation information when receiving the negative evaluation information sent by the passenger terminal; The negative evaluation information indicates that the driver does not wear a designated shielding device; The detection module is used to receive the face image fed back by the driver terminal and perform designated obstruction wearing detection according to the face image.

13. An electronic device, characterized in that: include: A processor, a storage medium and a bus, wherein the storage medium stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor and the storage medium communicate through the bus, and the processor executes the machine-readable instructions to execute the method as described in any one of claims 1 to 7 or the method as described in any one of claims 8 to 10.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 7 or the method according to any one of claims 8 to 10 is executed.

15. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 7 or the method according to any one of claims 8 to 10 is executed.

Images