Perception measurement result evaluation method and device, storage medium and program product

Abstract

The invention provides a sensing measurement result evaluation method and device, a storage medium and a program product, relates to the technical field of communication, and solves the technical problem of how to determine whether the accuracy of a sensing measurement result meets a sensing service requirement or not in the related technology. The method comprises the following steps: receiving request information; the request information comprises a sensing device identifier, a type of a sensing service and a sensing index of the type of the sensing service; indicating a target sensing device to execute a sensing service based on the request information, and generating a first sensing measurement report; the first sensing measurement report comprises a sensing measurement result generated when the target sensing device executes the sensing service; the sensing measurement result comprises a measurement parameter of the sensing index; and determining the qualified rate of the sensing measurement result of the target sensing equipment based on the measurement parameter of the sensing index and the target parameter value of the sensing index. The present disclosure is used for wavelength division multiplexing scenarios.

Description

Technical Field

[0001] The present disclosure relates to the field of communication technology, and in particular to a perception measurement result evaluation method, device, storage medium, and program product. Background Art

[0002] Machine vision is an important branch in the field of artificial intelligence. It uses computer vision technology to process, analyze and understand images to achieve functions such as object recognition, positioning, measurement and tracking. The machine vision system converts the detected target into an image signal through an image sensing device (such as a camera). The image signal is then transmitted to a dedicated image processing system for digital conversion and preprocessing. Various algorithms are used to operate on the digitized signal to extract the target's features. Finally, the corresponding information is output based on the analysis results and passed to the subsequent control or execution system.

[0003] However, the accuracy of the perception measurement results of the perception device is affected by the network quality. When the machine vision device performs perception measurement, the accuracy of the perception measurement results may be low due to fluctuations in network quality. How to determine whether the accuracy of the perception measurement results meets the perception business requirements has become a technical problem that needs to be solved urgently. Summary of the invention

[0004] The present disclosure provides a perception measurement result evaluation method, device, storage medium and program product, which solve the technical problem of how to determine whether the accuracy of the perception measurement result meets the perception service requirements in the related art.

[0005] In order to achieve the above objectives, the present invention adopts the following technical solutions:

[0006] In a first aspect, a perception measurement result evaluation method is provided, the method comprising: receiving request information; the request information comprising: a perception device identifier, a type of perception service, and a perception indicator of the type of perception service; the perception device identifier is used to determine a target perception device that performs the perception service; the perception indicator is used to determine whether the target perception device meets the requirements of the perception service; based on the request information, instructing the target perception device to perform the perception service, and generating a first perception measurement report; the first perception measurement report includes a perception measurement result generated by the target perception device performing the perception service; the perception measurement result includes a measurement parameter of the perception indicator; based on the measurement parameter of the perception indicator, and a target parameter value of the perception indicator, determining a qualified rate of the perception measurement result of the target perception device; the target parameter value of the perception indicator is a parameter value that meets the requirements of the perception service under the perception indicator.

[0007] In combination with the above-mentioned first aspect, in a possible implementation manner, the method further includes: determining whether the target sensing device has successfully sensed based on a qualified rate of the sensing measurement results of the target sensing device and a preset qualified rate threshold.

[0008] In combination with the above-mentioned first aspect, in a possible implementation method, the method specifically includes: when it is determined that the pass rate of the perception measurement results of the target perception device is greater than a preset threshold, determining that the perception of the target perception device is successful; when it is determined that the pass rate of the perception measurement results of the target perception device is less than the preset threshold, determining that the perception of the target perception device has failed.

[0009] In combination with the above-mentioned first aspect, in a possible implementation method, the method also includes: when it is determined that the target perception device perceives successfully, sending the perception measurement report to the perception information processing device; the perception information processing device is used to visualize the perception measurement report; when it is determined that the target perception device perceives unsuccessfully, instructing the target perception device to perform the perception service to generate a second perception measurement report, and the second perception measurement report is used to determine whether the target perception device perceives successfully.

[0010] In combination with the first aspect above, in a possible implementation, the perception indicators include: perception recognition accuracy, perception distance accuracy, perception angle accuracy, perception area information, and perception delay information.

[0011] In combination with the above-mentioned first aspect, in a possible implementation manner, the method specifically includes: determining the pass rate of the perceived recognition accuracy based on the measurement parameters of the perceived recognition accuracy and the target parameter value of the perceived recognition accuracy; determining the pass rate of the perceived distance accuracy based on the measurement parameters of the perceived distance accuracy and the target parameter value of the perceived distance accuracy; determining the pass rate of the perceived angle accuracy based on the measurement parameters of the perceived angle accuracy and the target parameter value of the perceived angle accuracy; determining the pass rate of the perceived area information based on the measurement parameters of the perceived area information and the target parameter value of the perceived area information; determining the pass rate of the perceived delay information based on the measurement parameters of the perceived delay information and the target parameter value of the perceived delay information; determining the pass rate of the perceived measurement results of the target perception device based on the preset weight values ​​of the perception indicators, the pass rate of the perceived recognition accuracy, the pass rate of the perceived distance accuracy, the pass rate of the perceived angle accuracy, the pass rate of the perceived area information, and the pass rate of the perceived delay information.

[0012] In combination with the first aspect above, in a possible implementation manner, the pass rate of the perception measurement result satisfies the following formula:

[0013]

[0014] Among them, P GZ(t)is the qualified rate of the perception measurement results, W is the parameter weight, SZ(t) is the qualified rate of the perception recognition accuracy, JU(t) is the qualified rate of the perception distance accuracy, JD(t) is the qualified rate of the perception angle accuracy, MBY(t) is the qualified rate of the target area information, SY(t) is the qualified rate of the perception delay, and θ is the deviation value.

[0015] In a second aspect, a perception measurement result evaluation device is provided, which includes: a communication unit and a processing unit; the communication unit is used to receive request information; the request information includes: a perception device identifier, a type of perception service, and a perception indicator of the type of perception service; the perception device identifier is used to determine a target perception device that performs the perception service; the perception indicator is used to determine whether the target perception device meets the requirements of the perception service; the processing unit is used to instruct the target perception device to perform the perception service based on the request information and generate a first perception measurement report; the first perception measurement report includes a perception measurement result generated by the target perception device performing the perception service; the perception measurement result includes a measurement parameter of the perception indicator; the processing unit is used to determine a qualified rate of the perception measurement result of the target perception device based on the measurement parameter of the perception indicator and a target parameter value of the perception indicator; the target parameter value of the perception indicator is a parameter value that meets the requirements of the perception service under the perception indicator.

[0016] In combination with the above-mentioned second aspect, in a possible implementation manner, the processing unit is further used to: determine whether the target sensing device has successfully sensed based on the qualified rate of the sensing measurement results of the target sensing device and a preset qualified rate threshold.

[0017] In combination with the above-mentioned second aspect, in a possible implementation method, the processing unit is specifically used to: when it is determined that the pass rate of the perception measurement results of the target perception device is greater than a preset threshold, determine that the perception of the target perception device is successful; when it is determined that the pass rate of the perception measurement results of the target perception device is less than the preset threshold, determine that the perception of the target perception device has failed.

[0018] In combination with the above-mentioned second aspect, in a possible implementation method, the processing unit is also used to: when it is determined that the target perception device perceives successfully, send the perception measurement report to the perception information processing device; the perception information processing device is used to visualize the perception measurement report; when it is determined that the target perception device perceives unsuccessfully, instruct the target perception device to perform the perception service to generate a second perception measurement report, and the second perception measurement report is used to determine whether the target perception device perceives successfully.

[0019] In combination with the above second aspect, in a possible implementation, the perception indicators include: perception recognition accuracy, perception distance accuracy, perception angle accuracy, perception area information, and perception delay information.

[0020] In combination with the above-mentioned second aspect, in a possible implementation method, the processing unit is specifically used to: determine the pass rate of the perception recognition accuracy based on the measurement parameters of the perception recognition accuracy and the target parameter value of the perception recognition accuracy; determine the pass rate of the perception distance accuracy based on the measurement parameters of the perception distance accuracy and the target parameter value of the perception distance accuracy; determine the pass rate of the perception angle accuracy based on the measurement parameters of the perception angle accuracy and the target parameter value of the perception angle accuracy; determine the pass rate of the perception area information based on the measurement parameters of the perception area information and the target parameter value of the perception area information; determine the pass rate of the perception delay information based on the measurement parameters of the perception delay information and the target parameter value of the perception delay information; determine the pass rate of the perception measurement results of the target perception device based on the preset weight values ​​of the perception indicators, the pass rate of the perception recognition accuracy, the pass rate of the perception distance accuracy, the pass rate of the perception angle accuracy, the pass rate of the perception area information, and the pass rate of the perception delay information.

[0021] In combination with the second aspect, in a possible implementation manner, the pass rate of the perception measurement result satisfies the following formula:

[0022]

[0023] Among them, P GZ(t) is the qualified rate of the perception measurement results, W is the parameter weight, SZ(t) is the qualified rate of the perception recognition accuracy, JU(t) is the qualified rate of the perception distance accuracy, JD(t) is the qualified rate of the perception angle accuracy, MBY(t) is the qualified rate of the target area information, SY(t) is the qualified rate of the perception delay, and θ is the deviation value.

[0024] In a third aspect, a perception measurement result evaluation device is provided, comprising: a processor and a memory; wherein the memory is used to store computer execution instructions, and when the perception measurement result evaluation device is running, the processor executes the computer execution instructions stored in the memory, so that the perception measurement result evaluation device performs the perception measurement result evaluation method recorded in the above-mentioned first aspect and any possible implementation method thereof.

[0025] In a fourth aspect, a computer-readable storage medium is provided, in which instructions are stored. When the instructions in the computer-readable storage medium are executed by a processor of a perception measurement result evaluation device, the perception measurement result evaluation device performs the perception measurement result evaluation method as described in the first aspect and any possible implementation method thereof.

[0026] In a fifth aspect, a chip is provided, the chip including a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run a computer program or instruction to implement the perception measurement result evaluation method recorded in the above-mentioned first aspect and any possible implementation method thereof.

[0027] In the present disclosure, the name of the above-mentioned perception measurement result evaluation device does not limit the device or functional module itself. In actual implementation, these devices or functional modules may appear with other names. As long as the functions of each device or functional module are similar to those of the present disclosure, they belong to the scope of the present disclosure and its equivalent technologies.

[0028] The technical solution provided by the present disclosure brings at least the following beneficial effects: in the present disclosure, the perception measurement result evaluation device first receives request information, and determines the target perception device for performing the perception service and the perception indicator of the type of the perception service according to the perception device identifier in the request information; then instructs the target perception device to perform the perception service and generates a first perception measurement report; the first perception measurement report includes the perception measurement result generated by the target perception device performing the perception service; the perception measurement result includes the measurement parameters of the perception indicator; finally, based on the measurement parameters of the perception indicator and the preset target parameter value of the perception indicator, the qualified rate of the perception measurement result of the target perception device is determined; that is, the qualified rate of the perception measurement report is determined based on the preset target parameter value of the perception indicator as the parameter value that meets the perception service requirements under the perception indicator and the measurement parameters of the perception indicator obtained by the actual measurement, so as to determine whether this perception is successful, thereby solving the technical problem of how to determine whether the accuracy of the perception measurement result meets the perception service requirements. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art are briefly introduced below.

[0030] Figure 1 A schematic diagram of the structure of a perception measurement result evaluation system provided by an embodiment of the present disclosure;

[0031] Figure 2 A schematic diagram of the hardware structure of a perception measurement result evaluation device provided in an embodiment of the present disclosure;

[0032] Figure 3 A flowchart of a method for evaluating a perception measurement result provided by an embodiment of the present disclosure;

[0033] Figure 4 A flowchart of another method for evaluating a perception measurement result provided by an embodiment of the present disclosure;

[0034] Figure 5 A flowchart of another method for evaluating a perception measurement result provided by an embodiment of the present disclosure;

[0035] Figure 6A flowchart of another method for evaluating a perception measurement result provided by an embodiment of the present disclosure;

[0036] Figure 7 A flowchart of another method for evaluating a perception measurement result provided by an embodiment of the present disclosure;

[0037] Figure 8 A flowchart of another method for evaluating a perception measurement result provided by an embodiment of the present disclosure;

[0038] Fig. 9 A schematic diagram of the structure of a perception measurement result evaluation device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0039] A method, device, storage medium and program product for evaluating a perception measurement result provided by an embodiment of the present disclosure are described in detail below with reference to the accompanying drawings.

[0040] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0041] The terms “first”, “second” and the like in the specification and drawings of the present disclosure are used to distinguish different objects, or to distinguish different processing of the same object, rather than to describe a specific order of objects.

[0042] In addition, the terms "including" and "having" and any variations thereof mentioned in the description of the present disclosure are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes other steps or units that are not listed, or optionally includes other steps or units that are inherent to these processes, methods, products or devices. It should be noted that in the embodiments of the present disclosure, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present disclosure should not be interpreted as being more preferred or more advantageous than other embodiments or design solutions. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0043] In the description of the present disclosure, unless otherwise specified, “plurality” means two or more.

[0044] At present, machine vision is an important branch in the field of artificial intelligence. It uses computer vision technology to process, analyze and understand images to realize functions such as object recognition, positioning, measurement and tracking. The machine vision system converts the detected target into an image signal through an image perception device (such as a camera). The image signal is then transmitted to a dedicated image processing system for digital conversion and preprocessing, and various algorithms are used to operate on the digitized signal to extract the characteristics of the target. Finally, the corresponding information is output according to the analysis results and passed to the subsequent control or execution system.

[0045] However, the accuracy of the perception measurement results of the perception device is affected by the network quality. When the machine vision device performs perception measurement, the accuracy of the perception measurement results may be low due to fluctuations in network quality. How to determine whether the accuracy of the perception measurement results meets the perception business requirements has become a technical problem that needs to be solved urgently.

[0046] In order to solve the above technical problems, the present disclosure provides a method, device, storage medium and program product for evaluating perception measurement results, which are used to determine whether the accuracy of the perception measurement results meets the requirements of the perception service. The method includes: the perception measurement result evaluation device first receives a request message, and determines the target perception device for performing the perception service according to the perception device identifier in the request message, and determines the perception indicator of the type of the perception service; then instructs the target perception device to perform the perception service and generates a first perception measurement report; the first perception measurement report includes the perception measurement result generated by the target perception device performing the perception service; the perception measurement result includes the measurement parameters of the perception indicator; finally, based on the measurement parameters of the perception indicator and the preset target parameter value of the perception indicator, the qualified rate of the perception measurement result of the target perception device is determined; that is, based on the preset target parameter value of the perception indicator as the parameter value that meets the requirements of the perception service under the perception indicator and the measurement parameters of the perception indicator obtained by the actual measurement, the qualified rate of the perception measurement report is determined, and then it can be determined whether the perception is successful, thereby solving the technical problem of how to determine whether the accuracy of the perception measurement result meets the requirements of the perception service.

[0047] In a possible implementation, the above-mentioned perception measurement result evaluation method can be applied to the perception measurement result evaluation system 100. Figure 1 A perception measurement result evaluation system 100 provided in an embodiment of the present application is described in detail. Figure 1 As shown, Figure 1 A perception measurement result evaluation system 100 is provided in an embodiment of the present disclosure. The system includes: a terminal 101, a communication perception platform device 102, a machine vision management platform device 103, and a perception data receiving terminal 104.

[0048] Among them, the terminal 101 is located in the scene to be perceived, and is used to send request information to the communication perception platform device 102, the request information includes: a perception device identifier, a type of perception service, and a perception indicator of the type of perception service; the perception device identifier is used to determine a target perception device that performs the perception service; the perception indicator is used to determine whether the target perception device meets the requirements of the perception service; the communication perception platform device 102 is used to instruct the target perception device to perform the perception service based on the request information, generate a first perception measurement report, and send the perception measurement report to the machine vision management platform device 103; the machine vision management platform device 103 is used to determine the pass rate of the perception measurement results of the target perception device based on the measurement parameters of the perception indicator and the target parameter value of the perception indicator; when it is determined that the target perception device has successfully perceived based on the pass rate of the perception measurement results of the target perception device and a preset pass rate threshold, the perception measurement report is sent to the perception data receiving terminal 104; the perception data receiving terminal 104 is used to receive the perception measurement report.

[0049] Optionally, the terminal, communication perception platform device, machine vision management platform device, and physical device of the perception data receiving terminal can be a terminal, a server, or other types of devices, which is not limited to the embodiments of the present application.

[0050] Optionally, a communication connection is established between the terminal and the server.

[0051] In actual applications, a terminal can be connected to multiple servers, and a server can be connected to multiple terminals. For ease of understanding, this application is described by taking one terminal connected to one server as an example.

[0052] Optionally, the terminal may be a device that provides voice and / or data connectivity to a user, a handheld device with wireless connection capabilities, or other processing devices connected to a wireless modem. A wireless terminal may communicate with one or more core networks via a radio access network (RAN). A wireless terminal may be a mobile terminal, such as a mobile phone (or "cellular" phone) and a computer with a mobile terminal, or a portable, pocket-sized, handheld, computer-built-in or vehicle-mounted mobile device that exchanges language and / or data with a radio access network, such as a mobile phone, tablet computer, laptop computer, netbook, personal digital assistant (PDA).

[0053] Optionally, the server can be a server in a server cluster (consisting of multiple servers), or a chip in the server, or a system on a chip in the server, or can be implemented by a virtual machine (VM) deployed on a physical machine, which is not limited in the embodiments of the present application.

[0054] In a possible implementation, the hardware structure of the perception measurement result evaluation device includes: Figure 2 The components of the perception measurement result evaluation device 200 shown in FIG. Figure 2 The hardware structure of the perception measurement result evaluation device 200 is described as an example. Figure 2 As shown, the perception measurement result evaluation device 200 includes at least one processor 201, a communication line 202, and at least one communication interface 204, and may also include a memory 203. The processor 201, the memory 203 and the communication interface 204 may be connected via the communication line 202.

[0055] The processor 201 may be a central processing unit (CPU), an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present disclosure, such as one or more digital signal processors (DSP), or one or more field programmable gate arrays (FPGA).

[0056] The communication link 202 may include a pathway for transmitting information between the above-mentioned components.

[0057] The communication interface 204 is used to communicate with other devices or communication networks, and can use any transceiver-like device, such as Ethernet, radio access network (RAN), wireless local area network (WLAN), etc.

[0058] The memory 203 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, an optical disc storage (including compressed optical discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to include or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited to these.

[0059] In one possible design, the memory 203 can exist independently of the processor 201, that is, the memory 203 can be a memory outside the processor 201. In this case, the memory 203 can be connected to the processor 201 through the communication line 202, and is used to store execution instructions or application code, and the processor 201 controls the execution to implement the perception measurement result evaluation method provided in the following embodiment of the present disclosure. In another possible design, the memory 203 can also be integrated with the processor 201, that is, the memory 203 can be the internal memory of the processor 201, for example, the memory 203 is a high-speed cache, which can be used to temporarily store some data and instruction information.

[0060] As an implementation method, the processor 201 may include one or more CPUs, for example Figure 2 As another implementation, the perception measurement result evaluation device 200 may include multiple processors, such as Figure 2 As another implementation, the perception measurement result evaluation apparatus 200 may further include an output device 205 and an input device 206.

[0061] In the following, a method for evaluating a perception measurement result provided by an embodiment of the present disclosure is described in detail.

[0062] like Figure 3 As shown, Figure 3 A method for evaluating a perception measurement result provided by an embodiment of the present disclosure can be applied to Figure 2 In the perception measurement result evaluation device shown, the method includes the following S301-S303, which are described in detail below.

[0063] S301. A perception measurement result evaluation device receives request information.

[0064] The request information includes: a sensing device identifier, a type of sensing service, and a sensing indicator of the type of sensing service.

[0065] In a possible implementation, the perception device identifier is used to determine a target perception device that performs a perception service; and the perception indicator is used to determine whether the target perception device meets the requirements of the perception service.

[0066] S302: The perception measurement result evaluation apparatus instructs the target perception device to perform a perception service based on the requested information, and generates a first perception measurement report.

[0067] The first perception measurement report includes the perception measurement result generated by the target perception device when executing the perception service.

[0068] In a possible implementation manner, the perception measurement result includes a measurement parameter of the perception indicator.

[0069] S303: The perception measurement result evaluation device determines the pass rate of the perception measurement result of the target perception device based on the measurement parameters of the perception indicator and the target parameter value of the perception indicator.

[0070] In a possible implementation, the target parameter value of the perception indicator is a parameter value that meets the perception service requirement under the perception indicator.

[0071] It is understandable that the target parameter value of the perception indicator is a preset value and can be adjusted according to the actual needs of the perception service.

[0072] The technical solution provided by the above embodiment can at least bring the following beneficial effects: the perception measurement result evaluation device first receives the request information, and determines the target perception device for performing the perception service and the perception indicator of the type of the perception service according to the perception device identifier in the request information; then instructs the target perception device to perform the perception service and generates a first perception measurement report; the first perception measurement report includes the perception measurement result generated by the target perception device performing the perception service; the perception measurement result includes the measurement parameters of the perception indicator; finally, based on the measurement parameters of the perception indicator and the preset target parameter value of the perception indicator, the qualified rate of the perception measurement result of the target perception device is determined; that is, based on the preset target parameter value of the perception indicator as the parameter value that meets the perception service requirements under the perception indicator and the measurement parameters of the perception indicator obtained by the actual measurement, the qualified rate of the perception measurement report is determined, and then it can be determined whether the perception is successful, thereby solving the technical problem of how to determine whether the accuracy of the perception measurement result meets the perception service requirements.

[0073] In one possible implementation, combining Figure 3 ,like Figure 4 As shown, in the above S303, after the perception measurement result evaluation device determines the pass rate of the perception measurement results of the target perception device based on the measurement parameters of the perception indicators and the target parameter values ​​of the perception indicators, the perception measurement result evaluation device also needs to determine whether the target perception device perceives successfully. This process can be specifically implemented through the following S401, which is described in detail below.

[0074] S401. The perception measurement result evaluation device determines whether the target perception device has successfully perceived based on the qualified rate of the perception measurement results of the target perception device and a preset qualified rate threshold.

[0075] In a possible implementation, the perception measurement result evaluation device determines the pass rate of each perception indicator based on the perception measurement result, and determines whether the target perception device perceives successfully based on the pass rate of each perception indicator and a preset pass rate threshold of each perception indicator.

[0076] The technical solution provided by the above-mentioned embodiments can at least bring about the following beneficial effects: the perception measurement result evaluation device determines the pass rate of each perception indicator based on the perception measurement results, and determines whether the target perception device has successfully perceived based on the pass rate of each perception indicator and a preset pass rate threshold for each perception indicator, so that the target perception device determines that the perception measurement results meet the perception business requirements when the perception is successful.

[0077] In one possible implementation, combining Figure 4 ,like Figure 5 As shown, the above S401, the perception measurement result evaluation device determines whether the target perception device has successfully perceived based on the pass rate of the perception measurement results of the target perception device and the preset pass rate threshold. This process can be specifically implemented through the following S501-S502, which is described in detail below.

[0078] S501. When determining that a qualified rate of the perception measurement results of the target perception device is greater than a preset threshold, the perception measurement result evaluation device determines that the perception of the target perception device is successful.

[0079] In a possible implementation, the perception measurement result evaluation device determines that the request information and the perception measurement report meet the perception service requirements and generates a perception success indication when determining that the pass rate of the perception measurement results of the target perception device is greater than a preset threshold.

[0080] Exemplarily, the preset threshold is 80%. When determining that the pass rate of the perception measurement results of the target perception device is greater than 80%, the perception measurement result evaluation device determines that the request information and the perception measurement report meet the perception service requirements and generates a perception success indication.

[0081] S502: When determining that the qualified rate of the perception measurement results of the target perception device is less than a preset threshold, the perception measurement result evaluation device determines that the target perception device has failed in perception.

[0082] In a possible implementation, when determining that the pass rate of the perception measurement results of the target perception device is less than a preset threshold, the perception measurement result evaluation device determines that the request information and the perception measurement report do not meet the perception service requirements and generates a perception failure indication.

[0083] In a possible implementation manner, the perception failure indication is used to indicate the parameters in the perception measurement report and the reasonable range values ​​of the parameters.

[0084] Exemplarily, the preset threshold is 60%. When determining that the pass rate of the perception measurement results of the target perception device is less than 60%, the perception measurement result evaluation device determines that the request information and the perception measurement report do not meet the perception service requirements and generates a perception failure indication.

[0085] The technical solution provided by the above embodiment can at least bring about the following beneficial effects: the perception measurement result evaluation device determines whether the target perception device has successfully perceived the target perception device based on the pass rate of the perception measurement results of the target perception device and a preset pass rate threshold, so that the perception measurement result evaluation device determines whether the accuracy of the perception measurement results meets the perception business requirements.

[0086] In one possible implementation, Figure 6 As shown, in the above S401, after the perception measurement result evaluation device determines whether the target perception device has successfully perceived based on the pass rate of the perception measurement results of the target perception device and the preset pass rate threshold, the perception measurement result evaluation device also needs to process the perception measurement report based on the perception results. This process can be specifically determined by the following S601-S602, which is described in detail below.

[0087] S601. When determining that the target perception device has successfully perceived the target perception device, the perception measurement result evaluation device sends a perception measurement report to the perception information processing device.

[0088] The perception information processing device is used to perform visualization processing on the perception measurement report.

[0089] In a possible implementation manner, when it is determined that the target perception device has successfully perceived the target perception device, the perception measurement result evaluation device sends the perception measurement report to the perception information processing device to perform visualization processing on the perception measurement report.

[0090] S602: When determining that the target sensing device fails in sensing, the sensing measurement result evaluation apparatus instructs the target sensing device to perform a sensing service and generate a second sensing measurement report.

[0091] The second perception measurement report is used to determine whether the target perception device has perceived successfully.

[0092] In a possible implementation, when determining that the target perception device fails in perception, the perception measurement result evaluation device instructs the target perception device to perform a perception service to generate a second perception measurement report, and determines whether the target perception device succeeds in perception based on the second perception measurement report.

[0093] In a possible implementation, when the perception measurement result evaluation device is used to determine that the target perception device perceives successfully based on the second perception measurement report, the perception measurement report is sent to the perception information processing device to perform visualization processing on the perception measurement report.

[0094] In a possible implementation manner, when the perception measurement result evaluation device is used to determine that the target perception device fails to perceive based on the second perception measurement report, the target perception device is instructed to perform a perception service to generate a third perception measurement report.

[0095] In a possible implementation, when the perception measurement result evaluation apparatus determines that the target perception device fails in perception, the above S502 and S602 are repeatedly executed until the perception measurement result evaluation apparatus determines that the target perception device succeeds in perception.

[0096] The technical solution provided by the above-mentioned embodiment can at least bring about the following beneficial effects: when the perception measurement result evaluation device determines that the target perception device has successfully perceived, the perception measurement report is sent to the perception information processing device to perform visualization processing on the perception measurement report, so that the request information sending end obtains the perception measurement report; when it is determined that the target perception device has failed to perceive, the target perception device is instructed to perform the perception service to generate a second perception measurement report to again determine whether the target perception device has successfully perceived.

[0097] In a possible implementation, the perception indicators include: perception recognition accuracy, perception distance accuracy, perception angle accuracy, perception area information, and perception delay information.

[0098] Exemplarily, when the perception indicators include: perception recognition accuracy, perception distance accuracy, perception angle accuracy, perception area information, and perception delay information, the perception measurement report is shown in the following Table 1.

[0099] Table 1 Perception measurement report

[0100]

[0101] In one possible implementation, combining Figure 5 ,like Figure 7As shown, the above S303, the process in which the perception measurement result evaluation device determines the pass rate of the perception measurement results of the target perception device based on the measurement parameters of the perception indicators and the target parameter values ​​of the perception indicators, can be specifically implemented through the following S701-S706, which is described in detail below.

[0102] S701. The perception measurement result evaluation device determines a pass rate of the perception recognition accuracy based on a measurement parameter of the perception recognition accuracy and a target parameter value of the perception recognition accuracy.

[0103] Among them, the perception recognition accuracy is used to characterize the probability of correctly identifying the perception target category.

[0104] In a possible implementation, the pass rate of the perceptual recognition accuracy is a ratio of a measured parameter value of the perceptual recognition accuracy to a target parameter value of the perceptual recognition accuracy.

[0105] S702: The perception measurement result evaluation device determines a qualified rate of the perception distance accuracy based on the measurement parameters of the perception distance accuracy and the target parameter value of the perception distance accuracy.

[0106] Among them, the perception distance accuracy is used to characterize the range of the perception distance.

[0107] In a possible implementation, the pass rate of the perceived distance accuracy is a ratio of a measured parameter value of the perceived distance accuracy to a target parameter value of the perceived distance accuracy.

[0108] S703: The perception measurement result evaluation device determines the pass rate of the perception angle accuracy based on the measurement parameters of the perception angle accuracy and the target parameter value of the perception angle accuracy.

[0109] Among them, the perception angle accuracy is used to characterize the root mean square error between the perception angle estimation value and the true value.

[0110] In a possible implementation, the pass rate of the perception angle accuracy is a ratio of a measured parameter value of the perception angle accuracy to a target parameter value of the perception angle accuracy.

[0111] S704: The perception measurement result evaluation apparatus determines a qualified rate of the perception area information based on the measurement parameters of the perception area information and the target parameter value of the perception area information.

[0112] Among them, the perception area information is used to characterize the length, width, and height range of the perception target recognition collected by the perception device.

[0113] In a possible implementation manner, the pass rate of the perception area information is a ratio of a measured parameter value of the perception area information to a target parameter value of the perception area information.

[0114] S705: The perception measurement result evaluation apparatus determines a qualified rate of the perception delay information based on measurement parameters of the perception delay information and a target parameter value of the perception delay information.

[0115] Among them, the perceived delay information is used to characterize the maximum delay from receiving a perceived service request to responding to the request.

[0116] In a possible implementation manner, the pass rate of the perceived delay information is a ratio of a measured parameter value of the perceived delay information to a target parameter value of the perceived delay information.

[0117] S706. The perception measurement result evaluation device determines the pass rate of the perception measurement results of the target perception device based on the preset weight values ​​of the perception indicators, the pass rate of the perception recognition accuracy, the pass rate of the perception distance accuracy, the pass rate of the perception angle accuracy, the pass rate of the perception area information, and the pass rate of the perception delay information.

[0118] Exemplarily, when the perception indicators include: perception recognition accuracy, perception distance accuracy, perception angle accuracy, perception area information, and perception delay information, as shown in Table 2, Table 2 shows the perception indicators and target parameter values ​​of the perception indicators.

[0119] Table 2 Perception indicators and target parameter values ​​of perception indicators

[0120]

[0121] In one possible implementation, the perception measurement result evaluation device substitutes the preset weight value of the perception index, the pass rate of the perception recognition accuracy, the pass rate of the perception distance accuracy, the pass rate of the perception angle accuracy, the pass rate of the perception area information, and the pass rate of the perception delay information into the pass rate calculation formula of the perception measurement result to determine the pass rate of the perception measurement result of the target perception device.

[0122] In a possible implementation, the pass rate of the perception measurement result satisfies the following formula:

[0123]

[0124] Among them, P GZ(t) is the qualified rate of the perception measurement results, W is the parameter weight, SZ(t) is the qualified rate of the perception recognition accuracy, JU(t) is the qualified rate of the perception distance accuracy, JD(t) is the qualified rate of the perception angle accuracy, MBY(t) is the qualified rate of the target area information, SY(t) is the qualified rate of the perception delay, and θ is the deviation value.

[0125] The technical solution provided by the above embodiment can at least bring the following beneficial effects: the perception measurement result evaluation device determines the pass rate of the perception measurement results of the target perception device based on the measurement parameters of the perception indicator and the preset target parameter value of the perception indicator; that is, based on the preset target parameter value of the perception indicator as the parameter value that meets the perception business requirements under the perception indicator and the measurement parameters of the perception indicator obtained by actual measurement, the pass rate of the perception measurement report is determined, thereby determining whether the perception is successful.

[0126] In one possible implementation, Figure 8 As shown, Figure 8 This is a flow chart of another method for evaluating a perception measurement result provided by an embodiment of the present disclosure. The process specifically includes the following S801-S805, which are described in detail below.

[0127] S801. The terminal sends request information to the communication awareness platform device, and correspondingly, the communication awareness platform device receives the request information from the terminal.

[0128] The request information includes: a sensing device identifier, a type of sensing service, and a sensing indicator of the type of sensing service.

[0129] In a possible implementation, the perception device identifier is used to determine a target perception device that performs a perception service; and the perception indicator is used to determine whether the target perception device meets the requirements of the perception service.

[0130] S802: The communication perception platform device instructs the target perception device to perform a perception service based on the request information and generates a perception measurement report.

[0131] S803. The communication perception platform device sends the perception measurement report to the machine vision management platform device. Correspondingly, the machine vision management platform device receives the perception measurement report from the communication perception platform device.

[0132] S804. The machine vision management platform device determines the pass rate of the perception measurement results of the target perception device based on the measurement parameters of the perception indicators and the target parameter values ​​of the perception indicators.

[0133] S805. The machine vision management platform device sends a perception measurement response to the terminal. Correspondingly, the terminal receives the perception measurement response from the machine vision management platform device.

[0134] The technical solution provided by the above embodiment can at least bring the following beneficial effects: the terminal sends a request message to the communication perception platform device, the communication perception platform device receives the request message, and determines the target perception device for performing the perception service and the perception indicator of the type of the perception service according to the perception device identifier in the request message; then instructs the target perception device to perform the perception service and generates a first perception measurement report; the first perception measurement report includes the perception measurement result generated by the target perception device performing the perception service; the perception measurement result includes the measurement parameters of the perception indicator; the perception measurement report is sent to the machine vision management platform device, and the machine vision management platform device determines the pass rate of the perception measurement result of the target perception device based on the measurement parameters of the perception indicator and the preset target parameter value of the perception indicator; that is, the pass rate of the perception measurement report is determined based on the preset target parameter value of the perception indicator as the parameter value that meets the perception service requirements under the perception indicator and the measurement parameters of the perception indicator obtained by the actual measurement, and then it can be determined whether this perception is successful, thereby solving the technical problem of how to determine whether the accuracy of the perception measurement result meets the perception service requirements.

[0135] It can be seen that the above mainly introduces the technical solution provided by the embodiment of the present disclosure from the perspective of the method. In order to achieve the above functions, it includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the modules and algorithm steps of each example described in the embodiment disclosed herein, the embodiment of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present disclosure.

[0136] The embodiment of the present disclosure can divide the functional modules of the perception measurement result evaluation device according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware or in the form of software functional modules. Optionally, the division of modules in the embodiment of the present disclosure is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0137] In one possible implementation, Fig. 9 , Fig. 9 A schematic diagram of the structure of a perception measurement result evaluation device 900 provided in the present disclosure.

[0138] The perception measurement result evaluation device 900 includes: a communication unit 901 and a processing unit 902; the communication unit 901 is used to receive request information; the request information includes: a perception device identifier, a type of perception service, and a perception indicator of the type of perception service; the perception device identifier is used to determine a target perception device that performs the perception service; the perception indicator is used to determine whether the target perception device meets the requirements of the perception service; the processing unit 902 is used to instruct the target perception device to perform the perception service based on the request information and generate a first perception measurement report; the first perception measurement report includes a perception measurement result generated by the target perception device performing the perception service; the perception measurement result includes a measurement parameter of the perception indicator; the processing unit 902 is used to determine the pass rate of the perception measurement result of the target perception device based on the measurement parameter of the perception indicator and the target parameter value of the perception indicator; the target parameter value of the perception indicator is a parameter value that meets the requirements of the perception service under the perception indicator.

[0139] In a possible implementation, the processing unit 902 is further configured to determine whether the target sensing device has successfully sensed based on a qualified rate of the sensing measurement result of the target sensing device and a preset qualified rate threshold.

[0140] In one possible implementation, the processing unit 902 is specifically used to: determine that the target perception device has successfully perceived the target perception device when the qualified rate of the perception measurement results of the target perception device is greater than a preset threshold; and determine that the target perception device has failed to perceive the target perception device when the qualified rate of the perception measurement results of the target perception device is less than the preset threshold.

[0141] In one possible implementation, the processing unit 902 is further used to: when it is determined that the target perception device has perceived successfully, send the perception measurement report to the perception information processing device; the perception information processing device is used to visualize the perception measurement report; when it is determined that the target perception device has perceived unsuccessfully, instruct the target perception device to perform the perception service to generate a second perception measurement report, and the second perception measurement report is used to determine whether the target perception device has perceived successfully.

[0142] In a possible implementation, the perception indicators include: perception recognition accuracy, perception distance accuracy, perception angle accuracy, perception area information, and perception delay information.

[0143] In one possible implementation, the processing unit 902 is specifically used to: determine the pass rate of the perceived recognition accuracy based on the measurement parameters of the perceived recognition accuracy and the target parameter value of the perceived recognition accuracy; determine the pass rate of the perceived distance accuracy based on the measurement parameters of the perceived distance accuracy and the target parameter value of the perceived distance accuracy; determine the pass rate of the perceived angle accuracy based on the measurement parameters of the perceived angle accuracy and the target parameter value of the perceived angle accuracy; determine the pass rate of the perceived area information based on the measurement parameters of the perceived area information and the target parameter value of the perceived area information; determine the pass rate of the perceived delay information based on the measurement parameters of the perceived delay information and the target parameter value of the perceived delay information; determine the pass rate of the perceived measurement results of the target perception device based on the preset weight values ​​of the perception indicators, the pass rate of the perceived recognition accuracy, the pass rate of the perceived distance accuracy, the pass rate of the perceived angle accuracy, the pass rate of the perceived area information, and the pass rate of the perceived delay information.

[0144] In a possible implementation, the pass rate of the perception measurement result satisfies the following formula:

[0145]

[0146] Among them, P GZ(t) is the qualified rate of the perception measurement results, W is the parameter weight, SZ(t) is the qualified rate of the perception recognition accuracy, JU(t) is the qualified rate of the perception distance accuracy, JD(t) is the qualified rate of the perception angle accuracy, MBY(t) is the qualified rate of the target area information, SY(t) is the qualified rate of the perception delay, and θ is the deviation value.

[0147] An embodiment of the present disclosure also provides a perception measurement result evaluation device, which includes a processor and a memory; wherein the memory is used to store computer execution instructions, and when the perception measurement result evaluation device is running, the processor executes the computer execution instructions stored in the memory, so that the perception measurement result evaluation device performs the perception measurement result evaluation method recorded in the embodiment of the present disclosure.

[0148] An embodiment of the present disclosure provides a computer program product including instructions. When the instructions are executed on a computer, the computer is enabled to execute the perception measurement result evaluation method in the above method embodiment.

[0149] An embodiment of the present disclosure provides a chip, which includes a processor and a communication interface, wherein the communication interface and the processor are coupled, and the processor is used to run a computer program or instruction to implement the perception measurement result evaluation method in the above method embodiment.

[0150] Among them, the computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable computer disk, and a hard disk. Random Access Memory (RAM), Read-Only Memory (ROM), Erasable Programmable Read Only Memory (EPROM), registers, hard disks, optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any other form of computer-readable storage medium in a suitable combination of the above, or numerical values ​​in the art. An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an Application Specific Integrated Circuit (ASIC). In the embodiments of the present disclosure, computer-readable storage media may be any tangible media that contains or stores a program that may be used by or in conjunction with an instruction execution system, apparatus, or device.

[0151] Since the apparatus, device, computer-readable storage medium, and computer program product in the embodiments of the present disclosure can be applied to the above-mentioned method, the technical effects that can be obtained can also refer to the above-mentioned method embodiments, and the embodiments of the present disclosure will not be repeated here.

[0152] The above is only a specific implementation of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present disclosure should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the rights requirements.

Claims

1. A method for evaluating a perceptual measurement result, characterized in that: include: Receive request information; The request information includes: a sensing device identifier, a type of sensing service, and a sensing index of the type of sensing service; the sensing device identifier is used to determine a target sensing device that performs the sensing service; the sensing index is used to determine whether the target sensing device meets the requirements of the sensing service; Instructing the target sensing device to perform the sensing service based on the request information, generating a first sensing measurement report; the first sensing measurement report includes a sensing measurement result generated by the target sensing device performing the sensing service; the sensing measurement result includes a measurement parameter of the sensing indicator; Based on the measurement parameters of the perception indicator and the target parameter value of the perception indicator, the pass rate of the perception measurement result of the target perception device is determined; the target parameter value of the perception indicator is the parameter value that meets the perception business requirements under the perception indicator.

2. The method according to claim 1, characterized in that The method further comprises: Based on the qualified rate of the perception measurement results of the target perception device and a preset qualified rate threshold, it is determined whether the target perception device has successfully perceived.

3. The method according to claim 2, characterized in that The determining whether the target sensing device has successfully sensed based on the qualified rate of the sensing measurement result of the target sensing device and a preset qualified rate threshold comprises: In the case where it is determined that the qualified rate of the perception measurement result of the target perception device is greater than a preset threshold, determining that the perception of the target perception device is successful; When it is determined that the qualified rate of the perception measurement result of the target perception device is less than a preset threshold, it is determined that the perception of the target perception device fails.

4. The method according to claim 3, characterized in that The method further comprises: When it is determined that the target sensing device has successfully sensed, the sensing measurement report is sent to a sensing information processing device; the sensing information processing device is used to perform visualization processing on the sensing measurement report; In the case of determining that the target sensing device fails in sensing, instructing the target sensing device to perform the sensing service and generate a second sensing measurement report; the second sensing measurement report is used to determine whether the target sensing device succeeds in sensing.

5. The method according to claim 4, characterized in that The perception indicators include: perception recognition accuracy, perception distance accuracy, perception angle accuracy, perception area information, and perception delay information.

6. The method according to claim 5, characterized in that The determining the qualified rate of the perception measurement result of the target perception device based on the measurement parameter of the perception indicator and the target parameter value of the perception indicator includes: Determining a pass rate of the perceptual recognition accuracy based on a measurement parameter of the perceptual recognition accuracy and a target parameter value of the perceptual recognition accuracy; Determining the pass rate of the perceived distance accuracy based on the measurement parameters of the perceived distance accuracy and the target parameter value of the perceived distance accuracy; Determining a qualified rate of the perception angle accuracy based on a measurement parameter of the perception angle accuracy and a target parameter value of the perception angle accuracy; determining a qualified rate of the perception area information based on the measurement parameters of the perception area information and the target parameter value of the perception area information; Determining a pass rate of the perceived delay information based on a measurement parameter of the perceived delay information and a target parameter value of the perceived delay information; The pass rate of the perception measurement results of the target perception device is determined based on the preset weight values ​​of the perception indicators, the pass rate of the perception recognition accuracy, the pass rate of the perception distance accuracy, the pass rate of the perception angle accuracy, the pass rate of the perception area information, and the pass rate of the perception delay information.

7. The method according to any one of claims 1 to 6, characterized in that: The pass rate of the perception measurement results satisfies the following formula: Among them, P GZ(t) is the qualified rate of the perception measurement results, W is the parameter weight, SZ(t) is the qualified rate of the perception recognition accuracy, JU(t) is the qualified rate of the perception distance accuracy, JD(t) is the qualified rate of the perception angle accuracy, MBY(t) is the qualified rate of the target area information, SY(t) is the qualified rate of the perception delay, and θ is the deviation value.

8. A perception measurement result evaluation device, characterized in that: include: a communication unit and a processing unit; The communication unit is used to receive request information; The request information includes: a sensing device identifier, a type of sensing service, and a sensing index of the type of sensing service; the sensing device identifier is used to determine a target sensing device that performs the sensing service; the sensing index is used to determine whether the target sensing device meets the requirements of the sensing service; The processing unit is configured to instruct the target sensing device to perform the sensing service based on the request information, and generate a first sensing measurement report; the first sensing measurement report includes a sensing measurement result generated by the target sensing device performing the sensing service; the sensing measurement result includes a measurement parameter of the sensing indicator; The processing unit is used to determine the pass rate of the perception measurement results of the target perception device based on the measurement parameters of the perception indicator and the target parameter value of the perception indicator; the target parameter value of the perception indicator is a parameter value that meets the perception business requirements under the perception indicator.

9. A perception measurement result evaluation device, characterized in that: include: A processor and a memory; wherein the memory is used to store computer-executable instructions, and when the perception measurement result evaluation device is running, the processor executes the computer-executable instructions stored in the memory, so that the perception measurement result evaluation device performs the perception measurement result evaluation method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions. When the instructions in the computer-readable storage medium are executed by a processor of the perception measurement result evaluation device, the perception measurement result evaluation device executes the perception measurement result evaluation method according to any one of claims 1 to 7.

11. A computer program product, characterized in that The computer program product comprises instructions, and when the instructions are executed by a computing device, the computing device is caused to perform the perception measurement result evaluation method according to any one of claims 1 to 7.

Images