Airplane cockpit display data identification method, device, equipment and medium

Abstract

The invention discloses an aircraft cockpit display data identification method, device and equipment and a medium. Comprising the steps of determining an image focusing condition of a current aircraft cockpit; when the image focusing condition is successful focusing, acquiring an interface expansion condition, and acquiring display image information according to the interface expansion condition; and obtaining a data identification model, and inputting the display image information into the data identification model to obtain a data identification result. The information acquisition module is arranged, whether the interface expansion module is started or not is judged according to the obtained interface expansion condition when the image focusing condition is successful focusing, and then the data identification result can be directly obtained by obtaining the display image information and inputting the display image information into the trained data identification model. And a user can perform reading operation. Manual reading is not needed, the manual workload is reduced, the automation level is high, the test efficiency is improved, the risk that manual operation and data reading are wrong is avoided, and the test accuracy is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of data reading, and in particular to a method, device, equipment and medium for identifying data of an aircraft cockpit display. Background Art

[0002] The aircraft system is a complex system. To ensure the correctness and reliability of the system, a series of performance tests are required during the manufacturing process. The engine indication and crew warning system is a bridge between the pilot and the engine. The display in the cockpit shows the engine status and fault alarm information of dozens of systems on the entire aircraft, providing the pilot with basic information on the engine operation and methods for handling some special situations, so that the pilot can better monitor the normal and safe operation of the engine and maximize the engine's effectiveness, which plays an important role in ensuring flight safety and extending the effective life of the engine.

[0003] With the development of avionics technology and the continuous improvement of aircraft assembly test efficiency, the automation of ground functional test has become an inevitable trend. During the aircraft assembly or maintenance stage, the existing technology mainly uses manual testing for ground functional tests, that is, the cockpit observer tells the personnel at the test location the operation and display status information through the intercom.

[0004] The existing technology adopts the manual testing method, which increases the manual workload, is time-consuming and labor-intensive, makes the test efficiency low, and has a low level of automation. In addition, there is a risk of manual operation and data reading errors, which reduces the accuracy of the test. Summary of the invention

[0005] The present invention provides a method, device, equipment and medium for identifying data of a display screen in a cockpit of an aircraft, so as to complete the automatic operation of function keys in the cockpit of an aircraft and the reading of display screen data, and realize the automatic test of the ground function test of the aircraft.

[0006] According to one aspect of the present invention, a method for identifying aircraft cockpit display data is provided, the method comprising:

[0007] Determine the current image focus of the aircraft cockpit;

[0008] When the image focus status is successful, the interface expansion status is obtained, and the display image information is obtained according to the interface expansion status;

[0009] A data recognition model is obtained, and the display image information is input into the data recognition model to obtain a data recognition result.

[0010] Optionally, determining the focus status of the image of the current aircraft cockpit includes: taking a designated area set by a user as a target area, and obtaining a focused image of the current aircraft cockpit based on the target area; judging whether the image resolution of the focused image is greater than a preset threshold, and if so, determining that the image focus status is a focus success; otherwise, determining that the image focus status is a focus failure.

[0011] Optionally, obtaining the interface expansion status includes: determining whether an interface expansion module startup signal is received, and if so, determining that the interface expansion status is that an external device exists; otherwise, determining that the interface expansion status is that no external device exists.

[0012] Optionally, the display image information is obtained according to the interface expansion situation, including: when the interface expansion situation is that an external device exists, obtaining an external device control instruction; controlling the external device to operate based on the external device control instruction, and obtaining the display image information at a specified time interval.

[0013] Optionally, the display image information is obtained according to the interface expansion situation, including: when the interface expansion situation is that there is no external device, the display image information is directly obtained at a specified time interval.

[0014] Optionally, obtaining a data recognition model includes: obtaining historical display images of a target area within a specified time range; obtaining annotation information input by a user based on the historical display images, and generating image samples according to the annotation information; building a recognition model network structure, and performing deep learning on the image samples through the recognition model network structure to generate a data recognition model.

[0015] Optionally, the method also includes: when receiving a data retrieval instruction input by a user, obtaining a preset data call script; retrieving a data recognition result based on the data call script; and sending the data recognition result to a user terminal for display.

[0016] According to another aspect of the present invention, there is provided an aircraft cockpit display data recognition device, the device comprising:

[0017] An image focus determination module is used to determine the image focus of the current aircraft cockpit;

[0018] A display image information acquisition module is used to obtain the interface expansion status when the image focus status is successful, and obtain the display image information according to the interface expansion status;

[0019] The data recognition result acquisition module is used to acquire a data recognition model and input the display image information into the data recognition model to acquire a data recognition result.

[0020] According to another aspect of the present invention, there is provided an electronic device, the electronic device comprising:

[0021] at least one processor; and

[0022] a memory communicatively connected to the at least one processor; wherein,

[0023] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute an aircraft cockpit display data recognition method described in any embodiment of the present invention.

[0024] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement an aircraft cockpit display data recognition method described in any embodiment of the present invention when executed.

[0025] The technical solution of the embodiment of the present invention arranges the information acquisition module, and when the image focusing condition is successful, determines whether to start the interface expansion module according to the obtained interface expansion condition, and then obtains the display image information, inputs the display image information into the trained data recognition model, and directly obtains the data recognition result for the user to perform the reading operation. No manual reading is required, which reduces the manual workload, has a high level of automation, improves the test efficiency, avoids the risk of manual operation and data reading errors, and improves the accuracy of the test.

[0026] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0028] Figure 1 is a flow chart of a method for identifying aircraft cockpit display data provided according to Embodiment 1 of the present invention;

[0029] Figure 2 is a structural schematic diagram of an automatic identification system for aircraft ground function tests provided according to Embodiment 1 of the present invention;

[0030] Figure 3is a flow chart of another aircraft cockpit display data recognition method provided according to Embodiment 1 of the present invention;

[0031] Figure 4 is a flow chart of another aircraft cockpit display data recognition method provided according to Embodiment 2 of the present invention;

[0032] Figure 5 is a structural schematic diagram of an aircraft cockpit display data recognition device provided according to Embodiment 3 of the present invention;

[0033] Figure 6 The present invention is a schematic diagram of the structure of an electronic device for implementing an aircraft cockpit display data recognition method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0034] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0035] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0036] Embodiment 1

[0037] Figure 1 A flowchart of a method for recognizing aircraft cockpit display data is provided for the first embodiment of the present invention. This embodiment can be applied to ground function tests during aircraft assembly, for example, onboard function tests such as engine indication and crew warning systems. The method can be performed by an aircraft cockpit display data recognition device, which can be implemented in the form of hardware and / or software, and can be configured in a computer controller. Figure 1 As shown, the method includes:

[0038] S110: Determine the current focus status of the image in the cockpit of the aircraft.

[0039] Among them, the cockpit refers to the cockpit where the pilot controls the aircraft, usually located at the front of an aircraft. Nowadays, the cockpits of most aircraft adopt a closed design, and various flight instruments and aircraft control systems are generally installed in the cockpit of the aircraft. In most civil aircraft, the cockpit and the passenger cabin are separated by a door. The cockpit includes displays, such as EICAS displays. EICAS displays refer to display screens used to display engine status and fault alarm information of dozens of systems on the entire aircraft. They provide pilots with basic information on engine operation and methods for handling some special situations, so that pilots can better monitor the normal and safe operation of the engine and maximize the engine's effectiveness. It plays a great role in ensuring flight safety and extending the effective life of the engine.

[0040] Specifically, the image focus of the current aircraft cockpit can be determined through the information acquisition module. For example, the function of collecting display information during the ground functional test can be realized through an industrial camera, lens, light source, automatic rotating platform and tripod. The image focus situation represents the clarity of the image taken by the information acquisition module. It should be noted that the technical solution of the embodiment of the present invention can be implemented by an automatic identification system for aircraft ground functional tests, which is mainly composed of five parts: an information acquisition module, a communication module, an information processing module, an information display and control module, and an interface expansion module.

[0041] For example, Figure 2 The present invention provides a schematic diagram of the structure of an automatic identification system for ground function tests of an aircraft. Figure 2 In the figure, 1 represents the cockpit, 11 represents the cockpit display, 2 represents the cockpit information acquisition system, 21 represents the industrial camera, 22 represents the automatic rotating platform, 23 represents the camera bracket, 3 represents the router, and 4 represents the information control platform. The system has the functions of collecting, remotely transmitting, processing and identifying the information on the cockpit display of the aircraft. The industrial camera installed in the cockpit automatically aligns with the display to collect and obtain the original information, and then uploads the original information to the server and the background for image processing through the local area network established by the router, so as to obtain the actual ground function test information required.

[0042] Optionally, determining the focus status of the image of the current aircraft cockpit includes: taking a designated area set by a user as a target area, and obtaining a focused image of the current aircraft cockpit based on the target area; judging whether the image resolution of the focused image is greater than a preset threshold, and if so, determining that the image focus status is a focus success; otherwise, determining that the image focus status is a focus failure.

[0043] Specifically, the user can place the information acquisition module according to the pre-selected cockpit placement position, and set the designated area of ​​the cockpit as the target area. At this time, the information acquisition module will focus through the autofocus algorithm script, that is, the industrial camera and the display will be automatically focused to obtain a clear and effective display image. The focus image of the current aircraft cockpit can be obtained based on the target area, and then the image focus situation can be determined by comparing the image resolution to determine whether the acquired image information is clear and effective. When the image resolution of the focused image is greater than the preset threshold, it can be determined that the image focus situation is a successful focus, which means that the display image information acquired at this time is clear and effective. When the image resolution of the focused image is not greater than the preset threshold, it is determined that the image focus situation is a failed focus, which means that the display image information acquired at this time is not clear and effective, and the user needs to readjust the position of the information acquisition module.

[0044] S120: When the image focusing status is successful, obtain the interface expansion status, and obtain the display image information according to the interface expansion status.

[0045] Among them, the interface expansion status refers to the connection status of the interface expansion module. The interface expansion module is mainly used to facilitate the subsequent operation linkage with the robot. The interface expansion function is reserved in the background, and the control and data processing of the robot are completed through the communication interface designed by Python.

[0046] Figure 3 A flowchart of a method for identifying aircraft cockpit display data is provided for the first embodiment of the present invention, wherein step S120 mainly includes the following steps S121 to S126:

[0047] S121. When the image focusing condition is successful, determine whether an interface expansion module start signal is received. If so, execute S122-S124. Otherwise, execute S125-S126.

[0048] S122: Determine that the interface expansion status is that an external device exists.

[0049] S123. When the interface expansion status indicates that an external device exists, obtain an external device control instruction.

[0050] S124: Control the external device to operate based on the external device control instruction, and obtain display image information at a specified time interval.

[0051] Specifically, when the user is operating, if an external device, such as a robotic arm, is needed, the user clicks the start button on the information display and control module, and an interface expansion module start signal is generated. When it is determined that the interface expansion module start signal is received, it indicates that the interface expansion situation is that an external device exists. At this time, the external device control instruction can be obtained, and the external device can be controlled to operate based on the external device control instruction. For example, an operation instruction is sent to the robotic arm through the Ethernet communication protocol to allow it to complete the specific operation of the ground function test.

[0052] Among them, the information display and control module is used to realize the function of displaying relevant information of functional tests. The web page can be built through the B / S architecture, and the data interaction interface can be designed through Python to display and control the background data on the front-end page.

[0053] Furthermore, the user can set the time interval for collecting images, that is, specify the time interval, and the controller will obtain the display image information at the specified time interval. Exemplarily, the specified time interval can be 1s, and the industrial camera is used to capture the display information changes in real time every 1s. This embodiment has good versatility, operability and scalability, and supports simultaneous information recognition of multiple displays in the cockpit. In addition, according to test needs, the automatic recognition system can be combined with external devices to complete the automatic operation and data reading of the function buttons in the aircraft cockpit.

[0054] S125. Determine that the interface expansion status is that there is no external device.

[0055] S126. When the interface expansion status is that there is no external device, directly obtain the display image information at a specified time interval.

[0056] Specifically, when it is determined that no interface expansion module start signal is received, it indicates that the interface expansion status is that no external device exists. At this time, there is no need to control the external device, and the display image information can be directly obtained at the specified time interval.

[0057] S130, obtaining a data recognition model, and inputting the display image information into the data recognition model to obtain a data recognition result.

[0058] Specifically, the display image information is transmitted to the image processing module in real time through Ethernet communication for processing. The information processing module refers to the use of image processing technology to correct, grayscale, binarize, and segment the collected original display image information, remove invalid information and information irrelevant to ground functional tests, and then store the processed information on the server to facilitate later data tracing. The system also includes a communication module, which is mainly used to realize the data interaction function between the information acquisition module and the information processing module. A local area network is built through a router, and the information acquisition system and the information processing and display system are placed in the same network segment to complete data communication.

[0059] Exemplarily, by adopting image processing technology, the original image is corrected, grayed, binarized, and region segmented to form an image recognition model. By adopting sample training technology, the data recognition model is trained with a large amount of sample data, and finally an optimal data recognition model is formed. The image information obtained by the optimal data recognition model is saved to the server backend database for easy calling of the front-end display interface.

[0060] Optionally, the method also includes: when receiving a data retrieval instruction input by a user, obtaining a preset data call script; retrieving a data recognition result based on the data call script; and sending the data recognition result to a user terminal for display.

[0061] Specifically, the user terminal refers to a mobile terminal connected to the information display and control module. The user terminal includes a front-end display interface. The user terminal includes but is not limited to mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers) and PMPs (portable multimedia players) and other mobile terminal devices. Users can interact with the system and read display data without manually entering the cockpit. When receiving the data retrieval instruction input by the user, the controller will obtain the pre-set data call script. The controller retrieves the data recognition result based on the data call script and sends the data recognition result to the user terminal for display, completing the automatic operation and data reading of the function buttons in the aircraft cockpit, and finally realizing the automatic testing of the aircraft ground function test, while avoiding the risk of manual operation and data reading errors. At the same time, the data can be monitored and stored to improve test efficiency and data backtracking.

[0062] The technical solution of the embodiment of the present invention arranges the information acquisition module, and when the image focusing condition is successful, determines whether to start the interface expansion module according to the obtained interface expansion condition, and then obtains the display image information, inputs the display image information into the trained data recognition model, and directly obtains the data recognition result for the user to perform the reading operation. No manual reading is required, which reduces the manual workload, has a high level of automation, improves the test efficiency, avoids the risk of manual operation and data reading errors, and improves the accuracy of the test.

[0063] Embodiment 2

[0064] Figure 4 This is a flow chart of a method for recognizing aircraft cockpit display data provided in the second embodiment of the present invention. This embodiment describes the specific process of obtaining a data recognition model based on the first embodiment. The specific contents of steps S210-S220 are roughly the same as steps S110-S120 in the first embodiment, so they will not be described in detail in this embodiment. Figure 4 As shown, the method includes:

[0065] S210: Determine the current focus status of the image in the cockpit of the aircraft.

[0066] Optionally, determining the focus status of the image of the current aircraft cockpit includes: taking a designated area set by a user as a target area, and obtaining a focused image of the current aircraft cockpit based on the target area; judging whether the image resolution of the focused image is greater than a preset threshold, and if so, determining that the image focus status is a focus success; otherwise, determining that the image focus status is a focus failure.

[0067] S220: When the image focusing status is successful, obtain the interface expansion status, and obtain the display image information according to the interface expansion status.

[0068] Optionally, obtaining the interface expansion status includes: determining whether an interface expansion module startup signal is received, and if so, determining that the interface expansion status is that an external device exists; otherwise, determining that the interface expansion status is that no external device exists.

[0069] Optionally, the display image information is obtained according to the interface expansion situation, including: when the interface expansion situation is that an external device exists, obtaining an external device control instruction; controlling the external device to operate based on the external device control instruction, and obtaining the display image information at a specified time interval.

[0070] Optionally, the display image information is obtained according to the interface expansion situation, including: when the interface expansion situation is that there is no external device, the display image information is directly obtained at a specified time interval.

[0071] S230, obtaining historical display images of the target area within a specified time range.

[0072] S240 , acquiring annotation information input by the user based on the historical display image, and generating an image sample according to the annotation information.

[0073] S250, building a recognition model network structure, and performing deep learning on image samples through the recognition model network structure to generate a data recognition model.

[0074] Specifically, the data recognition model refers to a model that is pre-trained by the user and can identify the key content in the display image information. The data recognition model contains the correspondence between each display image information and the data recognition result. The target data recognition result corresponding to the display image information can be determined by the data recognition model. When establishing the data recognition model, the controller will obtain the historical display image of the target area within the specified time range. The historical display image refers to each display image collected by the information acquisition module within the specified time range. The user can mark the historical display image to generate sample data. It should be noted that the marked content is the key information in the display image, such as warning information, status information of the hydraulic landing gear, oil temperature and hydraulic information. The user can build a recognition model network structure according to the training needs. Finally, the controller can generate a data recognition model for identifying key information by performing deep learning on the image sample through the recognition model network structure. The data recognition model is generated by performing deep learning on the image sample through the recognition model network structure.

[0075] S260: Input the display image information into a data recognition model to obtain a data recognition result.

[0076] Optionally, the method also includes: when receiving a data retrieval instruction input by a user, obtaining a preset data call script; retrieving a data recognition result based on the data call script; and sending the data recognition result to a user terminal for display.

[0077] The technical solution of the embodiment of the present invention arranges the information acquisition module, and when the image focusing condition is successful, determines whether to start the interface expansion module according to the obtained interface expansion condition, and then obtains the display image information, inputs the display image information into the trained data recognition model, and directly obtains the data recognition result for the user to perform the reading operation. No manual reading is required, which reduces the manual workload, has a high level of automation, improves the test efficiency, avoids the risk of manual operation and data reading errors, and improves the accuracy of the test.

[0078] Embodiment 3

[0079] Figure 5This is a schematic diagram of the structure of an aircraft cockpit display data recognition device provided by the third embodiment of the present invention. Figure 5 As shown, the device includes: an image focus condition determination module 310, which is used to determine the image focus condition of the current aircraft cockpit;

[0080] The display image information acquisition module 320 is used to acquire the interface expansion status when the image focus status is successful, and acquire the display image information according to the interface expansion status;

[0081] The data recognition result acquisition module 330 is used to acquire a data recognition model and input the display image information into the data recognition model to acquire a data recognition result.

[0082] Optionally, the image focus status determination module 310 is specifically used to: take the designated area set by the user as the target area, and obtain the focus image of the current aircraft cockpit based on the target area; determine whether the image resolution of the focus image is greater than a preset threshold, and if so, determine that the image focus status is a focus success; otherwise, determine that the image focus status is a focus failure.

[0083] Optionally, the display image information acquisition module 320 specifically includes: an interface expansion status acquisition unit, used to: determine whether the interface expansion module startup signal is received, if so, determine the interface expansion status as the existence of an external device; otherwise, determine the interface expansion status as the absence of an external device.

[0084] Optionally, the display image information acquisition module 320 specifically includes: an external device control unit, which is used to: when the interface expansion situation is that there is an external device, obtain an external device control instruction; control the external device to operate based on the external device control instruction, and obtain the display image information at a specified time interval.

[0085] Optionally, the display image information acquisition module 320 specifically includes: a no external device information acquisition unit, which is used to: when the interface expansion situation is that there is no external device, directly acquire the display image information at a specified time interval.

[0086] Optionally, the data recognition result acquisition module 330 specifically includes: a data recognition model acquisition unit, used to: obtain historical display images of the target area within a specified time range; obtain annotation information input by the user based on the historical display images, and generate image samples according to the annotation information; build a recognition model network structure, and perform deep learning on the image samples through the recognition model network structure to generate a data recognition model.

[0087] Optionally, the device also includes: a data identification result display module, which is used to: when receiving a data retrieval instruction input by a user, obtain a pre-set data call script; retrieve the data identification result based on the data call script; and send the data identification result to the user terminal for display.

[0088] The technical solution of the embodiment of the present invention arranges the information acquisition module, and when the image focusing condition is successful, determines whether to start the interface expansion module according to the obtained interface expansion condition, and then obtains the display image information, inputs the display image information into the trained data recognition model, and directly obtains the data recognition result for the user to perform the reading operation. No manual reading is required, which reduces the manual workload, has a high level of automation, improves the test efficiency, avoids the risk of manual operation and data reading errors, and improves the accuracy of the test.

[0089] An aircraft cockpit display data recognition device provided in an embodiment of the present invention can execute an aircraft cockpit display data recognition method provided in any embodiment of the present invention, and has corresponding functional modules and beneficial effects of the execution method.

[0090] Embodiment 4

[0091] Figure 6 A schematic diagram of the structure of an electronic device 10 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0092] like Figure 6As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0093] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0094] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The processor 11 executes the various methods and processes described above, such as a method for recognizing data in an aircraft cockpit display. That is: determining the image focus status of the current aircraft cockpit; when the image focus status is successful, obtaining the interface expansion status, and obtaining the display image information according to the interface expansion status; obtaining a data recognition model, and inputting the display image information into the data recognition model to obtain a data recognition result.

[0095] In some embodiments, a method for identifying aircraft cockpit display data may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the method for identifying aircraft cockpit display data described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform an aircraft cockpit display data identification method in any other appropriate manner (e.g., by means of firmware).

[0096] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (CPLDs), computer hardware, firmware, software, and / or combinations thereof, application specific standard products (ASSPs), system on a chip systems (SOCs), combinations thereof. These various embodiments may include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0097] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0098] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0099] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0100] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0101] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0102] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0103] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for identifying aircraft cockpit display data, characterized in that: include: Determine the current image focus of the aircraft cockpit; When the image focusing condition is successful, obtaining the interface expansion condition, and obtaining the display image information according to the interface expansion condition; A data recognition model is obtained, and the display image information is input into the data recognition model to obtain a data recognition result.

2. The method according to claim 1, characterized in that: Determining the current image focus status of the aircraft cockpit includes: Taking a designated area set by a user as a target area, and acquiring a focus image of the current aircraft cockpit based on the target area; Determine whether the image resolution of the focused image is greater than a preset threshold, and if so, determine that the image focus is successful; Otherwise, it is determined that the image focus condition is focus failure.

3. The method according to claim 1, characterized in that: The acquisition interface expansion includes: Determine whether an interface expansion module start signal is received, and if so, determine that the interface expansion condition is that an external device exists; Otherwise, it is determined that the interface expansion condition is that no external device exists.

4. The method according to claim 3, characterized in that The obtaining of display image information according to the interface expansion condition includes: When the interface expansion condition is that an external device exists, obtaining an external device control instruction; The external device is controlled to operate based on the external device control instruction, and the display image information is acquired at a specified time interval.

5. The method according to claim 4, characterized in that The obtaining of display image information according to the interface expansion condition includes: When the interface expansion condition is that there is no external device, the display image information is directly obtained at a specified time interval.

6. The method according to claim 2, characterized in that The acquiring of the data recognition model comprises: Acquire historical display images of the target area within a specified time range; Acquiring annotation information input by a user based on the historical display image, and generating an image sample according to the annotation information; A recognition model network structure is constructed, and deep learning is performed on the image samples through the recognition model network structure to generate the data recognition model.

7. The method according to claim 1, characterized in that The method further comprises: When receiving a data retrieval instruction input by the user, obtaining a preset data call script; Calling a script based on the data to retrieve the data recognition result; The data recognition result is sent to the user terminal for display.

8. An aircraft cockpit display data recognition device, characterized in that: include: An image focus determination module is used to determine the image focus of the current aircraft cockpit; A display image information acquisition module, used to acquire an interface expansion status when the image focus status is successful, and acquire display image information according to the interface expansion status; The data recognition result acquisition module is used to acquire a data recognition model and input the display image information into the data recognition model to acquire a data recognition result.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can perform the method according to any one of claims 1 to 7.

10. A computer storage medium, characterized in that: The computer storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the method according to any one of claims 1 to 7 when executed.

Images