Question and answer content extraction method and system in programming environment, electronic equipment and medium

Abstract

The invention discloses a question and answer content extraction method and system in a programming environment, electronic equipment and a medium, and the system comprises: a data processing module, which is used for preprocessing input network question and answer text data, removing useless information and carrying out word segmentation; an entity recognition module, which is used for performing entity recognition in the field of software engineering on the text processed by the data processing module; a document reading module, which is used for inputting the text recognized by the entity recognition module into a neural network for document reading; and an abstract extraction module, which is used for extracting the key content in the question and answer text by using another neural network. The key content in the technical questions and answers can be extracted, the browsing time of developers is shortened, and the field development efficiency of programming is improved.

Description

technical field

[0001] The invention relates to a method, system, electronic equipment and medium for extracting question and answer content in a programming environment, and belongs to the technical field of the Internet. Background technique

[0002] Software development is a flexible and challenging job, and developers need strong learning ability and problem-solving ability. In the programming field, in addition to consulting reference books when encountering problems, developers often seek help from the Internet, ask other developers who have encountered similar problems, and learn from other people's solutions to avoid duplication of effort and improve development efficiency. Therefore, the software question-and-answer community has gradually become active, and is committed to providing developers with a platform to help each other and record questions.

[0003] There are more and more active developers on the technical question and answer platform. They ask questions...

Examples

Embodiment 1

[0029] Embodiment 1: The present invention proposes an extraction system for question and answer content under a programming environment, including:

[0030] The data processing module is used to perform: preprocessing the input network question and answer text data, removing useless information and performing word segmentation;

[0031] An entity recognition module, configured to perform: performing entity recognition in the field of software engineering on the text processed by the data processing module;

[0032] The document reading module is used to execute: input the text identified by the entity recognition module into the neural network for document reading;

[0033] The summary extraction module is used for execution: using another neural network to extract the key content in the question and answer text.

[0034] Preferably, the specific execution of the data processing module includes: initial state; processing code segments in the question-and-answer text; processin...

Embodiment 2

[0037] Embodiment 2: the present invention also proposes the extraction method of question and answer content under the programming environment, and the overall framework of the present invention is as follows figure 1 As shown, a method for extracting question and answer content under a programming environment proposed by the present invention includes the following 4 steps:

[0038] Step 1: For Q&A text on the web, first clear all tab, since the code snippet in the Q&A appears in the tab, clear The content in the tag also clears the code segment; then delete all the html tags, for example And so on; then replace the URL that appears in the text with "@u@", replace the expression that appears such as ":)" with "@e@", and replace the "@" that appears with other users' content with "@a@ "Replace; Finally, use the nltk word segmentation tool to segment the text. The word segmentation needs to take the API name as a whole. For example, os.path.join(path) needs to be separat...

Embodiment 3

[0048] Embodiment 3: The present invention also proposes an electronic device, including a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the method is implemented when the processor executes the program step.

technical field

[0001] The invention relates to a method, system, electronic equipment and medium for extracting question and answer content in a programming environment, and belongs to the technical field of the Internet. Background technique

[0002] Software development is a flexible and challenging job, and developers need strong learning ability and problem-solving ability. In the programming field, in addition to consulting reference books when encountering problems, developers often seek help from the Internet, ask other developers who have encountered similar problems, and learn from other people's solutions to avoid duplication of effort and improve development efficiency. Therefore, the software question-and-answer community has gradually become active, and is committed to providing developers with a platform to help each other and record questions.

[0003] There are more and more active developers on the technical question and answer platform. They ask questions...

Examples

Embodiment 1

[0029] Embodiment 1: The present invention proposes an extraction system for question and answer content under a programming environment, including:

[0030] The data processing module is used to perform: preprocessing the input network question and answer text data, removing useless information and performing word segmentation;

[0031] An entity recognition module, configured to perform: performing entity recognition in the field of software engineering on the text processed by the data processing module;

[0032] The document reading module is used to execute: input the text identified by the entity recognition module into the neural network for document reading;

[0033] The summary extraction module is used for execution: using another neural network to extract the key content in the question and answer text.

[0034] Preferably, the specific execution of the data processing module includes: initial state; processing code segments in the question-and-answer text; processin...

Embodiment 2

[0037] Embodiment 2: the present invention also proposes the extraction method of question and answer content under the programming environment, and the overall framework of the present invention is as follows figure 1 As shown, a method for extracting question and answer content under a programming environment proposed by the present invention includes the following 4 steps:

[0038] Step 1: For Q&A text on the web, first clear all tab, since the code snippet in the Q&A appears in the tab, clear The content in the tag also clears the code segment; then delete all the html tags, for example And so on; then replace the URL that appears in the text with "@u@", replace the expression that appears such as ":)" with "@e@", and replace the "@" that appears with other users' content with "@a@ "Replace; Finally, use the nltk word segmentation tool to segment the text. The word segmentation needs to take the API name as a whole. For example, os.path.join(path) needs to be separat...

Embodiment 3

[0048] Embodiment 3: The present invention also proposes an electronic device, including a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the method is implemented when the processor executes the program step.

Images