Methods, apparatus, electronic devices and storage media for generating product prototypes

By automatically generating product prototypes through speech recognition and semantic analysis, the problem of long communication times between product managers and R&D personnel has been solved, improving the efficiency of product prototype production and reducing costs.

CN115167817BActive Publication Date: 2026-11-10CHINA TELECOM CORP LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210629748.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-06-06
Publication Date
2026-11-10
Estimated Expiration
2042-06-06

AI Technical Summary

Technical Problem

In existing technologies, product managers and R&D personnel spend a lot of time communicating product requirements, resulting in low efficiency in product prototyping and high marginal costs.

Method used

By acquiring voice information describing product requirements, performing voice recognition and semantic analysis, determining target interface elements and their layout structure logic, and automatically generating product prototypes.

Benefits of technology

It reduced communication time between product managers and developers, improved product prototyping efficiency, and reduced marginal costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115167817B_ABST
    Figure CN115167817B_ABST
Patent Text Reader

Abstract

This invention provides a method, apparatus, electronic device, and storage medium for generating product prototypes. The method includes: acquiring voice information describing product requirements; performing speech recognition on the voice information to obtain text information; performing semantic analysis on the text information to determine target interface elements in the product prototype and the layout structure logic of the target interface elements; and combining the target interface elements according to the layout structure logic to generate the product prototype. This invention can automatically generate product prototypes by analyzing voice information describing product requirements, reducing or eliminating communication between product managers and developers. Therefore, it can complete the production of product prototypes without spending a long time, improving the efficiency of product prototype production and thus reducing the marginal cost of product prototype production.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of Internet technology, and in particular to a method for generating a product prototype, a device for generating a product prototype, an electronic device, and a computer-readable storage medium. Background Technology

[0002] With the widespread adoption of 5G and the development of wireless services, mobile phones and other terminal devices have become essential tools for people to handle various daily tasks. Applications installed on these devices offer a wide range of functions, making life more convenient and fulfilling.

[0003] In an application development team, for each product design, the product manager needs to create a product prototype from an idea, so that discussions can be held based on the prototype and the product design can be completed quickly.

[0004] However, creating a product prototype first requires the product manager and R&D personnel to communicate product requirements, and then the R&D personnel develop the product prototype. It is evident that the communication between the product manager and R&D personnel regarding product requirements takes a considerable amount of time. Therefore, how to improve the efficiency of product prototype production and thereby reduce the marginal cost of product prototype production is an urgent problem to be solved. Summary of the Invention

[0005] The present invention provides a method, apparatus, electronic device, and computer-readable storage medium for generating product prototypes, in order to solve the problem of how to improve the efficiency of product prototype production and thereby reduce the marginal cost of producing product prototypes.

[0006] This invention discloses a method for generating a product prototype, the method comprising:

[0007] Obtain voice information describing product requirements;

[0008] The voice information is subjected to speech recognition to obtain text information;

[0009] Semantic analysis is performed on the text information to determine the target interface elements in the product prototype and the layout structure logic of the target interface elements.

[0010] The product prototype is generated by combining the target interface elements according to the layout structure logic.

[0011] Optionally, the step of performing semantic analysis on the text information to determine the target interface elements in the product prototype and the layout structure logic of the target interface elements includes:

[0012] The text information is segmented to obtain at least one sentence;

[0013] The statement is segmented into words to obtain at least one word.

[0014] The target interface elements in the product prototype are determined based on the word segmentation in the statement, and the layout structure logic of the target interface elements is determined.

[0015] Optionally, the step of determining the target interface element in the product prototype based on the word segmentation in the statement, and determining the layout structure logic of the target interface element, includes:

[0016] Based on the word segmentation of the verb in the statement, determine the corresponding operation type;

[0017] Based on the word segmentation of nouns in the statement, the corresponding interface elements are obtained from the preset interface element library and used as target interface elements in the product prototype.

[0018] Obtain the interface element information of the target interface element; the interface element information is used to standardize and constrain the corresponding interface element when generating the product prototype;

[0019] Based on the order of word segmentation corresponding to the target interface element in the statement, the operation type, and the interface element information, the layout structure logic of the target interface element is determined.

[0020] Optionally, the step of retrieving corresponding interface elements from a pre-set interface element library based on word segmentation of nouns in the statement, and using them as target interface elements in the product prototype, includes:

[0021] Retrieve interface elements from a pre-set interface element library that correspond to the word segmentation of nouns in the statement, and use them as candidate interface elements.

[0022] Obtain the matching weight and matching probability corresponding to the operation type in the statement containing each candidate interface element;

[0023] Calculate the weighted average of the candidate interface elements based on the matching weight and the matching probability;

[0024] The candidate interface element with the highest weighted average value is selected as the target interface element in the product prototype.

[0025] Optionally, each of the interface elements has corresponding interface element information, which includes at least one of element identifier, layer information, attributes, name, layout, and special attributes of the element; the operation type includes at least one of drawing operation, writing text operation, defining the next drawing area operation, splitting the previous interface element operation, and no operation.

[0026] Optionally, after generating the product prototype by combining the target interface elements according to the layout structure logic, the method further includes:

[0027] In response to a functional description instruction for the product prototype, the product prototype is demonstrated.

[0028] Optionally, the demonstration of the product prototype includes:

[0029] Expand the target interface element in the product prototype, or collapse the target interface element in the product prototype.

[0030] This invention also discloses a product prototype generation apparatus, the apparatus comprising:

[0031] The voice acquisition module is used to acquire voice information describing product requirements;

[0032] A speech recognition module is used to perform speech recognition on the speech information to obtain text information;

[0033] The semantic analysis module is used to perform semantic analysis on the text information to determine the target interface elements in the product prototype and the layout structure logic of the target interface elements.

[0034] The prototype generation module is used to generate the product prototype by combining the target interface elements according to the layout structure logic.

[0035] Optionally, the semantic analysis module is specifically used for:

[0036] The text information is segmented to obtain at least one sentence;

[0037] The statement is segmented into words to obtain at least one word.

[0038] The target interface elements in the product prototype are determined based on the word segmentation in the statement, and the layout structure logic of the target interface elements is determined.

[0039] Optionally, the semantic analysis module is specifically used for:

[0040] Based on the word segmentation of the verb in the statement, determine the corresponding operation type;

[0041] Based on the word segmentation of nouns in the statement, the corresponding interface elements are obtained from the preset interface element library and used as target interface elements in the product prototype.

[0042] Obtain the interface element information of the target interface element; the interface element information is used to standardize and constrain the corresponding interface element when generating the product prototype;

[0043] Based on the order of word segmentation corresponding to the target interface element in the statement, the operation type, and the interface element information, the layout structure logic of the target interface element is determined.

[0044] Optionally, the semantic analysis module is specifically used for:

[0045] Retrieve interface elements from a pre-set interface element library that correspond to the word segmentation of nouns in the statement, and use them as candidate interface elements.

[0046] Obtain the matching weight and matching probability corresponding to the operation type in the statement containing each candidate interface element;

[0047] Calculate the weighted average of the candidate interface elements based on the matching weight and the matching probability;

[0048] The candidate interface element with the highest weighted average value is selected as the target interface element in the product prototype.

[0049] Optionally, each of the interface elements has corresponding interface element information, which includes at least one of element identifier, layer information, attributes, name, layout, and special attributes of the element; the operation type includes at least one of drawing operation, writing text operation, defining the next drawing area operation, splitting the previous interface element operation, and no operation.

[0050] Optionally, the device further includes:

[0051] The product prototype demonstration module is used to demonstrate the product prototype in response to a functional description instruction for the product prototype.

[0052] Optionally, the product prototype demonstration module is used for:

[0053] Expand the target interface element in the product prototype, or collapse the target interface element in the product prototype.

[0054] This invention also discloses an electronic device, including a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus;

[0055] The memory is used to store computer programs;

[0056] When the processor executes a program stored in the memory, it implements the method described in the embodiments of the present invention.

[0057] This invention also discloses a computer program product stored in a storage medium, which is executed by at least one processor to implement the method described in this invention.

[0058] This invention also discloses a computer-readable storage medium storing instructions that, when executed by one or more processors, cause the processors to perform the methods described in this invention.

[0059] The embodiments of the present invention have the following advantages:

[0060] In this embodiment of the invention, voice information describing product requirements is acquired, and voice recognition is performed to obtain text information. Semantic analysis is then performed on the text information to determine the target interface elements and their layout structure logic in the product prototype. Finally, the product prototype can be automatically generated by combining the target interface elements according to the layout structure logic. This embodiment of the invention can automatically generate product prototypes by analyzing voice information describing product requirements, reducing or eliminating communication between product managers and developers. Therefore, product prototype creation can be completed much faster, improving efficiency and reducing marginal costs. Attached Figure Description

[0061] Figure 1 This is a schematic diagram of an application environment provided in an embodiment of the present invention;

[0062] Figure 2 This is a flowchart of the steps of a product prototype generation method provided in an embodiment of the present invention;

[0063] Figure 3 This is a schematic diagram of a business scenario for generating an App product prototype provided in an embodiment of the present invention;

[0064] Figure 4 This is a schematic diagram of the main process for generating an App product prototype provided in an embodiment of the present invention;

[0065] Figure 5 This is a schematic diagram of the analysis process of a semantic analysis technique provided in an embodiment of the present invention;

[0066] Figures 6A-6F This is a schematic diagram illustrating the generation of a product prototype for an App provided in an embodiment of the present invention;

[0067] Figure 7 This is a structural block diagram of a product prototype generation device provided in an embodiment of the present invention;

[0068] Figure 8 This is a block diagram of an electronic device provided in an embodiment of the present invention. Detailed Implementation

[0069] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0070] The product prototype generation method provided in this embodiment of the invention can be applied to, for example... Figure 1 In the application environment shown, specifically, terminal device 101 acquires voice information describing product requirements; performs speech recognition on the voice information to obtain text information; performs semantic analysis on the text information to determine the target interface elements in the product prototype and the layout structure logic of the target interface elements; and combines the target interface elements according to the layout structure logic to generate the product prototype.

[0071] In practical applications, terminal device 101 may include, but is not limited to, mobile phones, tablets, wearable devices, in-vehicle devices, augmented reality (AR) devices, virtual reality (VR) devices, laptops, personal computers (PCs), personal digital assistants (PDAs), servers, and other electronic devices. The server may be a standalone server or a server cluster consisting of multiple servers, and the server may be a cloud server.

[0072] Reference Figure 2 The diagram illustrates a flowchart of a method for generating a product prototype according to an embodiment of the present invention, which may specifically include the following steps:

[0073] Step 201: Obtain voice information describing product requirements.

[0074] Here, "product" can refer to an app. Product requirements are the description and planning of all the product's functions. During product development, there are corresponding requirement rules. Clearly describing these rules allows developers and testers to understand them intuitively and without ambiguity. A product prototype is a visual representation of the product's functional requirements and serves as a basis for communication. In practical applications, if the description of product requirements involves the product's interface interaction or modifications, a product prototype of the interface needs to be designed.

[0075] The voice information refers to the audio describing the product requirements, which can be acquired in real time through the microphone of the terminal device. For example, a product manager, after racking their brains, suddenly has a flash of inspiration and begins speaking into the microphone of the terminal device about the product requirements for the app: "I need an app called 'Business Hall.' This app has five tabs: 'Home, Inquiry & Service, Life, Messages, and Me.' The upper half of the home screen is a user's phone bill inquiry area, displaying information such as 'Account Balance,' 'Remaining Data,' and 'Remaining Voice Credits.' The lower half of the home screen is a product list that supports scrolling through pages." The terminal device can then acquire the voice information describing the app's product requirements.

[0076] Of course, the voice information describing product requirements can also be obtained in other ways. For example, pre-recorded voice information can be submitted to the terminal device as the voice information describing product requirements. This embodiment of the invention does not impose any restrictions on this.

[0077] Step 202: Perform speech recognition on the speech information to obtain text information.

[0078] Speech recognition, also known as Automatic Speech Recognition (ASR), is a technology that can convert human speech information into text information.

[0079] In this embodiment of the invention, after obtaining the voice information, speech recognition can be performed on the voice information to obtain the corresponding text information. Optionally, the text information can be text in various languages, such as Chinese text, English text, or mixed Chinese and English text, etc., which can be set according to actual needs, and this embodiment of the invention does not impose any restrictions on this.

[0080] Step 203: Perform semantic analysis on the text information to determine the target interface elements in the product prototype and the layout structure logic of the target interface elements.

[0081] Step 204: Generate the product prototype by combining the target interface elements according to the layout structure logic.

[0082] Semantic analysis refers to the process of machines understanding human sentences.

[0083] Interface elements refer to a series of elements in an app's interface that meet user interaction requirements, such as tabs, buttons, icons, and titles. Layout structure logic refers to the way interface elements are arranged within the interface, specifically including their relative layout, names, layers, and whether they can be expanded or collapsed. The target interface element is the interface element currently used to generate the product prototype.

[0084] In this embodiment of the invention, by performing semantic analysis on text information, the target interface elements in the product prototype and their layout structure logic within the interface can be determined. Then, the target interface elements can be combined according to the layout structure logic to generate the product prototype. The product manager can then communicate and discuss this product prototype with relevant personnel (such as other product managers or developers) to adjust product requirements or modify the product prototype itself. It is understood that further communication and discussion based on an actual product prototype improves communication efficiency, reduces the workload of the product manager, and allows the product manager more time to develop more creative ideas.

[0085] Reference Figure 3 This is a schematic diagram illustrating a business scenario for generating an App product prototype, provided in an embodiment of the present invention. The specific implementation process includes: a product manager, after much thought, suddenly has a flash of inspiration and begins speaking into a terminal device, stating that the desired App prototype design is "XXXXXX". The terminal device then collects the voice information of the product manager describing the product requirements. The voice information is converted into text information, and semantic analysis is performed on the text information to obtain each interface element and layout structure logic of the App prototype design. Based on the interface elements and layout structure logic determined by semantic analysis, relevant elements are found from the interface element library and combined according to the layout structure logic. A product prototype is then generated.

[0086] In the above-mentioned product prototype generation, voice information describing product requirements is acquired, speech recognition is performed on the voice information to obtain text information, semantic analysis is performed on the text information to determine the target interface elements and their layout structure logic in the product prototype, and then the product prototype can be automatically generated by combining the target interface elements according to the layout structure logic. This embodiment of the invention can automatically generate product prototypes by analyzing voice information describing product requirements, reducing or eliminating communication between product managers and developers. Therefore, product prototype creation can be completed without spending a long time, improving the efficiency of product prototype creation and thus reducing the marginal cost of product prototype creation.

[0087] Based on the above embodiments, modified embodiments of the above embodiments are proposed. It should be noted that, in order to keep the description brief, only the differences from the above embodiments are described in the modified embodiments.

[0088] In an exemplary embodiment, step 203, performing semantic analysis on the text information to determine the target interface elements in the product prototype and the layout structure logic of the target interface elements, may include the following steps:

[0089] The text information is segmented to obtain at least one sentence;

[0090] The statement is segmented into words to obtain at least one word.

[0091] The target interface elements in the product prototype are determined based on the word segmentation in the statement, and the layout structure logic of the target interface elements is determined.

[0092] When drawing a product prototype, the target interface elements of the product prototype are usually drawn step by step. In this embodiment of the invention, the required product prototype can be obtained by drawing the target interface elements of the product prototype step by step. Therefore, after converting the voice information describing the product requirements into text information, the text information can be segmented to obtain one or more sentences. Then, the target interface elements of the product prototype can be drawn step by step based on the sentences to obtain the required product prototype.

[0093] In practical implementation, considering that at least one operation type and one target interface element are usually required when drawing the target interface elements of a product prototype, the text information is segmented into sentences. A sentence can include verbs (corresponding to operation types) and nouns (corresponding to target interface elements), or a sentence can include only nouns. The target interface elements in the product prototype can be determined based on the nouns in the sentences, and the layout structure logic of the target interface elements can be determined based on the nouns and verbs in the sentences. Of course, in practice, the segmentation method can be set according to actual needs, and this embodiment of the invention does not impose any limitations on this.

[0094] In this embodiment of the invention, after the text information is processed to obtain sentences, the word segmentation of each sentence is processed to obtain one or more words in each sentence. Then, the drawing operation of the product prototype can be predicted based on the word segmentation in the sentence, that is, the target interface elements in the product prototype and the layout structure logic of each target interface element are determined.

[0095] In the above exemplary embodiment, after converting the voice information describing product requirements into text information, the text information can be processed to obtain sentences, and then each sentence can be processed to obtain word segments. Finally, the target interface elements in the product prototype and the layout structure logic of the target interface elements can be determined based on the word segments in each sentence, so that the product prototype can be drawn in an orderly manner and the product prototype can be automatically generated.

[0096] In an exemplary embodiment, determining the target interface element in the product prototype based on the word segmentation in the statement, and determining the layout structure logic of the target interface element, may include the following steps:

[0097] Based on the word segmentation of the verb in the statement, determine the corresponding operation type;

[0098] Based on the word segmentation of nouns in the statement, the corresponding interface elements are obtained from the preset interface element library and used as target interface elements in the product prototype.

[0099] Obtain the interface element information of the target interface element; the interface element information is used to standardize and constrain the corresponding interface element when generating the product prototype;

[0100] Based on the order of word segmentation corresponding to the target interface element in the statement, the operation type, and the interface element information, the layout structure logic of the target interface element is determined.

[0101] The operation type can include at least one of the following: drawing operation, writing text operation, defining the next drawing area operation, splitting the previous interface element operation, and no operation.

[0102] In practical implementation, the interface elements of product prototypes such as Apps for terminal devices are explicit and enumerable. Therefore, in this embodiment of the invention, an interface element library is pre-set, which includes multiple interface elements. Each interface element is set with its corresponding interface element information. The interface element information can include at least one of the following: element identifier (ID, Identity document), layer information, attributes, name, layout, and special attributes of the element. The interface element information can standardize and constrain the interface elements when generating the product prototype, so that the generated product prototype conforms to the design principles. For example, the interface elements are positioned appropriately in the interface and will not obscure other interface elements that should be displayed.

[0103] In this embodiment of the invention, the operation type is determined based on the word segmentation of verbs in the statement, and the corresponding interface element is determined from the interface element library as the target interface element based on the word segmentation of nouns in the statement. For example, assuming the statement contains verbs such as "have" or "need," the operation type can be determined to be a drawing operation; assuming the statement contains nouns such as "App" or "TAB bar," the target interface elements can be determined to be the App canvas and the tab bar in the interface element library. Of course, in addition to verbs and nouns, statements can usually also include quantifiers. The quantity of interface elements can be determined based on the quantifiers. For example, assuming the statement contains quantifiers such as "4" or "one," the corresponding quantity of interface elements can be determined to be 4 and 1, respectively.

[0104] In this embodiment of the invention, the specific process of semantic analysis includes: word segmentation, determining the operation type, determining the target interface element, and determining the context element relationship (i.e., determining the layout structure logic of the product prototype). The layout structure logic can determine the layout structure logic of the target interface element based on the order of word segmentation in the statement, the operation type, and the interface element information. Subsequently, the target interface element can be built based on the layout structure logic to obtain the product prototype.

[0105] For example, assuming the text message is "I need an app", this text message, after word segmentation, can be obtained as: "I (subject) need (verb) an (quantifier) ​​app (noun)".

[0106] Semantic analysis of the text information can be performed by ignoring the subject of the text information, and then the specific operation type can be determined as drawing operation based on the verb analysis, the number of target interface elements can be determined as 1 based on the quantifier, and the target interface element can be determined as "App canvas" based on the noun.

[0107] In the above exemplary embodiment, after segmenting the text information, the operation type and target interface element are determined based on the segmentation. Then, the layout structure logic of the target interface element can be determined based on the order of the segmentation of the target interface element in the statement, the operation type, and the interface element information. The target interface element is then built based on the layout structure logic to obtain a product prototype. Since the target interface element can be obtained from the existing interface element library, the product prototype can be built quickly, improving the efficiency of product prototype production.

[0108] In an exemplary embodiment, the step of obtaining the corresponding interface element from a preset interface element library based on the word segmentation of nouns in the statement, and using it as the target interface element in the product prototype, may include the following steps:

[0109] Retrieve interface elements from a pre-set interface element library that correspond to the word segmentation of nouns in the statement, and use them as candidate interface elements.

[0110] Obtain the matching weight and matching probability corresponding to the operation type in the statement containing each candidate interface element;

[0111] Calculate the weighted average of the candidate interface elements based on the matching weight and the matching probability;

[0112] The candidate interface element with the highest weighted average value is selected as the target interface element in the product prototype.

[0113] In this embodiment of the invention, the interface element library contains a rich variety of interface elements, and there may be multiple interface elements of the same type. Therefore, when using a noun to determine the target interface element in the interface element library, the interface element that matches the noun, i.e., the candidate interface element, may be one or more. When there is only one candidate interface element, the candidate interface element can be used as the target interface element. When there are multiple candidate interface elements, the target interface element can be further determined from the multiple candidate interface elements based on the operation type corresponding to the statement in which the noun is located.

[0114] Specifically, the formula for determining the target interface element from multiple candidate interface elements is as follows:

[0115]

[0116] Among them, WA i represents the weighted average value of a certain interface element A under the current operation type i, w represents the matching weight with the current operation type i, and x represents the matching probability with the current operation type i.

[0117] In this embodiment of the invention, when there are multiple candidate interface elements, the matching weight and matching probability of each candidate interface element in the statement can be obtained. Then, the weighted average value is calculated based on the matching weight and matching probability using the above matching calculation formula. Finally, the candidate interface element with the highest weighted average value can be used as the target interface element.

[0118] In the above exemplary embodiment, the corresponding interface element is obtained from the interface element library based on the word segmentation of nouns in the statement, and is used as a candidate interface element. When there are multiple candidate interface elements, the matching weight and matching probability corresponding to the operation type in the statement where each candidate interface element is located can be further obtained. The weighted average of the candidate interface elements is calculated based on the probability, and the candidate interface element with the highest weighted average is used as the target interface element for building the product prototype. By calculating the weighted average based on the operation type, the embodiment of the present invention can obtain the target interface element with a high degree of matching, thereby making the product prototype built based on the target interface element more accurate.

[0119] In an exemplary embodiment, after step 204, where the target interface elements are combined according to the layout structure logic to generate the product prototype, the method may further include the following steps:

[0120] In response to a functional description instruction for the product prototype, the product prototype is demonstrated.

[0121] In this embodiment of the invention, after generating a product prototype, a functional description instruction for the product can be responded to to demonstrate the product prototype, facilitating understanding of the various functions possessed by the product prototype by relevant personnel. This functional description instruction can be triggered by a terminal device through voice, touch, or other means.

[0122] In one specific embodiment, demonstrating the product prototype may include: expanding the target interface element in the product prototype, or collapsing the target interface element in the product prototype.

[0123] For example, assuming the product prototype contains target interface elements that can be expanded or collapsed, when the product manager wants to describe the expandable or collapseable functionality of the product prototype to relevant personnel, they can issue a function description instruction to expand or collapse. Upon receiving the instruction, the product prototype can automatically expand or collapse. Optionally, if the product prototype does not possess the functionality corresponding to the function description instruction issued by the product manager, the product manager can be prompted that the functionality is not available, and the system can add or confirm whether there is an error.

[0124] In the above exemplary embodiment, in response to the functional description instruction for the product prototype, the product prototype can be demonstrated accordingly, so that the product manager can better demonstrate the functions of the product prototype to relevant personnel. By cooperating with the product manager's demonstration, communication efficiency is improved, the workload of the product manager is reduced, and the product manager has more time to think about more creative ideas.

[0125] To enable those skilled in the art to better understand the technical solutions of the embodiments of the present invention, specific examples are provided below for illustrative purposes.

[0126] Reference Figure 4 This is a schematic diagram of the main process for generating an App product prototype provided in an embodiment of the present invention. The specific process is as follows: product manager's voice information → converted into text information through voice recognition → semantic analysis of text information to determine target interface elements and layout structure logic → obtaining target interface elements through interface element library → building target interface elements based on layout structure logic to obtain product prototype.

[0127] As can be seen, the main technologies used in the embodiments of the present invention include: semantic analysis technology and product prototype generation technology.

[0128] Among them, semantic processing technology, the specific analysis process is as follows: Figure 5 As shown: The product manager describes the product requirements by voice to obtain voice information → the voice information is recognized by speech to obtain text information → the text information is semantically analyzed to obtain information such as each target interface element, the generation order of the target interface elements, the layer where they are located, attributes, names and layouts, which are used as the target interface elements and layout structure logic for generating the product prototype.

[0129] Specifically, through semantic analysis of the text information "I need an app called 'Business Hall,' which has five tabs: 'Home, Inquiry & Service, Life, Messages, and Me.' The upper half of the home screen is a user's phone bill inquiry area, displaying information such as 'Account Balance,' 'Remaining Data,' and 'Remaining Voice Credits.' The lower half of the home screen is a product list that supports scrolling pagination," the target interface elements and corresponding layout structure logic are as follows:

[0130] Interface element 1:

[0131] Layers: 0

[0132] Attribute: App Canvas

[0133] Name: "Business Hall"

[0134] Layout: Full Screen

[0135] Interface element 2:

[0136] Layer: 1

[0137] Attribute: Tab bar

[0138] Name: None

[0139] Sub-elements: [Homepage, Inquiry & Processing, Lifestyle, Messages, Me]

[0140] Layout: Interface element 1 is bottom aligned

[0141] Interface element 3:

[0142] Layer: 2

[0143] Attribute: Text

[0144] Name: "Account Balance"

[0145] Layout: The title bar of UI element 1 is aligned to the top, at position 1 / 3.

[0146] Specifically, the product prototype generation technology includes: Prototype generation technology standardizes and constrains product prototypes. Since the interface elements of product prototypes for terminal devices (such as apps) are clearly defined and enumerable, a pre-generated interface element library can be used for product prototype generation. Specifically, the interface element library can pre-set bordered interface areas, borderless interface areas, text, tab bars, and other interface elements. Furthermore, multiple different styles can be set for the same interface element. The scope of interface elements is defined, and the attributes and layout of each interface element are defined and can be abstractly described. Based on semantic understanding and learning, the interface elements described by the product manager can be matched against the interface element library to obtain target interface elements. Then, the layout structure logic of each template interface element is analyzed according to the order of description. Finally, the product prototype is built based on the layout structure logic and the target interface elements.

[0147] The following example illustrates this. Suppose the product manager describes the product requirements verbally, obtains voice information, and then performs speech recognition to obtain text information: "I need an app called 'Business Hall.' This app has five tabs: 'Home, Inquiry & Service, Life, Messages, and Me.' The upper half of the home screen is a user's phone bill inquiry area, displaying information such as 'Account Balance,' 'Remaining Data,' and 'Remaining Voice.' The lower half of the home screen is a product list that supports scrolling pagination."

[0148] First, by segmenting the text, we can obtain the following sentences:

[0149] I need an app

[0150] Its name is "Business Hall".

[0151] This app has 5 tabs.

[0152] These five tabs are, in order: "Homepage, Inquiry & Processing, Lifestyle, Messages, and Me".

[0153] The top half of the homepage displays a user's phone bill inquiry area.

[0154] Display query information such as "Account Balance", "Remaining Data", and "Remaining Voice Credits" respectively.

[0155] The bottom half of the homepage displays a product list that supports scrolling through pages.

[0156] Then, semantic analysis is performed on each statement to gradually generate the App's product prototype based on each statement. Specifically:

[0157] I need an app → to draw an "App Canvas," where the "App Canvas" contains pre-stored UI elements from a UI element library. Based on this statement, we can obtain... Figure 6A The product prototype of the App shown.

[0158] The name is "Business Hall" → Draw a "Title" named "Business Hall", where the "Title" is a pre-defined App canvas. Based on this statement, we can obtain... Figure 6B The product prototype of the App shown.

[0159] This app has 5 tab bars. Drawing a "tab bar" consists of 5 tabs. The "tab bar" is a pre-stored UI element in the UI element library and is located at the bottom of the app's canvas by default. Based on this statement, we can obtain... Figure 6C The product prototype of the App shown.

[0160] These five tabs are, in order: "Homepage, Inquiry & Processing, Life, Messages, and Me" → Name and fill in the text for each tab. Based on this statement, we can obtain... Figure 6D The product prototype of the App shown.

[0161] The top half of the homepage displays a user's phone bill inquiry area. The title label area is divided into two parts, with the top half serving as the next drawing area. Based on this statement, we can obtain... Figure 6E The product prototype of the App shown.

[0162] The lower half of the homepage displays a product list, supporting scrolling pagination. The lower half's drawing area adds the product list and a scrolling control; these are all pre-stored UI elements from the UI element library. Based on this statement, we can obtain... Figure 6F The product prototype of the App shown.

[0163] Finally, after completing the drawing based on all the corresponding statements, you can obtain the product prototype of the App described by the product manager.

[0164] In summary, this invention innovatively proposes a method for creating product prototypes of terminal device apps using language, truly realizing the dream of product managers to "just speak," freeing their hands and improving efficiency for product prototype design and rapid idea verification. This invention is highly creative and can be applied to all product prototype design scenarios for terminal device apps, improving design efficiency. Since terminal device apps are indispensable in people's daily lives, this invention has a wide range of applications and strong practicality.

[0165] It should be noted that, for the sake of simplicity, the method embodiments are all described as a series of actions. However, those skilled in the art should understand that the embodiments of the present invention are not limited to the described order of actions, because according to the embodiments of the present invention, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions involved are not necessarily essential to the embodiments of the present invention.

[0166] Reference Figure 7 The diagram shows a structural block diagram of a product prototype generation device provided in an embodiment of the present invention, which may specifically include the following modules:

[0167] The voice acquisition module 701 is used to acquire voice information describing product requirements;

[0168] The speech recognition module 702 is used to perform speech recognition on the speech information to obtain text information;

[0169] The semantic analysis module 703 is used to perform semantic analysis on the text information to determine the target interface elements in the product prototype and the layout structure logic of the target interface elements.

[0170] The prototype generation module 704 is used to generate the product prototype by combining the target interface elements according to the layout structure logic.

[0171] In an exemplary embodiment, the semantic analysis module 703 is specifically used for:

[0172] The text information is segmented to obtain at least one sentence;

[0173] The statement is segmented into words to obtain at least one word.

[0174] The target interface elements in the product prototype are determined based on the word segmentation in the statement, and the layout structure logic of the target interface elements is determined.

[0175] In an exemplary embodiment, the semantic analysis module 703 is specifically used for:

[0176] Based on the word segmentation of the verb in the statement, determine the corresponding operation type;

[0177] Based on the word segmentation of nouns in the statement, the corresponding interface elements are obtained from the preset interface element library and used as target interface elements in the product prototype.

[0178] Obtain the interface element information of the target interface element; the interface element information is used to standardize and constrain the corresponding interface element when generating the product prototype;

[0179] Based on the order of word segmentation corresponding to the target interface element in the statement, the operation type, and the interface element information, the layout structure logic of the target interface element is determined.

[0180] In an exemplary embodiment, the semantic analysis module 703 is specifically used for:

[0181] Retrieve interface elements from a pre-set interface element library that correspond to the word segmentation of nouns in the statement, and use them as candidate interface elements.

[0182] Obtain the matching weight and matching probability corresponding to the operation type in the statement containing each candidate interface element;

[0183] Calculate the weighted average of the candidate interface elements based on the matching weight and the matching probability;

[0184] The candidate interface element with the highest weighted average value is selected as the target interface element in the product prototype.

[0185] In an exemplary embodiment, each of the interface elements has corresponding interface element information, which includes at least one of element identifier, layer information, attributes, name, layout, and special attributes of the element; the operation type includes at least one of drawing operation, writing text operation, defining the next drawing area operation, splitting the previous interface element operation, and no operation.

[0186] In one exemplary embodiment, the apparatus may further include:

[0187] The product prototype demonstration module is used to demonstrate the product prototype in response to a functional description instruction for the product prototype.

[0188] In one exemplary embodiment, the product prototype demonstration module is used for:

[0189] Expand the target interface element in the product prototype, or collapse the target interface element in the product prototype.

[0190] In the above manner, embodiments of the present invention can automatically generate product prototypes by analyzing voice information describing product requirements. Product managers and developers can reduce or even eliminate communication, thus completing the production of product prototypes without spending a long time, improving the efficiency of product prototype production, and thereby reducing the marginal cost of producing product prototypes.

[0191] As the device embodiment is basically similar to the method embodiment, the description is relatively simple, and relevant parts can be found in the description of the method embodiment.

[0192] In addition, this invention also provides an electronic device, including: a processor, a memory, and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, it implements the various processes of the above-described product prototype generation method embodiments and achieves the same technical effect. To avoid repetition, it will not be described again here.

[0193] This invention also provides a computer-readable storage medium storing a computer program. When executed by a processor, the computer program implements the various processes of the above-described product prototype generation method embodiments and achieves the same technical effects. To avoid repetition, it will not be described again here. The computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, etc.

[0194] This invention provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the above-described product prototype generation method embodiment, and achieves the same technical effect. To avoid repetition, it will not be described again here.

[0195] Figure 8 A schematic diagram of the hardware structure of an electronic device for implementing various embodiments of the present invention.

[0196] The electronic device 800 includes, but is not limited to, components such as: a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, a processor 810, and a power supply 811. Those skilled in the art will understand that... Figure 8 The electronic device structures shown are not intended to limit the electronic device. An electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements. In embodiments of the present invention, the electronic device includes, but is not limited to, mobile phones, tablet computers, laptops, PDAs, in-vehicle terminals, wearable devices, and pedometers.

[0197] It should be understood that, in this embodiment of the invention, the radio frequency unit 801 can be used for receiving and transmitting signals during information transmission or calls. Specifically, it receives downlink data from the base station and processes it with the processor 810; additionally, it transmits uplink data to the base station. Typically, the radio frequency unit 801 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low-noise amplifier, a duplexer, etc. Furthermore, the radio frequency unit 801 can also communicate with networks and other devices through a wireless communication system.

[0198] Electronic devices provide users with wireless broadband internet access through network module 802, such as helping users send and receive emails, browse web pages, and access streaming media.

[0199] The audio output unit 803 can convert audio data received by the radio frequency unit 801 or the network module 802 or stored in the memory 809 into audio signals and output them as sound. Furthermore, the audio output unit 803 can also provide audio output related to specific functions performed by the electronic device 800 (e.g., call signal reception sound, message reception sound, etc.). The audio output unit 803 includes a speaker, a buzzer, and a receiver, etc.

[0200] Input unit 804 is used to receive audio or video signals. Input unit 804 may include a graphics processing unit (GPU) 8041 and a microphone 8042. The GPU 8041 processes image data of still images or videos acquired by an image capture device (such as a camera) in video capture mode or image capture mode. The processed image frames can be displayed on display unit 806. The image frames processed by GPU 8041 can be stored in memory 809 (or other storage medium) or transmitted via radio frequency unit 801 or network module 802. Microphone 8042 can receive sound and process such sound into audio data. The processed audio data can be converted into a format that can be transmitted to a mobile communication base station via radio frequency unit 801 in telephone call mode.

[0201] The electronic device 800 also includes at least one sensor 805, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor. The ambient light sensor can adjust the brightness of the display panel 8061 according to the ambient light level, and the proximity sensor can turn off the display panel 8061 and / or backlight when the electronic device 800 is moved to the ear. As a type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes). When stationary, it can detect the magnitude and direction of gravity and can be used to identify the posture of the electronic device (such as landscape / portrait switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc. The sensor 805 may also include a fingerprint sensor, pressure sensor, iris sensor, molecular sensor, gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc., which will not be described in detail here.

[0202] The display unit 806 is used to display information input by the user or information provided to the user. The display unit 806 may include a display panel 8061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0203] User input unit 807 can be used to receive input numerical or character information, and to generate key signal inputs related to user settings and function control of electronic devices. Specifically, user input unit 807 includes a touch panel 8071 and other input devices 8072. Touch panel 8071, also known as a touch screen, can collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near touch panel 8071). Touch panel 8071 may include two parts: a touch detection device and a touch controller. The touch detection device detects the user's touch position and the signal generated by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, and sends it to the processor 810, which receives and executes commands from the processor 810. In addition, touch panel 8071 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. Besides touch panel 8071, user input unit 807 may also include other input devices 8072. Specifically, other input devices 8072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, joysticks, etc., which will not be described in detail here.

[0204] Furthermore, the touch panel 8071 can cover the display panel 8061. When the touch panel 8071 detects a touch operation on or near it, it transmits the information to the processor 810 to determine the type of touch event. Subsequently, the processor 810 provides corresponding visual output on the display panel 8061 based on the type of touch event. Although in Figure 8 In this embodiment, the touch panel 8071 and the display panel 8061 are two independent components to realize the input and output functions of the electronic device. However, in some embodiments, the touch panel 8071 and the display panel 8061 can be integrated to realize the input and output functions of the electronic device. The specific implementation is not limited here.

[0205] Interface unit 808 serves as an interface for connecting external devices to electronic device 800. For example, external devices may include a wired or wireless headphone port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, and so on. Interface unit 808 can be used to receive input from external devices (e.g., data, power, etc.) and transmit the received input to one or more components within electronic device 800, or it can be used to transmit data between electronic device 800 and external devices.

[0206] The memory 809 can be used to store software programs and various data. The memory 809 may primarily include a program storage area and a data storage area. The program storage area may store the operating system, applications required for at least one function (such as sound playback, image playback, etc.), etc.; the data storage area may store data created based on the use of the mobile phone (such as audio data, phonebook, etc.). Furthermore, the memory 809 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0207] The processor 810 is the control center of the electronic device. It connects various parts of the electronic device via various interfaces and lines. By running or executing software programs and / or modules stored in the memory 809, and by calling data stored in the memory 809, it performs various functions and processes data, thereby providing overall monitoring of the electronic device. The processor 810 may include one or more processing units; preferably, the processor 810 may integrate an application processor and a modem processor. The application processor mainly handles the operating system, user interface, and applications, while the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 810.

[0208] The electronic device 800 may also include a power supply 811 (such as a battery) for supplying power to various components. Preferably, the power supply 811 is logically connected to the processor 810 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system.

[0209] In addition, the electronic device 800 includes some functional modules not shown, which will not be described in detail here.

[0210] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0211] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0212] The embodiments of the present invention have been described above with reference to the accompanying drawings. However, the present invention is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of the present invention without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of the present invention.

[0213] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed in this invention can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this invention.

[0214] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0215] In the embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative. For instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0216] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0217] In addition, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0218] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, essentially, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks.

[0219] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A method for generating a product prototype, characterized in that, include: Obtain voice information describing product requirements; The voice information is subjected to speech recognition to obtain text information; Semantic analysis is performed on the text information to determine the target interface elements in the product prototype and the layout structure logic of the target interface elements. The product prototype is generated by combining the target interface elements according to the layout structure logic. The step of performing semantic analysis on the text information to determine the target interface elements in the product prototype and the layout structure logic of the target interface elements includes: The text information is segmented to obtain at least one sentence; The statement is segmented to obtain at least one segment; wherein the segment includes nouns or verbs; The target interface elements in the product prototype are determined based on the word segmentation in the statement, and the layout structure logic of the target interface elements is also determined. The step of determining the target interface elements in the product prototype based on the word segmentation in the statement, and determining the layout structure logic of the target interface elements, includes: Based on the word segmentation of the verb in the statement, determine the corresponding operation type; Based on the word segmentation of nouns in the statement, the corresponding interface elements are obtained from the preset interface element library and used as target interface elements in the product prototype. Obtain the interface element information of the target interface element; the interface element information is used to standardize and constrain the corresponding interface element when generating the product prototype; Based on the order of word segmentation corresponding to the target interface element in the statement, the operation type, and the interface element information, the layout structure logic of the target interface element is determined.

2. The method according to claim 1, characterized in that, The step of retrieving corresponding interface elements from a pre-set interface element library based on word segmentation of nouns in the statement, and using them as target interface elements in the product prototype, includes: Retrieve interface elements from a pre-set interface element library that correspond to the word segmentation of nouns in the statement, and use them as candidate interface elements. Obtain the matching weight and matching probability corresponding to the operation type in the statement containing each candidate interface element; Calculate the weighted average of the candidate interface elements based on the matching weight and the matching probability; The candidate interface element with the highest weighted average value is selected as the target interface element in the product prototype.

3. The method according to claim 1, characterized in that, Each of the interface elements has corresponding interface element information, which includes at least one of the following: element identifier, layer information, attributes, name, layout, and special attributes of the element. The operation type includes at least one of the following: drawing operation, writing text operation, defining the next drawing area operation, splitting the previous interface element operation, and no operation.

4. The method according to claim 1, characterized in that, After generating the product prototype by combining the target interface elements according to the layout structure logic, the method further includes: In response to a functional description instruction for the product prototype, the product prototype is demonstrated.

5. The method according to claim 4, characterized in that, The demonstration of the product prototype includes: Expand the target interface element in the product prototype, or collapse the target interface element in the product prototype.

6. A device for generating a product prototype, characterized in that, include: The voice acquisition module is used to acquire voice information describing product requirements; A speech recognition module is used to perform speech recognition on the speech information to obtain text information; The semantic analysis module is used to perform semantic analysis on the text information to determine the target interface elements in the product prototype and the layout structure logic of the target interface elements. The prototype generation module is used to generate the product prototype by combining the target interface elements according to the layout structure logic. The device is also used to perform sentence segmentation on the text information to obtain at least one sentence; The statement is segmented to obtain at least one segment; wherein the segment includes nouns or verbs; The target interface elements in the product prototype are determined based on the word segmentation in the statement, and the layout structure logic of the target interface elements is also determined. The device is also used to determine the corresponding operation type based on the word segmentation of verbs in the statement; Based on the word segmentation of nouns in the statement, the corresponding interface elements are obtained from the preset interface element library and used as target interface elements in the product prototype. Obtain the interface element information of the target interface element; the interface element information is used to standardize and constrain the corresponding interface element when generating the product prototype; Based on the order of word segmentation corresponding to the target interface element in the statement, the operation type, and the interface element information, the layout structure logic of the target interface element is determined.

7. An electronic device, characterized in that, It includes a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus; The memory is used to store computer programs; When the processor executes a program stored in the memory, it implements the method as described in any one of claims 1-5.

8. A computer-readable storage medium having instructions stored thereon that, when executed by one or more processors, cause the processors to perform the method as described in any one of claims 1-5.

Citation Information

Patent Citations

  • Method and system for building UI using artificial intelligence

    CN108089842A

  • Product prototype processing method and device based on AI image recognition and related equipment

    CN113687813A