A method, device, equipment and storage medium for developing interface products

Abstract

The embodiment of the present application discloses an interface product development method, device, equipment and storage medium, which relates to the field of user interface technology, and includes: obtaining a first interactive video of an original interface product, the first interactive video is obtained by recording a first interactive operation process of the original interface product, the first interactive operation process includes a process of opening user interaction interfaces at each level in the original interface product; obtaining user interface materials corresponding to each user interaction interface and hierarchical logical relationships between each user interaction interface according to the first interactive video; generating a replica interface product of the original interface product according to the hierarchical logical relationship and the user interface materials. The above technical means can be used to solve the technical problems of long time consumption and low accuracy in manually developing competing product user interfaces in the prior art, and improve the efficiency of competing product user interface development.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of user interface technology, and in particular to an interface product development method, device, equipment and storage medium. Background Art

[0002] Competitive products refer to competitors of products in the same field. In order to expand the product market, it is necessary to analyze competitive products and better understand competitors. For competitors in the user interface field, in order to gain a deeper understanding of the functional attributes of interface competitors, it is necessary to conduct an in-depth analysis of interface competitors. When analyzing interface competitors, it is necessary to develop interface products that are consistent with interface competitors in order to analyze the functional attributes of the interface products. In the traditional solution, engineers refer to interface competitors, manually draw all user interaction interfaces of interface competitors, and manually establish the relationship between each user interaction interface. In the specific interface product development process, engineers need to connect to each page of the user interface, manually draw the user interaction interface for each item on each page, and when drawing the user interface, engineers determine the color of the user interaction interface by eye and select the corresponding color for drawing.

[0003] The inventor found that in the traditional process of manually drawing competitive interface products, engineers need to manually draw the content of each item and each page of the user interaction interface, which is prone to omissions and time-consuming. In addition, since the color recognition accuracy of the human eye is not high, it is easy to misrecognize and the drawn interface product does not meet the requirements. In summary, how to quickly and accurately copy competitive interface products has become a technical problem that needs to be solved urgently. Summary of the invention

[0004] The embodiments of the present application provide an interface product development method, apparatus, device and storage medium, which solve the problem of time-consuming and low-accuracy manual development of competing product user interfaces, and improve the efficiency of competing product user interface development.

[0005] In a first aspect, an embodiment of the present application provides an interface product development method, comprising:

[0006] Acquire a first interactive video of the original interface product, where the first interactive video is obtained by recording a first interactive operation process of the original interface product, where the first interactive operation process includes a process of opening user interactive interfaces at various levels in the original interface product;

[0007] Obtaining user interface materials corresponding to each of the user interaction interfaces and hierarchical logical relationships between the user interaction interfaces according to the first interaction video;

[0008] A replica interface product of the original interface product is generated according to the hierarchical logical relationship and the user interface material.

[0009] In a second aspect, an embodiment of the present application provides an interface product development device, including:

[0010] An interactive video acquisition module is used to acquire a first interactive video of an original interface product, where the first interactive video is obtained by recording a first interactive operation process of the original interface product, where the first interactive operation process includes a process of opening user interactive interfaces at various levels in the original interface product;

[0011] An interactive video analysis module, used to obtain user interface materials corresponding to each of the user interactive interfaces and a hierarchical logical relationship between each of the user interactive interfaces according to the first interactive video;

[0012] The interface product generation module is used to generate a replica interface product of the original interface product according to the hierarchical logical relationship and the user interface material.

[0013] In a third aspect, an embodiment of the present application provides an interface product development device, including:

[0014] one or more processors;

[0015] A memory for storing one or more programs;

[0016] When the one or more programs are executed by the one or more processors, the one or more processors implement the interface product development method as described in the first aspect.

[0017] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the interface product development method as described in the first aspect.

[0018] The above-mentioned interface product development method, device, equipment and storage medium, by recording the video of the interactive operation process of opening the user interaction interface at each level in the original interface product, obtains the user interface material corresponding to each user interaction interface and the hierarchical logical relationship between each user interaction interface according to the recorded video, and generates the imitation interface product of the original interface product according to the hierarchical logical relationship and the user interface material. The technical means solves the technical problem of long time and low accuracy in manually developing the user interface of the competing product, and improves the efficiency of the user interface development of the competing product. By recording the video, the images of all user interaction interfaces in the original interface product can be recorded, so that the user interface material in the user interaction interface image can be extracted according to the user interaction interface image recorded in each video frame in the recorded video, so as to facilitate the subsequent rapid rendering and generation of the corresponding user interaction interface according to the user interface material. At the same time, by recording the video, the process of opening the user interaction interface at each level of the original interface product can be recorded, so that the hierarchical logical relationship between each user interaction interface can be determined according to the different user interaction interface images recorded in the previous and next video frames in the recorded video, so as to establish the connection between each user interaction interface generated by the user interface material rendering according to the hierarchical logical relationship between each user interaction interface, and obtain the imitation interface product. The user interaction interface of the imitation interface product and the hierarchical logical relationship between each user interaction interface are automatically generated and established. There is no need for engineers to manually draw the user interaction interface and establish the logical relationship between each user interaction interface. The interface product development is convenient, efficient, and simple to operate, which can effectively improve the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 It is a flow chart of an interface product development method provided by an embodiment of the present application;

[0020] Figure 2 is a first schematic diagram of a first video frame provided in an embodiment of the present application;

[0021] Figure 3 is a second schematic diagram of a first video frame provided in an embodiment of the present application;

[0022] Figure 4 is a third schematic diagram of a first video frame provided in an embodiment of the present application;

[0023] Figure 5 is a fourth schematic diagram of a first video frame provided in an embodiment of the present application;

[0024] Figure 6 is a fifth schematic diagram of a first video frame provided in an embodiment of the present application;

[0025] Figure 7 is a flow chart of another interface product development method provided by an embodiment of the present application;

[0026] Figure 8 A first schematic diagram of a second video frame provided in an embodiment of the present application;

[0027] Fig. 9 A second schematic diagram of a second video frame provided in an embodiment of the present application;

[0028] Fig.10 A third schematic diagram of a second video frame provided in an embodiment of the present application;

[0029] Fig.11 It is a structural schematic diagram of an interface product development device provided by an embodiment of the present application;

[0030] Fig.12 It is a structural diagram of an interface product development device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0031] The present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are used to explain the present application, rather than to limit the present application. It should also be noted that, for ease of description, only the parts related to the present application, rather than all structures, are shown in the accompanying drawings.

[0032] It should be noted that, in this article, relational terms such as first and second are only used to distinguish one entity or operation or object from another entity or operation or object, and do not necessarily require or imply that there is any such actual relationship or order between these entities or operations or objects. For example, the "first" and "second" of the first interactive video and the second interactive video are used to distinguish two different interactive videos.

[0033] The interface product development method provided in the embodiments of the present application can be executed by an interface product development device, which can be implemented by software and / or hardware, and can be composed of two or more physical entities or one physical entity. For example, the interface product development device can be an intelligent device such as a computer.

[0034] The interface product development device is installed with at least one type of operating system, wherein the operating system includes but is not limited to Android system, Linux system and Windows system. The interface product development device can install at least one application based on the operating system, and the application can be an application that comes with the operating system or an application downloaded from a third-party device or server. In the embodiment, the interface product development device at least has an application that can execute the interface product development method, so the interface product development device can also be the application itself.

[0035] For ease of understanding, the embodiments are described exemplarily by taking a computer as the interface product development device.

[0036] Figure 1 This is a flow chart of an interface product development method provided by an embodiment of the present application. Figure 1 , the interface product development method includes:

[0037] S110, obtaining a first interactive video of the original interface product, where the first interactive video is obtained by recording a first interactive operation process of the original interface product, where the first interactive operation process includes a process of opening user interactive interfaces at various levels in the original interface product.

[0038] Exemplarily, the original interface product is a product for users to use. When the user uses the product, any user-interactive interface under the product can be opened according to the hierarchical logical relationship of the product. In the embodiment, the interface for user interaction is recorded as a user interaction interface. For example, the user obtains a user interaction interface that displays a menu bar by opening the menu bar of the product. It can be understood that the hierarchical logical relationship is used to describe the logical relationship between each user interaction interface. For example, the current user interaction interface displays a menu bar, and a plurality of operation controls are displayed in the menu bar, wherein each operation control corresponds to a function. The hierarchical logical relationship between each user interaction interface is: there is a corresponding user interaction interface for each operation control, and the user interaction interface corresponding to each functional control can be a user interaction interface of the same level, which are all the next level user interaction interfaces of the user interaction interface that displays the menu bar. In other words, when a certain operation control on a certain user interaction interface is triggered, the user interaction interface will jump to another user interaction interface, and the hierarchical logical relationship will characterize the jump relationship between the two user interaction interfaces triggered by the operation control. It should be noted that when a user uses an original interface product, the user can use the original interface product through touch operation or through an external device (such as a keyboard, mouse, etc.).

[0039] Exemplarily, the original interface product in this embodiment is an interface competitor. In order to gain a deeper understanding of the functional attributes of the interface competitor, the interface competitor needs to be analyzed. However, since the interface competitor is an interface displayed in the form of a user interaction interface and operating controls, its underlying code is unavailable. Therefore, if you want to obtain the same interface product as the original interface product, you need to develop a replica interface product that has the same user interaction interface as the original interface product and the same hierarchical logical relationship between each user interaction interface. By analyzing the functional attributes of the replica interface product, the functional attributes of the original interface product are determined. In order to draw the same user interaction interface as the original interface product, it is necessary to obtain the user interface materials in the user interaction interfaces of all levels in the original interface product. In order to establish the same hierarchical logical relationship as the original interface product, it is necessary to determine the hierarchical logical relationship between each user interaction interface in the original interface product.

[0040] The embodiment records the process of opening the user interaction interface at each level in the original interface product by means of video recording. The recorded video not only records the images of all user interaction interfaces, but also records the entire process of the user interaction interface jumping to another user interaction interface when the operation control of a certain user interaction interface is triggered. In one embodiment, during video recording, the operation controls contained in all user interaction interfaces in the original interface product need to be triggered to ensure that all user interaction interfaces of the original interface product and the hierarchical logical relationship between all user interaction interfaces are obtained. At this time, the process of obtaining all user interaction interfaces of the original interface product is recorded as the first interactive operation process, that is, the first interactive operation process is the process in which the user opens the user interaction interface at each level in the original interface product. It should be noted that each user interaction interface is opened according to the hierarchical logical relationship, and there is a situation where some user interaction interfaces are opened repeatedly, and each user interaction interface is not displayed all the time after opening, but is opened and closed according to the hierarchical logical relationship. For example, when each operation control in the menu bar is triggered in sequence, the user interaction interface corresponding to each operation control will be displayed in sequence, and after triggering an operation control, it is necessary to return to the user interaction interface of the menu bar, that is, first close the user interaction interface corresponding to the currently triggered operation control, and then trigger another operation control and display the user interaction interface corresponding to the other operation control. It can be understood that in actual applications, it is also possible to open only the required user interaction interface and give up opening the unnecessary user interaction interface based on the actual situation.

[0041] In an embodiment, the video obtained after recording the first interactive operation process of the original interface product is recorded as the first interactive video. Optionally, in order to record the first interactive video of the original interface product, a capture camera can be set up. At this time, the original interface product can be displayed on a display. When the original interface product is operated, the user interaction interface displayed on the display changes, and the camera records the entire process of the user interaction interface change in the display. Among them, the display can be a display provided by the interface product development device or a display of other devices. After the camera captures the first interactive video, the interface product development device obtains the first interactive video. Optionally, the interface product development device can also install an application with a screen recording function, and record the first interactive operation process of the original interface product through the application to obtain the first interactive video. It should be noted that other devices can also install an application with a screen recording function and the original interface product, and record the first interactive video, and then the interface product development device obtains the first interactive video.

[0042] S120: Obtain user interface materials corresponding to each user interaction interface and a hierarchical logical relationship between each user interaction interface according to the first interaction video.

[0043] Exemplarily, when generating a user interaction interface, it is rendered according to the user interface material of the user interaction interface, and the user interface material refers to the color and size of the user interaction interface and other parameters that can determine the style of the user interaction interface. By analyzing the image containing the user interaction interface, the corresponding user interface material can be obtained. In the embodiment, since the first interactive video records the first interactive operation process, the user interaction interface at each level is displayed in the first interactive video. Therefore, by analyzing the display content of the first interactive video, the user interface material of each user interaction interface can be obtained. It can be understood that the first interactive video is composed of various video frames. Therefore, analyzing the display content of the first interactive video refers to analyzing the display content of each video frame. In the embodiment, each video frame in the first interactive video is recorded as a first video frame, and the first video frame records the user interaction interface image. Optionally, the first video frame is converted into a binary array, which can describe the display content of the first video frame. After that, the binary array used to describe the user interface material in the binary array extraction can be used to quickly develop the corresponding user interaction interface according to the binary array.

[0044] Exemplarily, when an operation control of a certain user interaction interface is triggered, the currently displayed user interaction interface will change according to the hierarchical logical relationship and jump to another user interaction interface corresponding to the operation control. For the first interactive video that records the change process of the user interaction interface in the display, the jump process of the user interaction interface can be completely recorded through the continuous first video frames. Therefore, the hierarchical logical relationship between the user interaction interfaces is determined by the first video frame. It can be understood that when the user realizes the jump of the user interaction interface through the operation control, the operation control will be highlighted in the user interaction interface so that the user can clearly select the operation control. For example, when the user selects a certain operation control, the shadow color of the operation control changes, and at this time, the user interaction interface will display the change. Therefore, by analyzing the highlighting of the operation control in each first video frame of the first interactive video, the operation control that triggers the jump relationship can be determined, and the jump relationship between the user interaction interfaces can be clarified by the changes in the user interaction interfaces displayed in succession. Further, after clarifying the jump relationship between the user interaction interfaces and the corresponding operation control, the hierarchical logical relationship can be obtained, that is, the jump relationship and the corresponding operation control are logically described to obtain the hierarchical logical relationship. It can be understood that the above process does not need to analyze the specific meaning (i.e., function) of the operation control, but only needs to clarify the display position and display color of the operation control in the user interaction interface and the jump relationship of the user interaction interface after it is highlighted. Among them, the display position and display color of the operation control in the user interaction interface can be clarified through the user interface material.

[0045] It is understandable that the first interactive video records the operation process of opening all user interaction interfaces of the original interface product. In order to ensure that the user interaction interface recorded by the first interactive video is clear enough, the operation speed of opening the original interface product will not be too fast during the recording process. That is, when recording the first interactive video, the acquisition frequency of the first video frame is higher than the opening frequency of each user interaction interface, so that a user interaction interface may be recorded by multiple continuous first video frames, that is, multiple first video frames may display the same content. Therefore, when obtaining the user interface material and hierarchical logical relationship through the first video frame, there will be a situation where the first video frame with the same content is analyzed, which greatly increases the data processing amount and increases the difficulty of data processing. Therefore, in one embodiment, if it is identified that the same user interaction interface is contained in two adjacent first video frames, that is, the same content is displayed, it indicates that the user interaction interface is not operated, so only one of the first video frames can be retained. After processing each first video frame according to the above processing method, the adjacent first video frames in the retained first video frames no longer display the same user interaction interface. It should be noted that the user interaction interface generated by the operation control is not the same user interaction interface as the user interaction interface that does not appear highlighted.

[0046] S130: Generate a replica interface product of the original interface product according to the hierarchical logical relationship and the user interface material.

[0047] For example, a replica interface product refers to a product obtained by replicating an original interface product, which can also be understood as a copied product. The replica interface product is generated through hierarchical logical relationships and user interface materials. Through the user interface materials, various user interaction interfaces can be drawn, and through the hierarchical logical relationships, the levels of various user interaction interfaces and the operation controls that trigger the user interaction interfaces can be determined.

[0048] It is understandable that the reason why the original interface product presents a user interaction interface and jumps from one user interaction interface to another is because its underlying code determines the content of the user interaction interface and the hierarchical logical relationship between the user interaction interfaces. Therefore, after obtaining the user interface material of the original interface product and the hierarchical logical relationship between the user interaction interfaces according to the first interactive video, the user interface material and the hierarchical logical relationship are converted into the underlying code of the imitation interface product. The underlying code of the imitation interface product is run to obtain the imitation interface product.

[0049] Optionally, after the imitation interface product is generated, the imitation interface product can be verified to determine whether the user interaction interface displayed by the imitation interface product and its hierarchical logical relationship are consistent with the original interface product. If they are consistent, it means that the imitation interface product has passed the verification. Otherwise, it is necessary to regenerate the imitation interface product based on the first interactive video.

[0050] The technical solution provided by the embodiment is described exemplarily below:

[0051] The engineer operates the original interface product through the interface product development equipment, installs screen recording software on the interface product development equipment, opens the screen recording software, and records the process of the engineer opening the user interaction interface of each level of the original interface product through touch operation to obtain the first interaction video. According to the recording time of the first interaction video, the first video frame in the first interaction video is analyzed to obtain the user interface material and hierarchical logical relationship of the original interface product. Figure 2 This is a first schematic diagram of a first video frame provided in an embodiment of the present application. Figure 2 , which is a first video frame in the first interactive video. The user interaction interface recorded in the first video frame is the first user interaction interface 11. The first user interaction interface 11 displays a down operation control 12, a left operation control 13, an up operation control 14, a right operation control 15, a home operation control 16, and a return operation control 17. Among them, the first user interaction interface 11 is a home interface, that is, after the home operation control 16 of a certain user interaction interface is triggered, it jumps from the user interaction interface to the first user interaction interface 11. The first video frame recording the first user interaction interface 11 is analyzed and processed to obtain the user interface material of the first user interaction interface 11. Further, Figure 3 A second schematic diagram of a first video frame provided in an embodiment of the present application. Figure 3 , which is a first video frame of the first interactive video, and the first video frame records the second user interaction interface 18 generated by the downward operation control 12 when the downward operation control 12 is clicked in the first user interaction interface 11, and the highlight is the shadow change of the downward operation control 12. The first video frame recording the second user interaction interface 18 is analyzed and processed to obtain the user interface material of the second user interaction interface 18. According to the operation control with a shadow in the second user interaction interface 18, it can be determined that the downward operation control 12 is clicked, so that it is determined that the second user interaction interface 18 can be obtained after the downward operation control 12 is clicked, that is, the jump relationship from the first user interaction interface 11 to the second user interaction interface 18 is determined. Figure 4 is a third schematic diagram of a first video frame provided in an embodiment of the present application. Figure 4, which is a first video frame of the first interactive video, and the first video frame records the third user interaction interface 19. The third user interaction interface 19 is a user interaction interface that jumps after responding to the downward operation control 12. The first video frame that records the third user interaction interface 19 is analyzed and processed to obtain the user interface material of the third user interaction interface 19. Since the third user interaction interface 19 is changed from the second user interaction interface 18, it is determined that the downward operation control 12 in the second user interaction interface 18 will jump to the third user interaction interface 19 after the shadow change occurs, that is, the jump relationship from the second user interaction interface 18 to the third user interaction interface 19 is determined. At this time, according to the above jump relationship, the hierarchical logical relationship between the above three user interaction interfaces can be determined as follows: after clicking the downward operation control 12 on the first user interaction interface 11, it jumps from the first user interaction interface 11 to the second user interaction interface 18, and after responding to the downward operation control 12, it jumps from the second user interaction interface 18 to the third user interaction interface 19.

[0052] Furthermore, Figure 5 The fourth schematic diagram of the first video frame provided in the embodiment of the present application is a first video frame of the first interactive video, and the first video frame records the fourth user interaction interface 20 in which the shadow of the return operation control 17 changes when the return operation control 17 is clicked in the third user interaction interface 19. The first video frame recording the fourth user interaction interface 20 is analyzed and processed to extract the user interface material of the fourth user interaction interface 20. Figure 6 The fifth schematic diagram of the first video frame provided in the embodiment of the present application is a first video frame of the first interactive video, and the first video frame records the first user interaction interface 11. It can be understood that the third user interaction interface 19 can be entered by the down operation control 12 of the first user interaction interface 11, and the first user interaction interface 11 can be returned to by the return operation control 17 of the third user interaction interface 19. Figure 4 , Figure 5 and Figure 6 The user interaction interfaces recorded in the diagram can determine the hierarchical logical relationship from the third user interaction interface 19 to the first user interaction interface 11.

[0053] It can be understood that the steps for determining the hierarchical logical relationship between other user interaction interfaces are the same as the steps for determining the hierarchical logical relationship between the first user interaction interface 11 and the third user interaction interface 19 .

[0054] The above-mentioned interface product development method, by recording the video of the interactive operation process of opening the user interaction interface at each level in the original interface product, obtains the user interface material corresponding to each user interaction interface and the hierarchical logical relationship between each user interaction interface according to the recorded video, and generates the imitation interface product of the original interface product according to the hierarchical logical relationship and the user interface material. The technical means solves the technical problem of long time and low accuracy in manually developing the user interface of the competing product, and improves the efficiency of the user interface development of the competing product. By recording the video, the images of all the user interaction interfaces in the original interface product can be recorded, so that the user interface material in the user interaction interface image can be extracted according to the user interaction interface image recorded in each video frame in the recorded video, so as to facilitate the subsequent rapid rendering and generation of the corresponding user interaction interface according to the user interface material. At the same time, by recording the video, the process of opening the user interaction interface at each level of the original interface product can be recorded, so that the hierarchical logical relationship between each user interaction interface can be determined according to the different user interaction interface images recorded in the previous and next video frames in the recorded video, so as to establish the connection between each user interaction interface generated by the user interface material rendering according to the hierarchical logical relationship between each user interaction interface, and obtain the imitation interface product. The user interaction interface of the imitation interface product and the hierarchical logical relationship between each user interaction interface are automatically generated and established. There is no need for engineers to manually draw the user interaction interface and establish the logical relationship between each user interaction interface. The interface product development is convenient, efficient, and simple to operate, which can effectively improve the user experience.

[0055] Figure 7 1 is a flow chart of another method for developing an interface product provided by an embodiment of the present application. This embodiment is specific based on the above embodiment. Figure 7 The interface product development method provided in this embodiment includes:

[0056] S210, obtaining a first interactive video of the original interface product, where the first interactive video is obtained by recording a first interactive operation process of the original interface product, where the first interactive operation process includes a process of opening user interactive interfaces at various levels in the original interface product.

[0057] S220: Identify the user interaction interface displayed in each first video frame to obtain user interface material of the user interaction interface.

[0058] Exemplarily, the user interface material includes color parameters and size parameters of the user interaction interface. The color parameters can be used to clarify the specific display layout of the user interaction interface, and specifically, the display position and display color of each operation control in the user interface material can be clarified. The size parameters can be used to clarify the size of the user interaction interface. Among them, the user interface material can be obtained by identifying the first video frame. Among them, the embodiment of the identification means is not limited. For example, the pixel value of each pixel when displaying the first video frame is determined, and then the color parameter of the user interaction interface in the first video frame is obtained through the pixel value, and the size parameter is obtained through the number of pixels. It can be understood that if the first video frame displays other backgrounds in addition to the user interaction interface, the user interaction interface can be extracted first and then identified. Among them, the embodiment of the technical means for extracting the user interaction interface is not limited. For example, the user interaction interface is determined as a foreground image and the foreground image is extracted by image segmentation.

[0059] In one embodiment, the first video frame is converted into a binary array, the user interaction interface is described by the data in the binary array, and the color parameters and size parameters are further described by the binary array.

[0060] S230: Deduplication processing is performed on the first video frame to obtain a plurality of second video frames, and different user interaction interfaces are displayed between adjacent second video frames.

[0061] Exemplarily, since during the recording process, a user interaction interface may be recorded by multiple continuous first video frames, that is, the same user interaction interface is recorded in multiple continuous first video frames, only one first video frame is needed to obtain the material of the corresponding user interaction interface, and to confirm the hierarchical logical relationship between the corresponding user interaction interface and other user interaction interfaces. Therefore, only one first video frame needs to be retained among multiple continuous first video frames that display the same user interaction interface, and the deduplication process is to select one first video frame from the continuous first video frames that record the same content. In an embodiment, the first video frame retained after the deduplication process is recorded as the second video frame. It can be understood that in the retained second video frames, different user interaction interfaces are displayed between adjacent second video frames.

[0062] The technical means for deduplication processing can be set according to the actual situation. For example, first find out the continuous first video frames that display the same user interaction interface. This process can be achieved by calculating the similarity between adjacent first video frames, that is, adjacent first video frames with high similarity are determined to display the same user interaction interface. After that, display a first video frame as the second video frame in the continuous first video frames found. Accordingly, this step can specifically include S231-S233:

[0063] S231. Calculate first interface similarities between adjacent first video frames.

[0064] The first interface similarity refers to the similarity between two adjacent first video frames. At this time, the first interface similarity can also be understood as the similarity between two images. The specific calculation method of the first interface similarity is not limited in the embodiment. It can be understood that each adjacent first video frame corresponds to a first interface similarity. For example, according to the recording time of the first interactive video, the content of the first first video frame and the second first video frame are compared to calculate the first interface similarity between the two. Furthermore, the content of the second first video frame and the third first video frame is compared to calculate the first interface similarity between the two. By analogy, the first interface similarity of all two adjacent first video frames in the first interactive video is calculated.

[0065] S232. Divide the first interactive video into multiple video frame sets according to the first interface similarity, each video frame set includes one or more first video frames with continuous recording time, and when the video frame set includes multiple first video frames, the first interface similarity between adjacent first video frames is higher than the first similarity threshold.

[0066] Exemplarily, the specific value of the first similarity threshold can be set according to actual conditions. If it is higher than the first similarity threshold, it means that the two adjacent first video frames are extremely similar and can be considered to display the same user interaction interface. On the contrary, if it is lower than the first similarity threshold, it means that the two adjacent first video frames display different user interaction interfaces. If the similarity of the first interface corresponding to multiple consecutive first video frames is higher than the first similarity threshold, the multiple first video frames are divided into a video frame set, and the video frame set displays the same user interaction interface. It can be understood that if the similarity of the first interface between a first video frame and its two adjacent first video frames is lower than the first similarity threshold, it means that the user interaction interface displayed by the first video frame is different from the user interaction interface displayed by the adjacent first video frames. Therefore, the first video frame can be divided into a video frame set, that is, the video frame set contains only one first video frame. It should be noted that, since the same user interaction interface may be displayed repeatedly according to the interface hierarchy logic, in order to avoid deduplication of the first video frame corresponding to the repeatedly displayed user interaction interface, in the embodiment, when the video frame set contains multiple first video frames, each first video frame must be a continuous first video frame.

[0067] For example, the first interface similarity between the first first video frame and the second first video frame is compared with the first similarity threshold. If the first interface similarity is higher than the first similarity threshold, the first first video frame and the second first video frame are divided into the same video frame set, otherwise the first first video frame and the second first video frame are divided into different video frame sets. Furthermore, the first interface similarity between the second first video frame and the third first video frame is compared with the first similarity threshold. If the first interface similarity is higher than the first similarity threshold, the third first video frame is divided into the video frame set to which the second first video frame belongs, otherwise the third first video frame is divided into a new video frame set. By analogy, video frames with continuous recording time and high content similarity in the first interactive video are divided into the same video frame set.

[0068] S233 . Select a first video frame in each video frame set as a second video frame after deduplication.

[0069] Exemplarily, if a video frame set contains multiple first video frames, since the user interaction interfaces recorded by the first video frames in the same video frame set are highly similar, it indicates that no operation is performed on the user interaction interface during the recording time period corresponding to the video frame set. The recording time period can be regarded as a waiting time period, which means that the user interaction interface recorded in the first video frame during the recording time period is waiting for the user to operate the operation control on the user interaction interface. In the waiting time period, the user interaction interface information contained in the first video frames at all recording time points is consistent, so one of them can be selected as the first video frame representative of this waiting time period, that is, one can be selected as the second video frame. It can be understood that the second video frame can be a first video frame randomly selected from the video frame set, or it can be a first video frame with the best quality selected from the video frame set, such as selecting the clearest first video frame, or it can be a set first video frame, such as selecting the first first video frame, selecting the last first video frame, or selecting the middle first video frame.

[0070] Further, the first video frame obtained from the video frame set is used as the second video frame, and the second video frames are sorted and integrated according to the recording time of the second video frame. It can be understood that the user interaction interface recorded by the first video frame in the video frame set with adjacent recording time is different, and for the second video frame selected from the video frame set, the user interaction interface recorded by the second video frame with adjacent recording time is different.

[0071] S240: Obtain a hierarchical logical relationship between user interaction interfaces according to the second video frame.

[0072] Exemplarily, the second video frame with adjacent recording time records the jump change process of the user interaction interface, that is, the previous video frame in the adjacent second video frame records the user interaction interface before the jump, and the next video frame in the adjacent second video frame records the user interaction interface after the jump. Therefore, the jump relationship between the user interaction interfaces and the operation control that triggers the jump relationship can be obtained through the second video frame, and then the hierarchical logical relationship between the user interaction interfaces can be obtained. Further, this specific step includes S241-S245:

[0073] S241. Determine operation content acting on the user interaction interface according to the user interaction interface displayed in the second video frame.

[0074] Exemplarily, determining the operation content can be understood as determining the operation control of the user operation. It can be understood that in the hierarchical logical relationship, it is not necessary to clarify whether it is an operation control and its specific meaning, and it is only necessary to clarify its specific display position and display color by highlighting it. Therefore, in the embodiment, determining the operation control of the user operation is specifically to determine the display position of the highlight, and determine the display position as the location of the operation control. In the embodiment, this step can specifically include S2411-S2412:

[0075] S2411. Acquire a user interaction interface displayed in the second video frame, and identify an operation control triggered in the user interaction interface.

[0076] Exemplarily, when the user clicks on an operation control on the current user interaction interface, the operation control will be highlighted. The highlight in the second video frame is identified, the pixel position (i.e., display position) of the highlight in the second video frame is determined, and the pixel position is determined as the corresponding operation control. It should be noted that the highlight is a change that occurs when the operation control of the user interaction interface is clicked. The step of determining the clicked operation control in the user interaction interface in the embodiment of the present application is set accordingly according to the original interface product.

[0077] For example, highlights are shown as shading variations. Figure 8 This is a first schematic diagram of a second video frame provided in an embodiment of the present application. Figure 8 , the second video frame records the sixth user interaction interface 21. Shadow recognition is performed on the second video frame recording the sixth user interaction interface 21 to determine that the operation control of the sixth user interaction interface 21 is not triggered. Further, Fig. 9 A second schematic diagram of a second video frame provided in an embodiment of the present application. Figure 8 and Fig. 9 The second video frame with adjacent recording time. Fig. 9The second video frame records the seventh user interaction interface 22, and shadow recognition is performed on the second video frame recording the seventh user interaction interface 22 to determine that the shadow of the homepage operation control 16 in the seventh user interaction interface 22 changes, thereby determining that the homepage operation control 16 is triggered. Fig.10 A third schematic diagram of a second video frame provided in an embodiment of the present application. Fig. 9 and Fig.10 The second video frame with adjacent recording time. Fig.10 , the second video frame records the first user interaction interface 11, that is, the first user interaction interface 11 is the home page. Shadow recognition is performed on the second video frame recording the first user interaction interface 11 to determine that the operation control of the first user interaction interface 11 is not triggered.

[0078] S2412: Determine the operation content acting on the user interaction interface according to the operation control.

[0079] For example, refer to Figure 8 and Fig. 9 ,according to Figure 8 and Fig. 9 The user interaction interface content in the sixth user interaction interface 21 is determined to be a click operation on the homepage operation control 16. Fig. 9 and Fig.10 ,according to Fig. 9 and Fig.10 The user interaction interface content in the seventh user interaction interface 22 determines that the operation content is a homepage operation control 16 in response to the seventh user interaction interface 22.

[0080] S242: Use the user interaction interface displayed in the next second video frame of the second video frame as the operation result of the operation content.

[0081] It can be understood that, for two adjacent second video frames, the user interaction interface displayed in the second video frame after the second video frame can be considered as the result of the user's operation on the previous second video frame. Therefore, after identifying the operation content corresponding to the current second video frame, the user interaction interface in the second video frame after the current second video frame can be determined as the result of the operation corresponding to the operation content in the current second video frame. For example, Figure 8 and Fig. 9 is the second video frame with adjacent recording time. Figure 8 and Fig. 9It can be seen from the user interaction interface content that after the homepage operation control 16 of the sixth user interaction interface 21 is clicked, the homepage operation control 16 of the sixth user interaction interface 21 is shadow rendered to obtain the seventh user interaction interface 22. The seventh user interaction interface 22 is the operation result of clicking the homepage operation control 16 of the sixth user interaction interface 21. Further, the shadow rendering only highlights which operation control is clicked, and it is also necessary to respond to the clicked operation control and jump to the user interaction interface. Fig. 9 and Fig.10 is the second video frame with adjacent recording time. Fig. 9 and Fig.10 It can be seen from the user interaction interface content that after the seventh user interaction interface 22 renders the shadow of the homepage operation control 16, the seventh user interaction interface 22 jumps to the first user interaction interface 11. The first user interaction interface 11 is the operation result of responding to the operation content of the homepage operation control of the seventh user interaction interface 22.

[0082] S243: Generate an operation mark of the second video frame according to the operation content and the operation result.

[0083] Exemplarily, based on the operation content and operation result of the second video frame, the hierarchical logical relationship between the user interaction interfaces in the second video frame with adjacent recording time can be determined. Therefore, in order to facilitate the subsequent direct determination of the hierarchical logical relationship, the operation content and the operation result are converted into operation marks, and the hierarchical logical relationship between the user interaction interfaces in the second video frame is identified by the operation mark. Among them, the specific embodiment of the operation mark is not limited. For example, the operation mark includes the operation content and the operation result. After the second video frame is marked with the operation, the operation content and the operation result of the second video frame can be determined by reading the operation mark.

[0084] S244: Integrate the operation mark and user interface material corresponding to the second video frame according to the recording time.

[0085] Since only the user interaction interfaces in the second video frames with adjacent recording times have a hierarchical logical relationship, the second video frames are sorted and integrated according to the recording time, and the user interface materials extracted from the first video frames are associated with the corresponding second video frames, so that the user interaction interface can be rendered and generated directly according to the recording time and the operation marks and user interface materials of the second video frames, thereby ensuring that the subsequently generated user interaction interfaces have the correct hierarchical logical relationship.

[0086] S245. Analyze the integrated operation marks and user interface materials to obtain the hierarchical logical relationship between the user interaction interfaces.

[0087] Exemplarily, the hierarchical logical relationship between each user interaction interface can be clarified based on the operation mark. Since the user interaction interface is rendered through the user interface material when drawing the imitation interface product, the hierarchical logical relationship can be determined by clarifying the hierarchical logical relationship between the user interaction interfaces through the hierarchical logical relationship between the user interface materials.

[0088] For example, refer to Figure 8 and Fig. 9 According to the operation marks and user interface materials of the sixth user interaction interface 21 and the seventh user interaction interface 22, it can be determined that after the homepage operation control 16 in the sixth user interaction interface 21 is clicked, the shadow rendering is performed on the clicked homepage operation control 16 in the sixth user interaction interface 21, that is, the seventh user interaction interface 22 is obtained. Therefore, it can be determined that there is a hierarchical logical relationship between the sixth user interaction interface 21 and the seventh user interaction interface 22, that is, the shadow rendering is performed on the corresponding homepage operation control 16 after the homepage operation control 16 of the sixth user interaction interface 21 is clicked. Further, referring to Fig. 9 and Fig.10 According to the operation marks and user interface materials of the seventh user interaction interface 22 and the first user interaction interface 11, it can be determined that after responding to the homepage operation control 16 being clicked on the seventh user interaction interface 22, the seventh user interaction interface 22 will jump to the first user interaction interface 11. Therefore, it can be determined that there is a hierarchical logical relationship between the seventh user interaction interface 22 and the first user interaction interface 11, in which the seventh user interaction interface 22 jumps to the first user interaction interface 11 after responding to the homepage operation control 16 of the seventh user interaction interface 22.

[0089] S250: Generate a replica interface product of the original interface product according to the hierarchical logical relationship and the user interface material.

[0090] S260, verifying the imitation interface product and obtaining the verification result.

[0091] For example, in the process of generating a replica interface product according to the first interactive video, the hierarchical logical relationship between the determined user interaction interfaces may be inaccurate, and the replica interface product needs to be verified to ensure the accuracy of the replica interface product. The purpose of the verification is to ensure that the user interface material and hierarchical logical relationship of the user interaction interface of the replica interface product are the same as those of the original interface product.

[0092] The specific means of verification can be set according to the actual situation. In one embodiment, verification is performed by recording the interactive operation process of the imitation interface product. At this time, this step specifically includes S261-S262:

[0093] S261. Obtain a second interactive video of the imitation interface product. The second interactive video is obtained by recording a second interactive operation process of the imitation interface product. The second interactive operation process includes a process of opening user interactive interfaces at various levels in the imitation interface product. The second interactive video and the first interactive video correspond to the same interactive operation.

[0094] Exemplarily, the imitation interface product is composed of multiple user interaction interfaces like the original interface product, and there is a certain hierarchical logical relationship between the user interaction interfaces. The hierarchical logical relationship of the original interface product is obtained by analyzing the first interactive video that records the process of opening the user interaction interface at each level in the original interface product. The first interactive video reflects the hierarchical logical relationship between the user interaction interfaces at each level of the original interface product. In this regard, a second interactive video of the imitation interface product can be recorded. The second interactive video records the process of opening the user interaction interface at each level in the imitation interface product. At this time, the process of opening the user interaction interface at each level in the imitation interface product can be recorded as the second interactive operation process, and the second interactive video is obtained after recording the second interactive operation process. Among them, in order to facilitate the subsequent comparison of the first interactive video and the second interactive video directly according to the video recording time, during the recording process, the operation sequence of opening the imitation interface product and the operation sequence of opening the original interface product must be consistent, so that the operation sequence recorded in the first interactive video and the second interactive video is consistent, that is, the corresponding operations in the first interactive video and the second interactive video are the same.

[0095] S262: Compare the first interactive video and the second interactive video, and obtain a verification result according to the comparison result.

[0096] For example, since the first interactive video can reflect the hierarchical logical relationship of the original interface product and the second interactive video can reflect the hierarchical logical relationship of the imitation interface product, the first interactive video and the second interactive video can be compared to determine the similarity between the original interface product and the imitation product. That is, the similarity of the two interactive videos is calculated to obtain the verification result.

[0097] The first interactive video and the second interactive video each contain a plurality of video frames, each of which records user interactive interface information. Therefore, the similarity between the two videos can be determined by comparing the video frames in the first interactive video and the second interactive video, thereby determining the similarity between the original interface product and the imitation interface product. In one embodiment, this step includes: S2621-S2623

[0098] S2621. Deduplication processing is performed on the third video frame to obtain a plurality of fourth video frames, and different user interaction interfaces are displayed between adjacent fourth video frames.

[0099] Exemplarily, the third video frame refers to each video frame included in the second interactive video, that is, the second interactive video includes multiple third video frames. In recording the second interactive video, a user interaction interface of the imitation interface product may be recorded by multiple consecutive frames, but the user interaction interfaces recorded by these consecutive frames are the same, and the recorded information is redundant. Therefore, the third video frame needs to be deduplicated, and a single third video frame in the consecutive frames is retained. At this time, the retained third video frame is recorded as the fourth video frame. It can be understood that the fourth video frame and the second video frame have the same function. At this time, the deduplication process performed on the third video frame can refer to the deduplication process performed on the first video frame.

[0100] S2622. Calculate the second interface similarity between each second video frame and the corresponding fourth video frame in sequence according to the recording time.

[0101] Exemplarily, the second video frame is obtained after deduplication processing of the first video frame, and each video frame in the second video frame records a different user interaction interface. The fourth video frame is obtained after deduplication processing of the third video frame, and each video frame in the fourth video frame records a different user interaction interface. Any two adjacent video frames in the second video frame can reflect the hierarchical logical relationship of the original interface product, and any two adjacent video frames in the fourth video frame can reflect the hierarchical logical relationship of the imitation interface product. Since the first interactive video and the second interactive video correspond to the same interactive operation, the display order of each user interaction interface in the second video frame is the same as the display order of the same user interaction interface in the fourth video frame, that is, the changes in the user interaction interface of the two according to the recording time are the same. Therefore, the second video frame and the fourth video frame can be compared according to the recording time to determine whether the hierarchical logical relationship of the original interface product and the imitation interface product is the same. It can be understood that since the interactive operation order of the user interaction interface recorded in the first video frame and the third video frame is the same, the second video frame and the fourth video frame with the same recording order can be clearly recorded according to the recording time, that is, the second video frame and the fourth video frame with a corresponding relationship, and then the two are compared. The comparison method is to calculate the interface similarity of the two video frames. In the embodiment, the interface similarity currently calculated is recorded as the second interface similarity. At this time, there is a corresponding second interface similarity between each second video frame and the corresponding fourth video frame.

[0102] S2623. Obtain a comparison result between the first interactive video and the second interactive video according to the second interface similarity.

[0103] Exemplarily, if the second interface similarity between any second video frame and the corresponding fourth video frame is less than a preset similarity threshold, it indicates that the similarity between the second video frame and the fourth video frame is not high, the hierarchical logical relationship corresponding to the second video frame and the fourth video frame is different, or the displayed user interaction interface is different. At this time, it can be clearly seen that the original interface product and the imitation interface product are inconsistent, that is, the comparison result is that the original interface product and the imitation interface product are inconsistent, and the corresponding verification result is a failure result. If all second interface similarities are less than the preset similarity threshold, it indicates that the original interface product and the imitation interface product are consistent, that is, the comparison result is that the original interface product and the imitation interface product are consistent, and the corresponding verification result is a success result. Among them, the preset similarity threshold can be set according to actual conditions.

[0104] S270: confirm whether the verification result is a failure result. If the verification result is a failure result, execute step S240.

[0105] Specifically, if the original interface product and the imitation interface product are inconsistent, the verification result is determined to be a failure result. At this time, the hierarchical logical relationship of the original interface product is re-analyzed, and a new imitation interface product is developed to make the hierarchical logical relationship of the imitation interface product consistent with that of the original interface product, and the process returns to step 240. If the verification result is a success result, the obtained imitation interface product is retained.

[0106] The above-mentioned interface product development method records the video of the interactive operation process of opening the user interaction interface at each level in the original interface product, obtains the user interface material corresponding to each user interaction interface and the hierarchical logical relationship between each user interaction interface according to the recorded video, generates the imitation interface product of the original interface product according to the hierarchical logical relationship and the user interface material, verifies the imitation interface product, and if the verification fails, re-obtains the hierarchical logical relationship of the original interface product. The technical means solves the technical problem of long time and low accuracy in manually developing the user interface of the competing product, and improves the efficiency of the user interface development of the competing product. By recording the video, the images of all user interaction interfaces in the original interface product can be recorded, so that the user interface material in the user interaction interface image can be extracted according to the user interaction interface image recorded in each video frame in the recorded video, so as to facilitate the subsequent rapid rendering and generation of the corresponding user interaction interface according to the user interface material. At the same time, by recording the video, the process of opening the user interaction interface at each level of the original interface product can be recorded, so that the hierarchical logical relationship between each user interaction interface can be determined according to the different user interaction interface images recorded in the previous and next video frames in the recorded video, so as to establish the connection between each user interaction interface generated by the user interface material rendering according to the hierarchical logical relationship between each user interaction interface, and obtain the imitation interface product. The user interaction interface of the imitation interface product and the hierarchical logical relationship between each user interaction interface are automatically generated and established, and there is no need for engineers to manually draw the user interaction interface and establish the logical relationship between each user interaction interface. The interface product development is convenient, efficient, and simple to operate, which can effectively improve the user experience. In addition, after the imitation interface product is generated, in order to test whether the imitation interface product is qualified, the imitation interface product and the original interface product are compared to ensure that the imitation interface product and the original interface product are highly consistent and improve the accuracy of the imitation interface product. The verification process is a fully automatic test, without the need for manual comparison, which improves the user experience.

[0107] Fig.11 Schematic diagram of the structure of an interface product development device provided by an embodiment of the present application. Fig.11 The interface product development device includes: an interactive video acquisition module 301, an interactive video analysis module 302 and an interface product generation module 303.

[0108] The interactive video acquisition module 301 is used to acquire a first interactive video of the original interface product, where the first interactive video is obtained by recording a first interactive operation process of the original interface product, where the first interactive operation process includes a process of opening user interactive interfaces at various levels in the original interface product;

[0109] An interactive video analysis module 302, configured to obtain user interface materials corresponding to each user interactive interface and a hierarchical logical relationship between each user interactive interface according to the first interactive video;

[0110] The interface product generation module 303 is used to generate a replica interface product of the original interface product according to the hierarchical logical relationship and the user interface material.

[0111] On the basis of the above embodiment, the first interactive video includes a plurality of first video frames, each of which displays a corresponding user interaction interface, and the interactive video analysis module includes:

[0112] A material identification submodule is used to identify the user interaction interface displayed in each first video frame to obtain the user interface material of the user interaction interface; a deduplication processing submodule is used to deduplicate the first video frame to obtain multiple second video frames, and different user interaction interfaces are displayed between adjacent second video frames; a hierarchical logical relationship determination submodule is used to obtain the hierarchical logical relationship between user interaction interfaces based on the second video frames.

[0113] Based on the above embodiment, the user interface material includes color parameters and size parameters of the user interaction interface.

[0114] On the basis of the above embodiment, the deduplication processing submodule includes: a first similarity calculation unit, used to calculate the first interface similarity between adjacent first video frames; a set division unit, used to divide the first interactive video into multiple video frame sets according to the first interface similarity, each video frame set includes one or more first video frames with continuous recording time, and when the video frame set includes multiple first video frames, the first interface similarity between adjacent first video frames is higher than the first similarity threshold; a video frame selection unit, used to select a first video frame in each video frame set as a second video frame after deduplication.

[0115] On the basis of the above embodiment, the hierarchical logical relationship determination submodule includes: an operation content determination unit, which is used to determine the operation content acting on the user interaction interface according to the user interaction interface displayed in the second video frame; an operation result determination unit, which is used to use the user interaction interface displayed in the next second video frame of the second video frame as the operation result of the operation content; an operation mark acquisition unit, which is used to generate an operation mark for the second video frame according to the operation content and the operation result; an integration unit, which is used to integrate the operation mark and user interface material corresponding to the second video frame according to the recording time; and an analysis unit, which is used to analyze the integrated operation mark and user interface material to obtain the hierarchical logical relationship between the user interaction interfaces.

[0116] Based on the above embodiment, the operation content determination unit includes: an operation control determination subunit, which is used to obtain the user interaction interface displayed in the second video frame and identify the operation control triggered in the user interaction interface; an operation content determination subunit, which is used to determine the operation content acting on the user interaction interface according to the operation control.

[0117] Based on the above embodiment, the interface product development device also includes: a verification module for verifying the imitation interface product and obtaining a verification result; a return module for sending an instruction to the interactive video analysis module to continue executing the corresponding operation if the verification result is a failure.

[0118] On the basis of the above embodiment, the verification module includes: a second interactive video acquisition submodule, which is used to acquire a second interactive video of the imitation interface product, the second interactive video is obtained by recording the second interactive operation process of the imitation interface product, the second interactive operation process includes the process of opening the user interaction interface at each level in the imitation interface product, and the second interactive video and the first interactive video correspond to the same interactive operation; a video comparison submodule, which is used to compare the first interactive video and the second interactive video, and obtain a verification result based on the comparison result.

[0119] Based on the above embodiment, the second interactive video includes a plurality of third video frames;

[0120] The video comparison submodule includes: a deduplication processing unit, which is used to deduplicate the third video frame to obtain multiple fourth video frames, and different user interaction interfaces are displayed between adjacent fourth video frames; a second similarity calculation unit, which is used to calculate the second interface similarity between each second video frame and the corresponding fourth video frame in sequence according to the recording time; and a comparison result acquisition unit, which is used to obtain the comparison result of the first interactive video and the second interactive video according to the second interface similarity.

[0121] It is worth noting that in the above-mentioned embodiment of the interface product development device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application.

[0122] The interface product development device provided in the embodiment of the present application is included in the interface product development equipment, and can be used to execute the interface product development method provided in any of the above embodiments, and has corresponding functions and beneficial effects.

[0123] Fig.12 FIG. 1 is a schematic diagram of a structure of an interface product development device provided by an embodiment of the present application. Fig.12 As shown, the interface product development device includes a processor 40, a memory 41, an input device 42, an output device 43 and a display screen 44; the number of processors 40 in the interface product development device can be one or more. Fig.12 In the example of a processor 40; the number of display screens 44 in the interface product development device can be one or more, Fig.12 A display screen 44 is taken as an example; the processor 40, the memory 41, the input device 42, the output device 43 and the display screen 44 in the interface product development device can be connected by a bus or other means, Fig.12 The example of connecting through bus is taken in the following.

[0124] The memory 41 is a computer-readable storage medium that can be used to store software programs, computer executable programs and modules, such as program instructions / modules corresponding to the interface product development method in the embodiment of the present application (for example, the interactive video acquisition module 301, the interactive video analysis module 302 and the interface product generation module 303 in the interface product development device). The processor 40 executes the various functional applications and data processing of the interface product development device by running the software programs, instructions and modules stored in the memory 41, that is, implements the above-mentioned interface product development method.

[0125] The memory 41 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system and at least one application required for a function; the data storage area may store data created according to the use of the interface product development device, etc. In addition, the memory 41 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some instances, the memory 41 may further include a memory remotely arranged relative to the processor 40, and these remote memories may be connected to the interface product development device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0126] The input device 42 can be used to receive input digital or character information, and generate key signal input related to user settings and function control of the interface product development device. The output device 43 can include an audio output device such as a speaker. The display screen 44 can display various user interaction interfaces of the original interface product and various user interaction interfaces of the imitation interface product. In one embodiment, the display screen 44 can be a display screen with a touch function, which can be a capacitive screen, an electromagnetic screen, or an infrared screen.

[0127] The above-mentioned interface product development equipment includes an interface product development device, which can be used to execute any interface product development method and has corresponding functions and beneficial effects.

[0128] An embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, it is used to execute the interface product development method provided in the above embodiment.

[0129] Of course, the computer-readable storage medium provided in the embodiment of the present application, whose computer-executable instructions are not limited to the method operations described above, can also execute related operations in the interface product development method provided in any embodiment of the present application.

[0130] Through the above description of the implementation method, the technicians in the relevant field can clearly understand that the present application can be implemented with the help of software and necessary general hardware, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application can be essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as a computer floppy disk, read-only memory (ROM), random access memory (RAM), flash memory (FLASH), hard disk or optical disk, etc., including a number of instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods of each embodiment of the present application.

[0131] Note that the above are only preferred embodiments of the present application and the technical principles used. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present application. Therefore, although the present application is described in more detail through the above embodiments, the present application is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the appended claims.

Claims

1. A method for developing an interface product, characterized in that: include: Acquire a first interactive video of the original interface product, where the first interactive video is obtained by recording a first interactive operation process of the original interface product, where the first interactive operation process includes a process of opening user interactive interfaces at various levels in the original interface product; Obtaining user interface materials corresponding to each of the user interaction interfaces and hierarchical logical relationships between the user interaction interfaces according to the first interaction video; Generate a replica interface product of the original interface product according to the hierarchical logical relationship and the user interface material, wherein the replica interface product is used to study and analyze the functional attributes of the corresponding original interface product; This includes: converting the user interface material and the hierarchical logical relationship into the underlying code of the imitation interface product of the original interface product, the user interface material is used to draw the corresponding user interaction interface, and the hierarchical logical relationship is used to determine the level of each user interaction interface and trigger the operation controls of each user interaction interface.

2. The method according to claim 1, characterized in that The first interactive video includes a plurality of first video frames, each of which displays a corresponding user interaction interface. The user interface materials corresponding to each of the user interaction interfaces and the hierarchical logical relationship between the user interaction interfaces obtained according to the first interactive video include: Identifying a user interaction interface displayed in each of the first video frames to obtain a user interface material of the user interaction interface; Deduplication processing is performed on the first video frame to obtain a plurality of second video frames, and different user interaction interfaces are displayed between adjacent second video frames; A hierarchical logical relationship between the user interaction interfaces is obtained according to the second video frame.

3. The method according to claim 2, characterized in that The user interface material includes color parameters and size parameters of the user interaction interface.

4. The method according to claim 2, characterized in that: The performing deduplication processing on the first video frame to obtain a plurality of second video frames comprises: Calculating first interface similarity between adjacent first video frames; Dividing the first interactive video into a plurality of video frame sets according to the first interface similarity, each of the video frame sets including one or more first video frames with continuous recording time, and when the video frame set includes a plurality of first video frames, the first interface similarity between adjacent first video frames is higher than a first similarity threshold; A first video frame is selected from each of the video frame sets as a second video frame after deduplication.

5. The method according to claim 2, characterized in that: The obtaining of the hierarchical logical relationship between the user interaction interfaces according to the second video frame includes: Determining the operation content acting on the user interaction interface according to the user interaction interface displayed in the second video frame; taking a user interaction interface displayed in a second video frame next to the second video frame as an operation result of the operation content; generating an operation mark of the second video frame according to the operation content and the operation result; Integrate the operation mark and user interface material corresponding to the second video frame according to the recording time; The integrated operation mark and the user interface material are analyzed to obtain the hierarchical logical relationship between the user interaction interfaces.

6. The method according to claim 5, characterized in that The step of determining the operation content acting on the user interaction interface according to the user interaction interface displayed in the second video frame includes: Acquire a user interaction interface displayed in the second video frame, and identify an operation control triggered in the user interaction interface; The operation content acting on the user interaction interface is determined according to the operation control.

7. The method according to claim 1, characterized in that After generating the imitation interface product of the original interface product according to the hierarchical logical relationship and the user interface material, the method further includes: Verifying the imitation interface product and obtaining a verification result; If the verification result is a failure result, the process returns to executing the operation of obtaining the user interface materials corresponding to each of the user interaction interfaces and the hierarchical logical relationship between each of the user interaction interfaces according to the first interactive video, until a replica interface product with a successful verification result is generated.

8. The method according to claim 7, characterized in that The verifying of the imitation interface product and obtaining the verification result comprises: Acquire a second interactive video of the imitation interface product, where the second interactive video is obtained by recording a second interactive operation process of the imitation interface product, where the second interactive operation process includes a process of opening user interactive interfaces at various levels in the imitation interface product, and the second interactive video and the first interactive video correspond to the same interactive operation; The first interactive video and the second interactive video are compared, and a verification result is obtained according to the comparison result.

9. The method according to claim 8, characterized in that The second interactive video includes a plurality of third video frames; The comparing the first interactive video and the second interactive video and obtaining a verification result according to the comparison result includes: Deduplication processing is performed on the third video frame to obtain a plurality of fourth video frames, and different user interaction interfaces are displayed between adjacent fourth video frames; Calculating the second interface similarity between each of the second interaction video frames and the corresponding fourth video frame in sequence according to the recording time; A comparison result of the first interaction video and the second interaction video is obtained according to the second interface similarity.

10. An interface product development device, characterized in that: include: An interactive video acquisition module is used to acquire a first interactive video of an original interface product, where the first interactive video is obtained by recording a first interactive operation process of the original interface product, where the first interactive operation process includes a process of opening user interactive interfaces at various levels in the original interface product; An interactive video analysis module, used to obtain user interface materials corresponding to each of the user interactive interfaces and a hierarchical logical relationship between each of the user interactive interfaces according to the first interactive video; An interface product generation module is used to generate a replica interface product of the original interface product based on the hierarchical logical relationship and the user interface material, and the replica interface product is used to study and analyze the functional attributes of the corresponding original interface product; wherein the interface product generation module is specifically configured to: convert the user interface material and the hierarchical logical relationship into the underlying code of the replica interface product of the original interface product, the user interface material is used to draw the corresponding user interaction interface, and the hierarchical logical relationship is used to determine the hierarchy of each of the user interaction interfaces and trigger the operation controls of each of the user interaction interfaces.

11. An interface product development device, characterized in that: include: one or more processors; A memory for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the interface product development method as described in any one of claims 1-9.

12. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the program is executed by a processor, the interface product development method as described in any one of claims 1-9 is implemented.

Images