A process control method, device, terminal and computer readable storage medium

By detecting and handling the abnormal shutdown of the initial rendering process of a web browsing application, the problem of multiple audio and video files playing simultaneously was resolved, thus improving the user experience.

CN114117305BActive Publication Date: 2026-02-06SHENZHEN ZHONGKE MINGWANG COMM SOFTWARE CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202111436056.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-11-29
Publication Date
2026-02-06
Estimated Expiration
2041-11-29

AI Technical Summary

Technical Problem

In web browsing applications, user actions can cause multiple audio and video files to play simultaneously at different times, impacting the user experience.

Method used

Detect whether the initial rendering process of the target webpage in the web browsing application has been abnormally shut down, and shut down or re-associate the initial multimedia process when it is abnormally shut down to prevent multiple audio and video files from playing simultaneously.

Benefits of technology

It improves the user experience of watching audio and video on web pages, ensuring smooth and controllable audio and video playback.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114117305B_ABST
    Figure CN114117305B_ABST
Patent Text Reader

Abstract

The application belongs to the technical field of webpage loading, and particularly relates to a process control method and device, a terminal and a computer readable storage medium. According to the application, when the initial rendering process of a target webpage is abnormally closed, the initial multimedia process of the target webpage for playing audio and video is closed, so that the original initial multimedia process and the new multimedia process play the audio and video corresponding to the target webpage at the same time after the webpage browsing application establishes a new rendering process and a new multimedia process associated with the new rendering process is avoided. Alternatively, when the initial rendering process of the target webpage is abnormally closed, the initial multimedia process of the target webpage is re-associated, so that the initial multimedia process of the target webpage is controlled by the target webpage again, thereby avoiding the problem of multiple audio and video playing at the same time, and the experience of a user watching webpage audio and video can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of webpage loading, and particularly relates to a process control method and device, a terminal and a computer readable storage medium. BACKGROUND

[0002] Currently, in the process that a user opens a webpage of a webpage browsing application and watches audio and video in the webpage, the webpage browsing application may simultaneously play audio and video due to some operations or problems in the running of the webpage browsing application.

[0003] For example, in the process that the user watches audio and video in the webpage, the webpage browsing application is run in the background to switch to another application to perform another operation, and when the user returns to the webpage browsing application, multiple audio and video may be simultaneously played, and the data sources of the multiple audio and video may be the same data source but the playing time is not synchronized, thereby affecting the user's audio and video watching. SUMMARY

[0004] Embodiments of the present application provide a process control method and device, a terminal and a computer readable storage medium, which can avoid the situation that multiple audio and video are simultaneously played on the terminal and improve the user's experience of watching audio and video in a webpage.

[0005] A first aspect of embodiments of the present application provides a process control method, which is applied to a webpage browsing application and includes the following steps.

[0006] detecting whether an initial rendering process of a target webpage of the webpage browsing application is abnormally closed; the target webpage is a webpage in which target audio and video are played off the webpage;

[0007] if the initial rendering process of the target webpage is abnormally closed, closing an initial multimedia process of the target webpage for playing the target audio and video or reassociating the initial multimedia process.

[0008] A second aspect of embodiments of the present application provides a process control device, which is configured in a webpage browsing application and includes the following components.

[0009] a detection unit configured to detect whether an initial rendering process of a target webpage of the webpage browsing application is abnormally closed; the target webpage is a webpage in which target audio and video are played off the webpage;

[0010] a control unit configured to, when the initial rendering process of the target webpage is abnormally closed, close an initial multimedia process of the target webpage for playing the target audio and video or reassociate the initial multimedia process.

[0011] The third aspect of the embodiments of the present application provides a terminal, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the steps of the method of the first aspect when executing the computer program.

[0012] The fourth aspect of the embodiments of the present application provides a computer readable storage medium, which stores a computer program, and the computer program implements the steps of the method of the first aspect or the steps of the method of the first aspect when executed.

[0013] In the embodiments of the present application, when the initial rendering process of the target webpage is abnormally closed, the initial multimedia process for playing the audio and video of the target webpage is closed, so as to avoid the situation that the original initial multimedia process and the new multimedia process play the audio and video corresponding to the target webpage at the same time after the web browsing application establishes a new rendering process and a new multimedia process associated with the new rendering process. Alternatively, when the initial rendering process of the target webpage is abnormally closed, the initial multimedia process of the target webpage is re-associated, so that the initial multimedia process of the target webpage is controlled by the target webpage again, thereby avoiding the problem of multiple audio and video playing at the same time, and the experience of the user watching the audio and video of the webpage can be improved. BRIEF DESCRIPTION OF DRAWINGS

[0014] In order to more clearly illustrate the process control method of the embodiments of the present application, the drawings required to be used in the embodiments will be briefly introduced below, and it should be understood that the following drawings only show some of the embodiments of the present application, and therefore should not be regarded as a limitation on the scope. For those skilled in the art, other related drawings can also be obtained without creative labor on the basis of these drawings.

[0015] Figure 1 is a schematic diagram of the implementation process of the process control method provided by the embodiments of the present application;

[0016] Figures 2a-2c is a schematic diagram of the interface of the webpage audio and video playing in different playing modes provided by the embodiments of the present application;

[0017] Figure 3 is a schematic diagram of the structure of the process control device provided by the embodiments of the present application;

[0018] Figure 4 is a schematic diagram of the structure of the terminal provided by the embodiments of the present application. DETAILED DESCRIPTION

[0019] In order to make the purposes, technical solutions, and advantages of the present application clearer, the present application will be further described in detail below with reference to the drawings and embodiments. It should be understood that the specific embodiments described herein are merely intended to explain the present application and not to limit the present application.

[0020] The "and / or" herein merely describes an association relationship of associated objects, and means that three relationships can exist, for example, A and / or B can mean that A exists alone, A and B exist together, and B exists alone. In addition, in the description of the embodiments of the present application, unless otherwise specified, "multiple" means two or more than two, and "at least one" or "one or more" means one, two, or more than two.

[0021] In the present specification, "one embodiment" or "some embodiments" and the like mean that a specific feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Therefore, the statements "in one embodiment", "in some embodiments", "in other embodiments", "in additional embodiments" and the like appearing in various places in the specification are not necessarily all the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized. The terms "comprise", "include", "have" and their variants mean "including but not limited to", unless otherwise specifically emphasized.

[0022] The process control method of the embodiments of the present application can be applied to a terminal, such as a mobile phone, a tablet computer, an augmented reality (AR) / virtual reality (VR) device, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), and the like, which is installed with a web page browsing application. The embodiments of the present application do not limit the specific type of the terminal.

[0023] The web page browsing application described above can include a browser, an audio / video playing application, a social application, and the like, which can provide a web page browsing function. The present application does not limit the specific type of the web page browsing application.

[0024] At present, in order to improve the stability, smoothness, and security of web page loading of the web page browsing application, it generally adopts a multi-process mode for web page loading. For example, it can include a main process (Browser Process) and a rendering process (Render Process). The main process is an entry process of the web page browsing application, and the rendering process is used to render a visual interface to realize user interaction.

[0025] When the webpage opened by the webpage browsing application contains audio and video that needs to be played, the rendering process will notify the main process to newly create a multimedia process (Media Process) to play the audio and video. In this way of playing audio and video, when the multimedia process appears abnormal, the webpage browsing application will not be abnormally exited.

[0026] However, at present, when the user opens the webpage of the webpage browsing application and watches the audio and video in the webpage, it is possible that due to some operations or problems in the running of the webpage browsing application, the multiple multimedia processes of the webpage browsing application simultaneously play audio and video, which is not conducive to the user to watch the audio and video.

[0027] For example, when the user watches the audio and video in the webpage in the full-screen playing mode or the floating window playing mode, and places the webpage browsing application in the background to switch to other applications and perform other operations, when the user returns to the webpage browsing application, multiple audio and video may be played simultaneously, and the data sources of the multiple audio and video may be the same data source, but the playing time is not synchronized, which affects the user's audio and video watching.

[0028] For another example, when the user needs to share the webpage being browsed to a friend in a social application, the webpage browsing application needs to be placed in the background to switch to the social application. In this case, when the user returns to the webpage browsing application, the original audio and video may continue to be played, and a new audio and video may be played at the same time, and the played audio and video contents are the same, but the playing time is not synchronized, that is, multiple audio and video belonging to the same data source are played simultaneously, which affects the user's audio and video watching.

[0029] Specifically, in the Android system, the life cycle of a process is controlled by the system. For the consideration of user experience and application performance, when an application exits to run in the background, the system does not really kill the process of the application, and the process of the application still exists in the memory. The next time the user starts the application, it can be faster.

[0030] As the system runs for a longer time, more and more applications are opened, and more and more processes exist in the memory, so the available memory of the system becomes less and less. When the system memory decreases to a threshold value, the system will start to kill (close) a part of the processes according to the priority of the processes to release the memory for the use of the application to be started later.

[0031] When a web browsing application transitions from foreground to background operation, its rendering process (initial rendering process) becomes a background process. Therefore, it has a higher probability of being abnormally closed. However, the initial multimedia process associated with this initial rendering process may have a higher priority and thus not be abnormally closed. Furthermore, after the initial rendering process is abnormally closed, the web browsing application will create a new rendering process.

[0032] When a web browsing application resumes running from the background to the foreground, the new rendering process, while rendering the webpage, notifies the main process, based on historical records, to re-establish a new multimedia process associated with it to resume audio and video playback. However, because the initial multimedia process associated with the original initial rendering process was not abnormally shut down and continues to play audio and video, while the new multimedia process is used to play audio and video from the webpage, multiple audio and video files from the same data source are playing simultaneously, thus affecting the user's audio and video viewing experience.

[0033] Furthermore, the initial multimedia process associated with the original initial rendering process is not controlled by the new rendering process. It can only be controlled through controls in the audio / video playback window corresponding to that initial multimedia process, becoming an isolated audio / video playback window and affecting the user's control over the playback of that initial multimedia process. For example, the user cannot control the audio / video played by the initial multimedia process by swiping left or right on the webpage display interface or by closing the webpage.

[0034] Besides the possibility of multiple audio and video files playing simultaneously when a web browsing application returns to the foreground after running in the background, the same situation can also occur when a web browsing application, while running in the foreground, experiences an abnormal crash due to its own operational problems. In such cases, the web browsing application will create a new rendering process and a new multimedia process associated with the new rendering process.

[0035] To address the aforementioned technical issues, this application provides a process control method, apparatus, terminal, and computer-readable storage medium, which can prevent multiple audio and video files belonging to the same data source from playing simultaneously on the terminal, thereby improving the user's experience of watching webpage audio and video.

[0036] The technical solution of this application will be illustrated below through specific embodiments.

[0037] Example 1:

[0038] For example, such as Figure 1An implementation flowchart of a process control method provided in an embodiment of the present application is shown. The process control method is applied to a webpage browsing application of a terminal, and can be executed by a process control apparatus of the terminal. The process control method can be implemented in the following steps 101-102.

[0039] In step 101, it is detected whether an initial rendering process of a target webpage of the webpage browsing application is abnormally closed.

[0040] In the embodiment of the present application, the target webpage is a webpage having a target audio / video that is played out of the webpage.

[0041] Specifically, the target audio / video played out of the webpage can refer to a playback mode of the target audio / video being a preset playback mode.

[0042] Optionally, in the embodiment of the present application, the audio / video playback mode of the webpage can include an element playback mode, a full-screen playback mode, and a floating window playback mode.

[0043] When the audio / video in the webpage is played in the element playback mode, the audio / video is located in the webpage. When the audio / video in the webpage is played in the full-screen playback mode or the floating window playback mode, the audio / video is the target audio / video played out of the webpage.

[0044] That is, the preset playback mode can include one or both of the full-screen playback mode and the floating window playback mode.

[0045] Optionally, in some embodiments of the present application, it can be determined whether the webpage opened by the webpage browsing application is the target webpage by the following steps A01-A02, i.e., it can be determined whether the webpage opened by the webpage browsing application has the target audio / video played out of the webpage.

[0046] In step A01, it is detected whether the audio / video playback mode of the webpage opened by the webpage browsing application is a preset playback mode.

[0047] For example, when the webpage opened by the webpage browsing application has an audio / video being played, it is detected whether the playback mode of the audio / video is a preset playback mode.

[0048] In step A01, detecting whether the audio / video playback mode of the webpage opened by the webpage browsing application is a preset playback mode can refer to detecting whether the audio / video playback mode of the webpage opened by the webpage browsing application is a full-screen playback mode, and / or detecting whether the audio / video playback mode of the webpage opened by the webpage browsing application is a floating window playback mode.

[0049] In step A02, if the audio / video playback mode is a preset playback mode, it is determined that the webpage opened by the webpage browsing application is a target webpage having a target audio / video played out of the webpage.

[0050] As Figure 2a shown in the audio and video playing interface 20, the corresponding audio and video playing mode is the element state playing mode, as Figure 2b shown in the audio and video playing interface 21, the corresponding audio and video playing mode is the full screen playing mode, as Figure 2c shown in the audio and video playing interface 22, the corresponding audio and video playing mode is the floating window playing mode.

[0051] With the widespread use of web page audio and video, in order to unify the audio and video interface style and the audio and video control function expansion, the manufacturers of web page browsing applications basically take over the default user interaction interface of the same layer audio and video playing of the browser. That is, the text and pictures and other contents in the web page are played in the same layer with the audio and video in the web page, and the user can slide the web page, for example, as Figure 2a shown, sliding the web page upwards, the text and pictures and other web page contents 221 of the web page appear to change, but the playing position of the audio and video 222 does not change, realizing the same layer playing of the text and pictures and other contents in the web page with the audio and video in the web page.

[0052] And, in this user interaction interface, as Figure 2a shown, when the audio and video playing mode is the element state playing mode, the playing window of the audio and video 222 in the web page can be provided with a full screen playing mode opening control 223 and a floating window playing mode opening control 224, and the user can trigger the full screen playing mode opening control 223 or the floating window playing mode opening control 224 by clicking, pressing, etc. to open, so that the audio and video 222 in the web page can be converted from the element state playing mode as Figure 2a shown to the full screen playing mode as Figure 2b shown, or from the element state playing mode as Figure 2a shown to the floating window playing mode as Figure 2c shown, realizing the playing of the audio and video in the web page away from the web page.

[0053] It can be seen that in the embodiments of the present application, by detecting whether the audio and video playing mode of the web page opened by the web page browsing application is the full screen playing mode or the floating window playing mode or other preset playing modes, it can be determined that the web page opened by the web page browsing application is the target web page with the target audio and video playing away from the web page.

[0054] That is, when the audio and video playing mode of the web page is the element state playing mode, it is determined that the web page opened by the web page browsing application does not have the target audio and video playing away from the web page, and when the audio and video playing mode of the web page is the full screen playing mode or the floating window playing mode or other preset playing modes, it is determined that the web page opened by the web page browsing application is the target web page with the target audio and video playing away from the web page.

[0055] If the initial rendering process of the target webpage is abnormally closed, the initial multimedia process for playing the audio and video of the target webpage is closed, or the initial multimedia process of the target webpage is re-associated.

[0056] After the initial rendering process of the target webpage playing the target audio and video is abnormally closed, the initial multimedia process associated with the initial rendering process of the target webpage will become an isolated multimedia process, which is no longer controlled by the webpage of the web browsing application. Therefore, when the web browsing application establishes a new rendering process and a new multimedia process associated with the new rendering process, the original initial multimedia process and the new multimedia process will simultaneously play the audio and video corresponding to the target webpage, i.e., the problem of multiple audio and video playing simultaneously occurs, which adversely affects the user's audio and video watching.

[0057] Therefore, when the initial rendering process of the target webpage is abnormally closed, the initial multimedia process for playing the target audio and video of the target webpage needs to be closed to avoid the original initial multimedia process and the new multimedia process playing the audio and video corresponding to the target webpage simultaneously after the web browsing application establishes a new rendering process and a new multimedia process associated with the new rendering process. Alternatively, when the initial rendering process of the target webpage is abnormally closed, the initial multimedia process of the target webpage needs to be re-associated so that the initial multimedia process of the target webpage is controlled by the target webpage again, thereby avoiding the problem of multiple audio and video playing simultaneously, which can improve the user's experience of watching webpage audio and video.

[0058] Optionally, in some embodiments of the present application, the re-association of the initial multimedia process of the target webpage in step 102 can mean that after the initial rendering process of the target webpage is abnormally closed, a new rendering process of the target webpage is established, and the initial multimedia process associated with the initial rendering process is associated with the new rendering process.

[0059] For example, after the new rendering process of the target webpage is established, the audio and video playing in the web browser are imported into the new rendering process to realize the association of the initial multimedia process and the new rendering process.

[0060] After the new rendering process is associated with the initial multimedia process, the main process does not need to be notified to establish a new multimedia process, so the original initial multimedia process and the new multimedia process will not play the audio and video corresponding to the target webpage simultaneously, and the smoothness of webpage audio and video playing can be ensured, and the user can not perceive the abnormality of the rendering process of the web browsing application.

[0061] Optionally, in some embodiments of the present application, in the process of detecting whether the initial rendering process of the target webpage is abnormally closed in step 101, whether the initial rendering process of the target webpage is abnormally closed can be detected based on the main process of the webpage browsing application, or whether the initial rendering process of the target webpage is abnormally closed can be detected based on the initial multimedia process for playing the target audio and video.

[0062] Optionally, after detecting whether the initial rendering process of the target webpage is abnormally closed based on the initial multimedia process, if the initial multimedia process detects that the initial rendering process of the target webpage is abnormally closed, the main process is notified to close the initial multimedia process, or the initial multimedia process is re-associated.

[0063] It should be noted that the initial rendering process of the target webpage refers to a rendering process established before a new rendering process is established. When a new rendering process is established, the new rendering process becomes a new initial rendering process. When the new initial rendering process is abnormally closed, the webpage browsing application will again establish a new rendering process, and so on.

[0064] In addition, the initial rendering process being abnormally closed can refer to a rendering process being closed due to a webpage being normally closed under non-user control, a rendering process being closed due to an abnormal running of the rendering process itself, or a rendering process being abnormally closed due to a system keep-alive mechanism caused by the webpage browsing application being placed in the background, and the like.

[0065] It should be further noted that the target audio and video playing off the webpage can include audio and video playing in a multimedia process, that is, the target audio and video can be a video containing images, or can be audio playing in a multimedia process, and the present application does not limit this.

[0066] In the embodiments of the present application, when the initial rendering process of the target webpage is abnormally closed, the initial multimedia process for playing the target audio and video of the target webpage is closed, which can avoid a situation that the original initial multimedia process and the new multimedia process play the audio and video corresponding to the target webpage at the same time after the webpage browsing application establishes a new rendering process and a new multimedia process associated with the new rendering process. Alternatively, when the initial rendering process of the target webpage is abnormally closed, the initial multimedia process of the target webpage is re-associated, so that the initial multimedia process of the target webpage is re-controlled by the target webpage, which can avoid the problem of multiple audio and video playing at the same time, and can improve the experience of the user watching webpage audio and video.

[0067] Embodiment Two:

[0068] The present embodiment illustrates the specific implementation manner of step 102 in the above-mentioned embodiment one.

[0069] In the embodiments of the present application, the timing of closing the initial multimedia process of the target webpage for playing the target audio / video in step 102, and before and after closing the initial multimedia process of the target webpage for playing the target audio / video can be implemented in the following different ways.

[0070] Optionally, in some embodiments of the present application, step 102 can be implemented by the following steps B01 to B02:

[0071] Step B01, if the initial rendering process of the target webpage is closed abnormally, and the webpage browsing application is running in the foreground, then close the initial multimedia process of the target webpage for playing the target audio / video, and establish a new rendering process and a new multimedia associated with the new rendering process.

[0072] Step B02, resume playing the target audio / video by using the new multimedia process.

[0073] That is, after closing the initial multimedia process of the target webpage for playing the target audio / video, a new rendering process and a new multimedia associated with the new rendering process are immediately established.

[0074] Since the webpage browsing application is running in the foreground, it indicates that the user is browsing the target webpage. Therefore, by immediately establishing a new rendering process and a new multimedia associated with the new rendering process after closing the initial multimedia process of the target webpage for playing the target audio / video, the user's normal webpage browsing and webpage audio / video watching are avoided from being affected.

[0075] Optionally, in some embodiments of the present application, step 102 can be implemented by the following steps C01 to C03:

[0076] Step C01, if the initial rendering process of the target webpage is closed abnormally, and the webpage browsing application is running in the background, and the playing mode of the target audio / video is the full-screen playing mode, then close the initial multimedia process for playing the target audio / video, establish a new rendering process, and listen to whether the webpage browsing application is restored to the foreground running;

[0077] Step C02, when it is listened that the webpage browsing application is restored to the foreground running, establish a new multimedia process associated with the new rendering process;

[0078] Step C03, resume playing the target audio / video by using the new multimedia process.

[0079] In this embodiment, when the initial rendering process of the target webpage is abnormally closed, the webpage browsing application is running in the background, and the playing mode of the target audio / video is the full-screen playing mode, the initial multimedia process for playing the target audio / video is closed, and a new rendering process is established, so that the webpage browsing application can be immediately rendered when it is restored to the foreground running, and the white screen phenomenon can be avoided.

[0080] In addition, when the webpage browsing application is running in the background and the playing mode of the target audio / video is the full-screen playing mode, the initial multimedia process is located at the bottom layer of the display interface and can be in an abnormally closed state. Therefore, when the initial rendering process of the target webpage is abnormally closed, a new multimedia process associated with the new rendering process does not need to be immediately established. Therefore, the application establishes a new multimedia process associated with the new rendering process when the webpage browsing application is restored to the foreground running, instead of establishing a new multimedia process associated with the new rendering process at the same time as the new rendering process is established, so as to save the power consumption of the terminal and prevent the terminal from receiving the playing notification of the target audio / video when the webpage browsing application is in the background.

[0081] Optionally, in some embodiments of the application, the step 102 can also be implemented by the following steps D01 to D02:

[0082] Step D01, if the initial rendering process of the target webpage is abnormally closed, the webpage browsing application is running in the background, and the playing mode of the target audio / video is the floating window playing mode, the initial multimedia process for playing the target audio / video is closed, a new rendering process is established, and a new multimedia associated with the new rendering process is established.

[0083] Step D02, the playing of the target audio / video is restored by using the new multimedia process.

[0084] In this embodiment, when the playing mode of the target audio / video is the floating window playing mode, the target audio / video will be played in the form of a floating window on the display interface of the terminal regardless of whether the webpage browsing application is running in the background or not, i.e., the floating window of the target audio / video is located at the upper layer of the display interface. Therefore, after the initial rendering process of the target webpage is abnormally closed and the initial multimedia process for playing the target audio / video is closed, a new rendering process and a new multimedia associated with the new rendering process need to be immediately established to avoid affecting the user's audio / video watching.

[0085] It should be noted that, since the target audio and video are played in a floating window, if the initial rendering process of the target webpage is abnormally closed, and the initial multimedia process of the target audio and video is immediately closed and a new multimedia process associated with the new rendering process is established, a window-shaking situation may occur. Therefore, in some embodiments of this application, the above step 102 can also be implemented by the following steps E01 to E03:

[0086] Step E01: If the initial rendering process of the target webpage is abnormally closed, and the web browsing application is running in the background, and the playback mode of the target audio and video is floating window playback mode, then a new rendering process is created, and the web browsing application is monitored to see if it is restored to the foreground.

[0087] Step E02: Upon detecting that the web browsing application has resumed running in the foreground, close the initial multimedia process used to play the target audio and video, and establish a new multimedia process associated with the new rendering process.

[0088] Step E03: Restore playback of the target audio and video using the new multimedia process.

[0089] In this embodiment, when the initial rendering process of the target webpage is abnormally shut down, and the web browsing application is running in the background, and the playback mode of the target audio and video is a floating window playback mode, the initial multimedia process used to play the target audio and video is not directly shut down. Instead, when the web browsing application is detected to be running in the foreground, the initial multimedia process used to play the target audio and video is shut down, and a new multimedia process associated with the new rendering process is established to avoid situations like window shaking, making the audio and video playback smoother.

[0090] Specifically, during the process of a web browsing application returning to the foreground, it will generally first return to a state such as... Figure 2a Playback is performed in the element-mode playback mode shown, and then the playback mode is switched to the floating window mode. That is, the floating window itself will undergo a process of switching from the floating window mode to the element-mode playback mode. Therefore, when the web browsing application returns to the foreground, the initial multimedia process can be closed and a new multimedia process associated with the new rendering process can be created during the process of switching from the floating window mode to the element-mode playback mode. This can avoid window-shaking-like situations and make audio and video playback smoother.

[0091] Optionally, in some embodiments of this application, the above steps B02, C03, D02, and E03, which utilize a new multimedia process to resume playback of the target audio and video, can be implemented in the following way: during the process of closing the initial multimedia process used to play the target audio and video, the playback parameters of the target audio and video are recorded, and based on the playback parameters, playback of the target audio and video is resumed using a new multimedia process.

[0092] The playing parameters can include one or more of the following parameters: audio and video playing mode, floating window position, audio and video playing progress, audio and video playing multiple, audio and video playing link, pause / play state of audio and video playing, and the like. When the playing parameters are used to resume playing of the target audio and video by using a new multimedia process, the abnormality of the rendering process of the webpage browsing application can be realized without user awareness, and the user experience of watching webpage audio and video is improved.

[0093] The process control method provided in the embodiments of the present application can be applied to terminals of different operating systems. When the initial multimedia process for playing the target audio and video of the target webpage is closed or the initial multimedia process is re-associated, and then the playing of the target audio and video is resumed by using a new multimedia process based on the playing parameters, the abnormality of the rendering process of the webpage browsing application can be realized without user awareness, and the user experience of watching webpage audio and video is improved.

[0094] For the method embodiments described above, a series of actions are combined for simple description, but those skilled in the art should know that the present application is not limited by the action sequence. In some embodiments of the present application, some steps can be performed in other sequences.

[0095] Embodiment three:

[0096] An exemplary process control method is shown in the following. Figure 3 A structure diagram of a process control device 300 provided by the embodiments of the present application is shown. The process control device is configured in a webpage browsing application and includes a detection unit 301 and a control unit 302.

[0097] The detection unit 301 is configured to detect whether the initial rendering process of a target webpage of a webpage browsing application is abnormally closed. The target webpage is a webpage that has a target audio and video playing.

[0098] The control unit 302 is configured to close the initial multimedia process for playing the target audio and video of the target webpage or re-associate the initial multimedia process when the initial rendering process of the target webpage is abnormally closed.

[0099] Optionally, in some embodiments of the present application, the control unit 302 is specifically configured to:

[0100] After the initial rendering process of the target webpage is abnormally closed, a new rendering process of the target webpage is established.

[0101] The initial multimedia process is associated with the new rendering process.

[0102] Optionally, in some embodiments of the present application, the control unit 302 is specifically configured to:

[0103] When the initial rendering process of the target webpage is closed abnormally, and the webpage browsing application is running in the foreground, the initial multimedia process for playing the target audio / video is closed, a new rendering process is established, and a new multimedia associated with the new rendering process is established.

[0104] The playing of the target audio / video is resumed by using the new multimedia process.

[0105] Optionally, in some embodiments of the present application, the control unit 302 is specifically configured to:

[0106] When the initial rendering process of the target webpage is closed abnormally, and the webpage browsing application is running in the background, and the playing mode of the target audio / video is the full-screen playing mode, the initial multimedia process for playing the target audio / video is closed, a new rendering process is established, and whether the webpage browsing application resumes to run in the foreground is listened to.

[0107] When it is listened that the webpage browsing application resumes to run in the foreground, a new multimedia process associated with the new rendering process is established.

[0108] The playing of the target audio / video is resumed by using the new multimedia process.

[0109] Optionally, in some embodiments of the present application, the control unit 302 is specifically configured to:

[0110] When the initial rendering process of the target webpage is closed abnormally, and the webpage browsing application is running in the background, and the playing mode of the target audio / video is the floating window playing mode, the initial multimedia process for playing the target audio / video is closed, a new rendering process is established, and a new multimedia associated with the new rendering process is established.

[0111] The playing of the target audio / video is resumed by using the new multimedia process.

[0112] Optionally, in some embodiments of the present application, the control unit 302 is specifically configured to:

[0113] When the initial rendering process of the target webpage is closed abnormally, and the webpage browsing application is running in the background, and the playing mode of the target audio / video is the floating window playing mode, a new rendering process is established, and whether the webpage browsing application resumes to run in the foreground is listened to.

[0114] When it is listened that the webpage browsing application resumes to run in the foreground, the initial multimedia process for playing the target audio / video is closed, and a new multimedia process associated with the new rendering process is established.

[0115] The playing of the target audio / video is resumed by using the new multimedia process.

[0116] Optionally, in some embodiments of the present application, the control unit 302 is specifically configured to:

[0117] In the process of closing the initial multimedia process for playing the target audio-video, record the playing parameters of the target audio-video;

[0118] Based on the playing parameters, resume playing the target audio-video by using a new multimedia process.

[0119] Optionally, in some embodiments of the present application, the detection unit 301 is specifically configured to:

[0120] Detect whether the target audio-video playing mode of the webpage opened by the webpage browsing application is a preset playing mode; the preset playing mode includes one or both of the following playing modes: full-screen playing mode and floating window playing mode;

[0121] If it is the preset playing mode, determine that the webpage opened by the webpage browsing application is a target webpage that exists the target audio-video playing out of the webpage.

[0122] Optionally, in some embodiments of the present application, the detection unit 301 is specifically configured to:

[0123] Detect, based on the main process of the webpage browsing application, whether the initial rendering process of the target webpage is abnormally closed;

[0124] Alternatively,

[0125] Detect, based on the initial multimedia process for playing the target audio-video, whether the initial rendering process of the target webpage is abnormally closed.

[0126] It should be noted that, for the convenience and brevity of description, the specific working process of the process control apparatus 300 described above can refer to the corresponding process of each method embodiment described above, which will not be described here.

[0127] Exemplarily, Figure 4 Fig. 2 shows a structural schematic diagram of a terminal according to an embodiment of the present application. The terminal can include a processor 41, a memory 42, one or more input devices 43 (only one is shown in Fig. 2), and one or more output devices 44 (only one is shown in Fig. 2). The processor 41, the memory 42, the input device 43 and the output device 44 are connected through a bus 45. Figure 4

[0128] ​It should be understood that, in the embodiments of the present application, the processor 41 can be a central processing unit (CPU), and can also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gates or transistor logic, discrete hardware components, etc. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor.

[0129] The input device 43 can include a virtual keyboard, a touchpad, a fingerprint acquisition sensor (for acquiring fingerprint information and direction information of a fingerprint of a user), a microphone, etc., and the output device 44 can include a display, a speaker, etc.

[0130] The memory 42 stores a computer program, which can be run on the processor 41, for example, the computer program is a program of the process control method. When the processor 41 executes the computer program, the steps in the embodiments of the process control method are implemented, for example, Figure 1 As shown in steps 101 to 102, when the processor 41 executes the computer program, the functions in the embodiments of the device are implemented, for example, as shown in Figure 3 The functions of the detection unit 301 and the control unit 302.

[0131] The computer program can be divided into one or more modules / units, which are stored in the memory 42 and executed by the processor 41 to complete the present application. The one or more modules / units can be a series of computer program instruction segments capable of completing a specific function, which are used to describe the execution process of the computer program in the terminal performing the process control.

[0132] For example, the embodiments of the present application also provide a computer readable storage medium, which stores a computer program, and the computer program is executed to implement the steps of the process control method.

[0133] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above functional units is taken as an example, and in actual application, the above functions can be completed by different functional units or modules according to needs, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. Each functional unit or module in the embodiment can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or software. In addition, the specific names of each functional unit or module are only for easy distinction, and do not limit the protection scope of the present application. The specific working process of the unit or module in the above system can be the corresponding process in the foregoing method embodiment, which will not be repeated here.

[0134] In the above embodiments, the description of each embodiment has its own emphasis, and the parts not described or recorded in detail in a certain embodiment can be referred to the related description of other embodiments.

[0135] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized in electronic hardware or a combination of computer software and electronic hardware. Whether the functions are performed in hardware or software depends on the specific application and design constraints of the process control method. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0136] In the embodiments provided in the present application, it should be understood that the disclosed apparatus / user terminal and method can be implemented in other ways. For example, the apparatus / user terminal embodiments described above are only schematic, and the division of modules or units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the displayed or discussed each other can be indirect coupling or communication connection through some interface, device or unit, which can be electrical, mechanical or other forms.

[0137] The units described as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, that is, they can be located in one place, or they can be distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment scheme.

[0138] In addition, each of the function units in each of the embodiments of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software function unit.

[0139] If the integrated module / unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on such understanding, all or part of the processes in the above-mentioned embodiment methods can also be completed by a computer program instructing related hardware, and the computer program can be stored in a computer readable storage medium. When the computer program is executed by a processor, the steps of each method embodiment described above can be implemented. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or some intermediate forms. The computer readable medium can include any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal, and software distribution medium, etc. It should be noted that the content included in the computer readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction, for example, in some jurisdictions, according to legislation and patent practice, the computer readable medium does not include electrical carrier signals and telecommunication signals.

[0140] The above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacements to part of the method features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application.

Claims

1. A process control method characterized by, The application is applied to a webpage browsing application which adopts a multi-process mode for webpage loading, including a main process and a rendering process, wherein the main process is an entry process of the webpage browsing application, and the rendering process is used for rendering a visual interface; when a webpage opened by the webpage browsing application contains an audio / video which needs to be played, the rendering process notifies the main process to newly create a multimedia process to play the audio / video; the process control method comprises the following steps: detecting whether an initial rendering process of a target webpage of the webpage browsing application is abnormally closed; the target webpage is a webpage containing a target audio / video which is played out of the webpage; if the initial rendering process of the target webpage is abnormally closed, closing an initial multimedia process of the target webpage which is used for playing the target audio / video, so as to avoid a situation that the initial multimedia process and a new multimedia process play the audio / video corresponding to the target webpage at the same time after the webpage browsing application establishes a new rendering process and a new multimedia process associated with the new rendering process; or, re-associating the initial multimedia process, so that after the initial rendering process of the target webpage is abnormally closed, the initial multimedia process associated with the initial rendering process is associated with a new rendering process when the new rendering process of the target webpage is established.

2. The process control method according to claim 1, characterized by, The step of closing the initial multimedia process of the target webpage which is used for playing the target audio / video if the initial rendering process of the target webpage is abnormally closed comprises the following steps: if the initial rendering process of the target webpage is abnormally closed, and the webpage browsing application runs in the foreground, closing the initial multimedia process of the target webpage which is used for playing the target audio / video, and establishing a new rendering process and a new multimedia process associated with the new rendering process; resuming playing of the target audio / video by using the new multimedia process.

3. The process control method of claim 1, wherein, The step of closing the initial multimedia process of the target webpage which is used for playing the target audio / video if the initial rendering process of the target webpage is abnormally closed comprises the following steps: if the initial rendering process of the target webpage is abnormally closed, and the webpage browsing application runs in the background, and a playing mode of the target audio / video is a full-screen playing mode, closing the initial multimedia process which is used for playing the target audio / video, establishing a new rendering process, and listening to whether the webpage browsing application resumes to run in the foreground; when it is listened that the webpage browsing application resumes to run in the foreground, establishing a new multimedia process associated with the new rendering process; resuming playing of the target audio / video by using the new multimedia process.

4. The process control method of claim 1, wherein, The step of closing the initial multimedia process of the target webpage which is used for playing the target audio / video if the initial rendering process of the target webpage is abnormally closed comprises the following steps: if the initial rendering process of the target webpage is abnormally closed, the webpage browsing application runs in the background, and the playing mode of the target audio / video is a floating window playing mode, closing the initial multimedia process which is used for playing the target audio / video, establishing a new rendering process and a new multimedia process associated with the new rendering process; resuming playing of the target audio / video by using the new multimedia process.

5. The process control method of claim 1, wherein, If the initial rendering process of the target webpage is abnormally closed, the initial multimedia process for playing the target audio and video of the target webpage is closed, comprising: If the initial rendering process of the target webpage is abnormally closed, and the webpage browsing application is running in the background, and the playing mode of the target audio and video is the floating window playing mode, a new rendering process is established, and whether the webpage browsing application is restored to the foreground running is listened to; When the webpage browsing application is restored to the foreground running, the initial multimedia process for playing the target audio and video is closed, and a new multimedia process associated with the new rendering process is established; The playing of the target audio and video is resumed by using the new multimedia process.

6. A process control method according to any one of claims 2 to 5, wherein, The playing of the target audio and video by using the new multimedia process, comprising: In the process of closing the initial multimedia process for playing the target audio and video, the playing parameters of the target audio and video are recorded; Based on the playing parameters, the playing of the target audio and video is resumed by using the new multimedia process.

7. The process control method according to any one of claims 1 to 5, characterized by, The process control method, comprising: Detecting whether the target audio and video playing mode of the webpage opened by the webpage browsing application is a preset playing mode; the preset playing mode comprises one or both of the full screen playing mode and the floating window playing mode; If it is the preset playing mode, it is determined that the webpage opened by the webpage browsing application is the target webpage with the target audio and video playing off the webpage.

8. The process control method according to any one of claims 1 to 5, characterized by, The detection of whether the initial rendering process of the target webpage of the webpage browsing application is abnormally closed, comprising: Based on the main process of the webpage browsing application, whether the initial rendering process of the target webpage is abnormally closed is detected; Or, Based on the initial multimedia process for playing the target audio and video, whether the initial rendering process of the target webpage is abnormally closed is detected.

9. A process control apparatus, characterized by comprising: The process control device is configured in the webpage browsing application, and the webpage browsing application loads the webpage in a multi-process mode, comprising a main process and a rendering process, wherein the main process is the entry process of the webpage browsing application, and the rendering process is used for rendering the visual interface; when the webpage opened by the webpage browsing application contains audio and video to be played, the rendering process will notify the main process to newly create a multimedia process to play the audio and video; the process control device comprises: A detection unit is configured to detect whether the initial rendering process of the target webpage of the webpage browsing application is abnormally closed; the target webpage is a webpage with target audio and video playing off the webpage; A control unit is configured to close an initial multimedia process for playing the target audio / video of the target webpage when an initial rendering process of the target webpage is abnormally closed, so as to avoid a situation that the initial multimedia process and a new multimedia process play the audio / video of the target webpage simultaneously after a webpage browsing application establishes a new rendering process and a new multimedia process associated with the new rendering process; or, the initial multimedia process is re-associated, so that after the initial rendering process of the target webpage is abnormally closed, the initial multimedia process associated with the initial rendering process is associated with a new rendering process when a new rendering process of the target webpage is established.

10. A terminal, characterized by comprising: A computer program product comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the method according to any one of claims 1-8 when executing the computer program.

11. A computer readable storage medium, characterized in that, The computer readable storage medium stores a computer program, wherein the computer program is executed to implement the steps of the method according to any one of claims 1-8.

Citation Information

Patent Citations

  • Process clearing method and process clearing device

    CN104503841A

  • Terminal native crash processing method, terminal and computer readable storage medium

    CN107861854A

  • Multi-webpage video playing method and display device

    CN113660532A