Single-file multi-screen recording method, electronic device and storage medium thereof

Abstract

This invention relates to the technical field of multi-screen video recording, and more specifically, to a single-file multi-screen recording method, electronic device, and storage medium. The method includes: creating a first virtual screen; creating a mirrored data area on the first virtual screen matching the number of screen devices; acquiring real-time display data from multiple screen devices and outputting the real-time display data to the corresponding mirrored data area; and recording the first virtual screen to form a playback file when the screen devices interact. This invention requires minimal development; it only requires opening an electronic device with processing capabilities and simultaneously displaying the content of external screens by creating multiple virtual screens. This achieves the purpose of single-file multi-screen recording. Even if the developer is not on-site, they can remotely control different screens for multi-screen interaction and record the operation traces, increasing the convenience of multi-screen recording.

Description

Technical Field

[0001] This invention relates to the technical field of multi-screen video recording, and more specifically, to a single-file multi-screen recording method, an electronic device, and a storage medium thereof. Background Technology

[0002] The screen recording function allows you to record the content of a specific screen and create an MP4 file, which can then be played back as a video.

[0003] In existing technologies, when viewing recordings from multiple screens, the content of each screen is recorded separately into different MP4 files, and then these multiple MP4 files are opened for comparison, which is extremely inconvenient. Further, the different recording files can be merged together for viewing, but this requires developing an intermediate program, which consumes a significant amount of time, effort, and additional costs, making it a laborious approach. For example, when developers are debugging equipment, they need to observe the usage of two screens simultaneously and record the real-time interaction between the different screens. Recording them separately does not solve this type of problem. Current multi-screen recording methods can only record the content of multiple screens into multiple different files, resulting in inconvenient viewing. Summary of the Invention

[0004] To overcome the problem described in the background art of not being able to record the content of multiple screens into a single file, the present invention provides a single-file multi-screen recording method, an electronic device, and a storage medium thereof.

[0005] To solve the above-mentioned technical problems, the technical solution of the present invention is as follows:

[0006] In a first aspect, the present invention provides a single-file multi-screen recording method, the method being applied to an electronic device for recording multiple screen devices onto the same playback file, the method comprising:

[0007] Create the first virtual screen;

[0008] Create a mirrored data region on the first virtual screen that matches the number of screen devices;

[0009] Acquire real-time display data from multiple screen devices and output the real-time display data to the corresponding mirror data area;

[0010] When multiple screen devices interact, the first virtual screen is recorded to form a playback file.

[0011] Preferably, creating the first virtual screen includes:

[0012] Create the first virtual screen;

[0013] Connect the first virtual screen to the screen recording program.

[0014] Preferably, the screen recording program is MediaCodec.

[0015] Preferably, creating a mirrored data region on the first virtual screen that matches the number of screen devices includes:

[0016] Get the number of screen devices;

[0017] Create a mirrored data region based on the number of screen devices, with one mirrored data region corresponding to one screen device;

[0018] Connect the mirrored data area to the first virtual screen data.

[0019] Preferably, the step of acquiring real-time display data from multiple screen devices and outputting the real-time display data to the corresponding mirror data area includes:

[0020] Create multiple display controls in the mirrored data area, with one display control corresponding to one mirrored data area;

[0021] Acquire real-time display data from multiple screen devices and mirror the real-time display data from multiple screen devices through a display control.

[0022] Preferably, the display control is a SurfaceView.

[0023] Preferably, when the screen device is used for multi-screen interaction, it includes:

[0024] When a control action is received in the display area of ​​the physical screen, the action is fed back to the screen device;

[0025] The screen device receives feedback and performs corresponding control actions.

[0026] In a second aspect, the present invention provides an electronic device, the device comprising at least:

[0027] processor;

[0028] And the memory for storing data;

[0029] The processor is connected to the memory to execute the aforementioned single-file multi-screen recording method.

[0030] Preferably, the electronic device is an in-vehicle entertainment device, the processor is based on the Android platform, and the Android version is greater than 9.0.

[0031] Thirdly, the present invention provides a storage medium storing a computer program, which, when executed by a processor, implements the aforementioned single-file multi-screen recording method.

[0032] This invention uses an electronic device to record the content of different screens into the same file, achieving the effect of viewing different screens simultaneously within the same file. This invention requires minimal development; it only requires opening an electronic device with processing capabilities and creating multiple virtual screens to simultaneously display the content of external screens. This achieves the goal of single-file multi-screen recording. Even if the developers are not on-site, they can remotely control different screens for multi-screen interaction and record the operation process, increasing the convenience of multi-screen recording. Attached Figure Description

[0033] Figure 1 This is a flowchart illustrating the implementation of the single-file multi-screen recording method provided in Embodiment 1 of the present invention.

[0034] Figure 2 This is a flowchart illustrating the creation of a first virtual screen according to Embodiment 2 of the present invention.

[0035] Figure 3 This is a flowchart illustrating the implementation of creating a mirrored data region according to Embodiment 2 of the present invention.

[0036] Figure 4 This is a flowchart illustrating the creation of a display control as provided in Embodiment 2 of the present invention.

[0037] Figure 5 This is a flowchart illustrating the implementation of multi-screen recording as provided in Embodiment 2 of the present invention.

[0038] Figure 6 The following is a flowchart illustrating the implementation of a specific embodiment of the present invention, as provided in Embodiment 2. Detailed Implementation

[0039] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the invention.

[0040] In the accompanying drawings of the embodiments of this application, the same or similar reference numerals correspond to the same or similar components. In the description of this application, it should be understood that if terms such as "upper", "lower", "left", "right", "top", "bottom", "inner", "outer" indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings, they are only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, the terms used to describe positional relationships in the drawings are only for illustrative purposes and should not be construed as limiting this patent.

[0041] Furthermore, if terms such as "first" or "second" are used for descriptive purposes only, they are mainly used to distinguish different devices, components or parts (the specific types and structures may be the same or different), and are not used to indicate or imply the relative importance or quantity of the indicated devices, components or parts, and should not be construed as indicating or implying relative importance.

[0042] Example 1

[0043] This embodiment provides a single-file multi-screen recording method, which is mainly applied in electronic devices to record multiple screen devices into the same playback file. The method includes the following steps:

[0044] Please see Figure 1 The figure shows the implementation flow of the single-file multi-screen recording method in this embodiment.

[0045] like Figure 1 As shown, the method may include the following implementation process:

[0046] 101. Create the first virtual screen.

[0047] 102. Create a mirrored data area on the first virtual screen that matches the number of screen devices.

[0048] 103. Acquire real-time display data from multiple screen devices and output the real-time display data to the corresponding mirror data area.

[0049] 104. When multiple screen devices interact, record the first virtual screen to form a playback file.

[0050] First, the processor creates a primary virtual screen, which serves as the main screen for the entire program. During subsequent recording, the recorded interface will not exceed the scope of this primary virtual screen. When creating the primary virtual screen, the displayed content needs to be encoded for recording, and it is configured not to display content from other screens.

[0051] Based on step 101, that is, based on the first virtual screen, the processor creates several mirror data areas. The mirror data areas serve as the underlying screens and are used to mirror the display content of the main screen or other screens.

[0052] After the settings are completed in step 102, the processor will acquire the display content of the main screen or other screens, acquire the display data in real time and encode it through the first virtual screen, then save the encoded display data to a file, export the file to a computer for viewing, and use it to output the display content of the main screen or other screens.

[0053] In step 104, recording of the first virtual screen, i.e., recording the display content of the mirrored data area, can begin. During recording, the operator manipulates the physical screens, performing interactions between them. For example, moving content from one physical screen to another.

[0054] In this embodiment, when creating the first virtual screen, the processor needs to call an encoding program to encode and record the data content of the virtual screen to form a file.

[0055] This embodiment uses an electronic device to record the content of different screens into the same file, achieving the effect of viewing different screens simultaneously within the same file. In this embodiment, the operator only needs to turn on an electronic device with processing capabilities and create multiple virtual screens to simultaneously display the content of external screens, thus realizing the function of single-file multi-screen recording. Even if the developers are not on-site, they can remotely guide testers to interact with different screens and record the operation traces, increasing the convenience of multi-screen recording.

[0056] Example 2

[0057] The difference between this embodiment and the previous one is that:

[0058] This embodiment optimizes the implementation process of Embodiment 1.

[0059] Please see Figure 2 The figure illustrates the implementation process of creating the first virtual screen in this embodiment.

[0060] like Figure 2 As shown, the process may include:

[0061] 201. Create the first virtual screen.

[0062] 202. Connect the first virtual screen with the screen recording program.

[0063] Based on step 101, when creating the first virtual screen in step 201, the processor needs to create a recording program at the same time. Then, in step 202, the parameters of the screen recording interface are passed to the first virtual screen so that the first virtual screen and the screen recording program are connected. After that, multiple screens can be recorded.

[0064] In this embodiment, the screen recording program can be MediaCodec (a native codec interface).

[0065] Please see Figure 3 The figure illustrates the implementation process of creating a mirrored data region in this embodiment.

[0066] like Figure 3 As shown, the process may include:

[0067] 301. Obtain the number of screen devices.

[0068] 302. Create a mirrored data area based on the number of screen devices, with one mirrored data area corresponding to one screen device.

[0069] 303. Connect the mirrored data area to the first virtual screen data.

[0070] First, in step 301, the processor needs to obtain the number of screen devices connected to the main screen, which can be indirectly obtained by obtaining the number of connection ports. Then, in step 302, a mirror data area is created based on the number of screen devices, with each screen device corresponding to a display content output on one mirror data area. In step 303, the processor needs to establish a connection between the mirror data area and the first virtual screen. The first virtual screen can transmit encoded mirror data to a video file and save it to a storage medium.

[0071] Please see Figure 4 The figure illustrates the implementation process of creating the display control in this embodiment.

[0072] like Figure 4 As shown, the process may include:

[0073] 401. Create multiple display controls in the mirrored data area, with one display control corresponding to one mirrored data area.

[0074] 402. Obtain real-time display data from multiple screen devices and mirror the real-time display data from multiple screen devices through a display control.

[0075] The main function of the display controls is to mirror the display content of the screen devices. In step 401, based on the mirrored data area, the processor creates multiple display controls, with each display control corresponding to the display content of one screen device. In step 402, when the processor obtains the real-time display data of multiple screen devices, it mirrors and displays the real-time display data of the multiple screen devices through the display controls.

[0076] In this embodiment, the display control can be a SurfaceView (an Android control).

[0077] In this embodiment, after the processor creates the display control, it also needs to create a Surface (the interface that needs to be passed in to create the second virtual screen) and a second virtual screen. The display control is connected to the second virtual screen through the Surface, and the display control mainly outputs the display content through the second virtual screen.

[0078] Please see Figure 5 The figure shows the implementation process of multi-screen recording in this embodiment.

[0079] like Figure 5 As shown, the process may include:

[0080] 501. When a control action is received in the display area of ​​the physical screen, the action is fed back to the screen device.

[0081] 502. The screen device receives feedback and performs corresponding control actions.

[0082] In step 501, the tester can operate the device across multiple physical screens without performing any actions on the virtual screen. In step 502, the processor feeds back the tester's actions across the multiple physical screens to the screen device, which then mirrors the corresponding actions, representing the interaction between the first virtual screen and the screen device.

[0083] To provide a better user experience, we offer a specific implementation method.

[0084] See Figure 6 In this embodiment, an electronic device uses a processor to record multiple screens onto a single video file. The specific recording method is as follows:

[0085] 1) The processor creates the first virtual screen. When creating the first virtual screen, MediaCodeinputSurface (a parameter of the screen recording interface) needs to be passed in. The processor needs to encode and record the displayed content. The first virtual screen is set not to mirror the content of other screens.

[0086] 2) The processor creates a mirrored data area on the first virtual screen. The mirrored data area has two or more SurfaceViews to display the screen content to be recorded.

[0087] 3) The processor passes the Surface of the SurfaceView to the second virtual screen. Each SurfaceView corresponds to a virtual screen. These virtual screens need to mirror the real physical screen so that the physical screen can be mirrored on the SurfaceView.

[0088] Example 3

[0089] This embodiment provides an electronic device, which includes at least a processor and a memory.

[0090] The processor's primary function is logical processing, while memory stores the data used by the processor during operation. The processor and memory are connected to execute the following single-file, multi-screen recording method:

[0091] First, the processor creates a primary virtual screen, which serves as the main screen for the entire program. During subsequent recording, the recorded interface will not exceed the scope of this primary virtual screen. When creating the primary virtual screen, the displayed content needs to be encoded for recording, and it is configured not to display content from other screens.

[0092] When the processor creates the first virtual screen, it also needs to create a recording program. Then, it passes the parameters of the screen recording interface to the first virtual screen, so that the first virtual screen and the screen recording program can be connected. After that, multiple screens can be recorded.

[0093] Based on the first virtual screen, the processor creates several mirrored data regions. These mirrored data regions serve as the underlying screens, used to display the content of the main screen or other screens. The processor needs to obtain the number of screen devices connected to the main screen, which can be indirectly obtained by obtaining the number of connection ports. Then, based on the number of screen devices, mirrored data regions are created, with each screen device corresponding to a display content output on one mirrored data region.

[0094] The processor needs to establish a connection between the mirrored data area and the first virtual screen. The processor will acquire the display content of the main screen or other screens, obtain the display data in real time, encode it through the first virtual screen, and then input the encoded data into a file, which is saved in the storage medium.

[0095] Next, the processor needs to create multiple display controls in the mirrored data area, with one display control corresponding to one mirrored data area. The main function of the display controls is to mirror or copy the display content of the screen device.

[0096] Based on the mirrored data region, the processor creates multiple display controls, with each display control corresponding to the display content of one screen device. When the processor obtains real-time display data from multiple screen devices, it mirrors and displays the real-time display data from all screen devices through the display controls.

[0097] After the program framework is built based on the aforementioned processor, recording of the first virtual screen can begin, that is, recording the display content of the mirrored data area.

[0098] During recording, operators can interact between multiple physical screens. For example, they can play a video on one physical screen and move it to another.

[0099] In this embodiment, in-vehicle entertainment devices are mainly used in in-vehicle screen device systems. Moreover, the processor is required to be based on the Android platform, and the version of this Android platform is required to be greater than 9.0.

[0100] Example 4

[0101] This embodiment provides a storage medium storing a computer program. When the computer program is executed by a processor, it implements the single-file multi-screen recording method in Embodiment 1 or Embodiment 2.

[0102] Although the description of the present invention has been given in conjunction with the specific embodiments described above, it is obvious to those skilled in the art that many substitutions, modifications, and variations can be made based on the above description. Therefore, all such substitutions, modifications, and variations are included within the spirit and scope of the appended claims. The above embodiments of the present invention are merely examples for clearly illustrating the invention and are not intended to limit the implementation of the invention. For those skilled in the art, other variations or modifications can be made based on the above description. It is neither necessary nor possible to exhaustively describe all embodiments here. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention should be included within the protection scope of the claims of the present invention.

Claims

1. A method for recording multiple screens from a single file, characterized in that, The method is applied to electronic devices for recording multiple screen devices into the same playback file, and the method includes: Create the first virtual screen; Obtain the number of screen devices, create a mirror data area based on the number of screen devices, with one mirror data area corresponding to one screen device, and connect the mirror data area to the first virtual screen data; Multiple display controls, a second virtual screen, and the interface that the second virtual screen needs to pass in are created in the mirrored data area. The multiple display controls are connected to the second virtual screen data through the interface that the second virtual screen needs to pass in. One display control corresponds to one mirrored data area. Acquire real-time display data from multiple screen devices, and output the display content on the second virtual screen through display controls; When multiple screen devices interact, the first virtual screen is recorded to form a playback file.

2. The single-file multi-screen recording method according to claim 1, characterized in that, The creation of the first virtual screen includes: Create the first virtual screen; Connect the first virtual screen to the screen recording program.

3. The single-file multi-screen recording method according to claim 2, characterized in that, The screen recording program is MediaCodec.

4. The single-file multi-screen recording method according to claim 1, characterized in that, The display control is a SurfaceView.

5. The single-file multi-screen recording method according to claim 1, characterized in that, When the screen device interacts with multiple screens, it includes: When a control action is received in the display area of ​​the physical screen, the action is fed back to the screen device; The screen device receives feedback and performs corresponding control actions.

6. An electronic device, characterized in that, The device includes at least: processor; And the memory for storing data; The processor is connected to the memory to execute the single-file multi-screen recording method as described in any one of claims 1 to 5.

7. The electronic device according to claim 6, characterized in that, The electronic device is an in-vehicle entertainment device, and the processor is based on the Android platform, with the Android version being greater than 9.

0.

8. A storage medium, characterized in that, The storage medium stores a computer program, which, when executed by a processor, implements the single-file multi-screen recording method as described in any one of claims 1 to 5.

Images