A method and system for playing multimedia special-shaped combined screens based on local area network

By using material cutting, playback file allocation and time synchronization methods in the LAN, the problem of seamless docking and content consistency in the connecting screen technology is solved, and the seamless playback and synchronization of multimedia content on different devices is achieved, improving user experience and system reliability.

CN119767064AInactive Publication Date: 2025-04-04SHENZHEN ZHUOZE TECH CO LTD
View PDF 14 Cites 0 Cited by

Patent Information

Application Number
CN202510245966.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-03-04
Publication Date
2025-04-04
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The existing connecting screen technology has the problem of seamless docking and content consistency in realizing multimedia content playback, especially in the case of combinations of devices of different shapes and resolutions and complex network environments.

Method used

By using the methods of material cutting, playback file allocation and time synchronization in the LAN, the connecting screen cutting ratio of the playback device is calculated, multimedia materials are cut, and the playback files are integrated, and the time of the playback device is synchronized to ensure that all devices start and end playback at the same time.

Benefits of technology

It realizes seamless playback of multimedia content on display devices of different shapes and resolutions, ensures the synchronization and consistency of playback, improves visual effects and user experience, and enhances the reliability and efficiency of the system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119767064A_ABST
    Figure CN119767064A_ABST
Patent Text Reader

Abstract

The present invention discloses a method and system for multimedia special-shaped combined joint screen playback based on a local area network, wherein the method includes the following steps: a management server compiles playback devices into joint screen groups, obtains the number and resolution of playback devices, and calculates the joint screen cutting ratio of playback devices based on the number and resolution of playback devices; obtains materials, cuts materials based on the joint screen cutting ratio to obtain multiple playback files, integrates playback files to establish a corresponding list of materials, and playback devices obtain playback files according to the corresponding list of materials; synchronizes the time of joint screen groups, synchronizes the time between the joint screen host and the joint screen slave; the joint screen host sends a playback instruction to the joint screen slave, and the joint screen host performs a playback operation according to the reply status of the joint screen slave. The present invention aims to improve the efficiency and effect of joint screen playback, so as to achieve the purpose of seamless playback of multimedia content on display devices of different shapes and resolutions, and ensure the synchronization and consistency of playback.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of multimedia playback, and relates to a method and system for playing multimedia special-shaped combined joint screens based on a local area network. Background Art

[0002] With the rapid development of multimedia technology, screen display systems are increasingly used in commercial advertising, public information display, entertainment and other fields. Traditional screen display systems usually use a single display device, that is, a single screen, which limits the diversity of displayed content and the expansion of visual effects. In order to break through these limitations, a variety of interconnected screen technologies have emerged on the market, which provide a wider field of view and richer visual experience by combining multiple display devices into one large screen.

[0003] However, the existing joint screen technology has some challenges in achieving multimedia content playback. First, the existing spliced ​​screens belong to conventional shape splicing, that is, uniform resolution splicing to form a complete picture. In some specific places or application scenarios, such as outdoor advertising screens or temporary splicing display screens, it is not necessary to present the complete picture, only part of the picture is needed. This requires different playback devices to be combined and spliced. The resolution and shape of different display devices may be different, which makes it difficult to achieve seamless docking and content consistency during splicing. Secondly, synchronizing multiple display devices to achieve a coordinated and consistent playback effect is a technical problem, especially when the network environment is complex or the device performance varies greatly. Summary of the invention

[0004] The present invention provides a method and system for multimedia special-shaped combined screen playback based on a local area network, which aims to improve the efficiency and effect of combined screen playback through material cutting, playback file allocation and time synchronization, so as to achieve the purpose of seamless playback of multimedia content on display devices of different shapes and resolutions, and ensure the synchronization and consistency of playback.

[0005] In order to achieve the above object, the present invention adopts the following technical solutions: A method for playing multimedia special-shaped combined screens based on a local area network, comprising: Group the playback devices into joint-screen groups, obtain the number and resolution of the playback devices, and calculate the joint-screen cutting ratio of the playback devices based on the number and resolution of the playback devices; Acquire the material, cut the material based on the joint screen cutting ratio to obtain multiple playback files, integrate the playback files to establish a material corresponding list, and the playback device acquires the playback file according to the material corresponding list; Synchronize the time of the screen-connected group, one of the playback devices is used as the screen-connected host, and the other playback devices are used as screen-connected slaves, and synchronize the time between the screen-connected host and the screen-connected slaves; The connected screen host sends a play command to the connected screen slave, and the connected screen host performs the play operation according to the reply status of the connected screen slave.

[0006] As a further solution of the present invention, the material is obtained, the material is cut based on the joint screen cutting ratio to obtain multiple playback files, the playback files are integrated to establish a material corresponding list, and the playback device obtains the playback file according to the material corresponding list, including: cutting the material according to the joint screen cutting ratio based on the FFMPEG tool; the playback device downloads the playback file in the material corresponding list to the playback device through the Ftp protocol or the Http protocol.

[0007] As a further solution of the present invention, the time of synchronizing the connected screen grouping, one of the playback devices serves as the connected screen host, and the other playback devices serve as the connected screen slaves, and the time between the connected screen host and the connected screen slaves is synchronized, including: the connected screen host sends the host time to the connected screen slave, and the connected screen slave calculates the difference time according to the host time; if the difference time is less than the first preset value, the synchronization time of the connected screen grouping is successful.

[0008] As a further solution of the present invention, the connected screen host sends the host time to the connected screen slave, and the connected screen slave calculates the phase difference time according to the host time, and also includes: if the phase difference time is greater than the first preset value, repeating the process of the connected screen host sending the host time to the connected screen slave, and the connected screen slave calculating the phase difference time according to the host time, until the phase difference time is less than the first preset value.

[0009] As a further solution of the present invention, the connected screen host sends the host time to the connected screen slave, and before the connected screen slave calculates the time difference based on the host time, it also includes: the connected screen slave sends a broadcast to search for the IP address of the connected screen host; the connected screen host replies the IP address to the connected screen slave; the connected screen slave requests the time of the connected screen host and records the current request time.

[0010] As a further solution of the present invention, the first preset value ranges from 40 milliseconds to 100 milliseconds.

[0011] As a further solution of the present invention, the connected screen host sends a play instruction to the connected screen slave, and the connected screen host performs a play operation according to the reply status, including: the connected screen host broadcasts the play time to the connected screen slave; the connected screen slave replies to the connected screen host within a third preset time, and calculates the play time on the current device; if the connected screen host receives replies from all the connected screen slaves within the third preset time, it starts playing.

[0012] As a further solution of the present invention, after the connected screen slave replies to the connected screen host within the third preset time and calculates the playback time, it also includes: if the connected screen host has not received replies from all the connected screen slaves within the third preset time, the connected screen host repeats broadcasting the playback time to the connected screen slaves, and the connected screen slaves reply to the connected screen host within the third preset time, and calculate the playback time on the current device, until the connected screen host receives replies from all the connected screen slaves within the third preset time.

[0013] As a further solution of the present invention, the screen-connected host sends instructions to the screen-connected slave, and the screen-connected host performs a playback operation according to the reply status, including: the screen-connected host and the screen-connected slave communicate through the UDP protocol.

[0014] A system for multimedia special-shaped combined joint screen playback based on a local area network, comprising: A management server is used to organize playback devices into joint screen groups, obtain the number and resolution of playback devices, and calculate the joint screen cutting ratio of playback devices based on the number and resolution of playback devices; synchronize the time of the joint screen group, and send the playback file to the corresponding playback device; A video processing module, used for acquiring materials, cutting the materials based on the joint screen cutting ratio to obtain multiple playback files, and establishing a corresponding list of materials; The playback device is used to receive the corresponding list of materials and download the corresponding playback files for playback.

[0015] Beneficial effects of the present invention: The present invention supports the compilation of playback devices of different shapes and resolutions into joint screen groups, and can realize flexible combinations of horizontal screens, vertical screens and special-shaped arrangements, meet diverse display needs, and improve visual effects and user experience. By calculating the joint screen cutting ratio based on the number and resolution of the playback devices, the multimedia materials can be accurately cut to ensure that the content received by each playback device matches its display characteristics, thereby achieving seamless splicing and content consistency, and one of the playback devices is set as the joint screen host, and the other devices are joint screen slaves. A time synchronization mechanism is used to ensure that all devices can start and end playback at the same time point, avoiding the synchronization problem caused by playback delay and improving the continuity of playback. The joint screen host performs playback operations according to the reply status of the slave, and can monitor the status of each device in real time, promptly discover and handle abnormal situations, further enhance the reliability of the system and user experience, and significantly improve the efficiency and effect of multimedia special-shaped combination joint screen playback. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 It is a process step diagram of the present invention.

[0017] Figure 2It is a schematic diagram of the system structure of the present invention.

[0018] Figure 3 It is a schematic diagram of the special-shaped combined screen of the present invention.

[0019] Figure 4 It is a schematic diagram of the playback screen where the special-shaped combined screen of the present invention is located. DETAILED DESCRIPTION

[0020] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by technicians in the technical field of the present invention; the terms used in the specification of the application herein are only for the purpose of describing specific embodiments and are not intended to limit the present invention; the terms "including" and "having" and any variations thereof in the specification and claims of the present invention and the above-mentioned drawings are intended to cover non-exclusive inclusions. The terms "first", "second", etc. in the specification and claims of the present invention or the above-mentioned drawings are used to distinguish different objects, not to describe a specific order.

[0021] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0022] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0023] The present invention provides Figures 1 to 4 In an embodiment of the present invention, a method for playing multimedia heterogeneous combination screens based on a local area network includes the following steps: S1. The playback device is grouped into a joint screen group, the number and resolution of the playback device are obtained, and the joint screen cutting ratio of the playback device is calculated based on the number and resolution of the playback device; Among them, in the local area network, a search signal is broadcast through a specific network protocol (such as TCP / IP, UDP, etc.) to identify and list all available playback devices. After the device responds to the search signal, the management server will organize the device into one or more joint screen groups according to the preset grouping strategy (such as device location, device type, resolution, etc.). For each device organized into the joint screen group, the system obtains detailed information of the device through the device driver or API call, including device model, manufacturer, serial number, software version and the most critical resolution information. The management server records the network identification information such as the IP address and MAC address of each device for subsequent device communication and management; the management server determines their relative position and display area in the joint screen display based on the resolution information of each device. The management server calculates the proportion of each device in the joint screen display based on the number and resolution information of the playback devices. For example, if a joint screen group consists of two 1080*640 and one 1080*1920, the management server will calculate the proportion of the video content that each display device should display.

[0024] S2. Get the material, cut the material based on the joint screen cutting ratio to obtain multiple playback files, integrate the playback files to establish a corresponding list of materials, the playback device obtains the playback file according to the corresponding list of materials; Among them, the material can be a video, an image, an animation or any form of multimedia content, and the material can be obtained in various ways, including but not limited to selection in the media library, network download and user upload; further, according to the screen-connected cutting ratio calculated in step S1, the video processing module uses video editing software or a special video processing tool to cut the material, and each cut playback file can be matched with the corresponding device. The management server integrates the cut playback files, establishes a corresponding material list, and associates each playback file with its corresponding playback device. This list can be a database table, a configuration file or any other form of data structure.

[0025] You can refer to the following and cut the entire material into 6 parts. For example, if the material name is test.jpg, the cut names are test1.jpg, test2.jpg, test3.jpg, test4.jpg, test5.jpg, and test6.jpg, and create a corresponding material list.

[0026] The corresponding list of materials is as follows: The playback device obtains the playback file according to the corresponding list of materials.

[0027] S3. Synchronize the time of the joint screen group, one of the playback devices as the joint screen host, the other playback devices as the joint screen slave, synchronize the time between the joint screen host and the joint screen slave; Among them, in the process of joint screen playback, time synchronization is a key factor to ensure that all playback devices can start and end playback at the same time, mainly to avoid playback delays and asynchronism problems, and maintain the continuity of video content and the overall visual effect. Specifically, in the joint screen group, a playback device with stable performance and good network connection can be selected as the joint screen host. The joint screen host is responsible for sending synchronization signals and playback instructions, which requires sufficient processing power and network bandwidth. The remaining playback devices are configured as joint screen slaves. The joint screen slaves rely on the time synchronization signal sent by the joint screen host to calibrate their internal clocks. The joint screen slaves need to be able to receive and process the synchronization signals from the host and adjust their own playback time according to these signals. In this process, methods including but not limited to calculating time difference judgment or other precise time synchronization protocols can be used to synchronize the time between the joint screen host and the slaves to improve high-precision time synchronization.

[0028] Furthermore, the linked screen host can periodically send timestamps to all slaves. The linked screen slaves calculate the time difference based on the received signal and adjust their own clocks to match the time of the host, ensuring that all devices can be synchronized within millisecond-level accuracy.

[0029] Furthermore, in a local area network, network delays and fluctuations may affect the accuracy of time synchronization. The connected screen host can reduce the impact of network delays and fluctuations by sending multiple synchronization signals and calculating the average value, or using other network time synchronization technologies.

[0030] S4. The connected screen host sends a play command to the connected screen slave, and the connected screen host performs the play operation according to the reply status of the connected screen slave.

[0031] Specifically, after the connected screen host determines that all devices are synchronized and ready to play, it generates playback instructions. These instructions include information such as the start time of playback, the identifier of the playback content, the playback order, etc. The connected screen host decides whether to start playback or delay playback based on the reply status of the slave device.

[0032] In general, special-shaped combined screen playback is mainly used to improve the display effect. By combining playback devices of different sizes and resolutions, including but not limited to multiple mobile phones, multiple computers, multiple TVs, etc. into a large screen, a wider range of content can be displayed to enhance a broader field of view and a richer visual experience. The cutting ratio can be dynamically calculated according to the number and resolution of the playback devices, so that any material can be adapted to different playback environments, improving the adaptability and flexibility of the content. By synchronizing the time of all devices in the joint screen grouping, it ensures that the video content can be accurately and synchronously played on all playback devices, avoiding the degradation of the viewing experience caused by asynchrony. Video content is allocated according to the display capabilities of each device, optimizing resource utilization, and ensuring that each device can operate efficiently within its performance range. By monitoring the status of the playback device and the execution of the synchronous playback instructions, the system can promptly detect and handle abnormal situations, enhancing the stability and reliability of the system, and can also play smoothly and synchronously even in complex network environments or with large differences in device performance.

[0033] The obtaining of the material, cutting the material based on the joint screen cutting ratio to obtain a plurality of playback files, integrating the playback files to establish a material corresponding list, and the playback device obtaining the playback file according to the material corresponding list, comprises the following steps: Cut the material according to the joint screen cutting ratio based on the FFMPEG tool; The playback device downloads the playback file of the list corresponding to the material to the playback device through the Ftp protocol or the HTTP protocol.

[0034] In this embodiment, the material can be a video file, an image sequence or any other form of multimedia content, which can be obtained in various ways, such as from local storage, a network server or user upload. According to the joint screen cutting ratio, the FFmpeg tool cuts the original material into multiple parts, each part corresponds to a playback device, and ensures that the video content received by each playback device matches its resolution, thereby achieving seamless splicing. During the FFmpeg cutting process, the cutting parameters are configured, such as the starting point, end point, aspect ratio, etc. of the cutting, to ensure that the material is correctly cut into multiple playback files.

[0035] Cutting method Figure 3 and Figure 4 As shown, Figure 3 It is the playback arrangement position of the playback device. Figure 4 The screen presentation position of the playback device in the playback material. The resolution of 192.168.0.2 is 1080*1920, and the resolution of other screens is 1080*640. According to the following screen grouping, the proportion of the corresponding device to be cut can be calculated. The size of the entire material is 3240 (1080*3) in width and 2560 (1920+640) in height.

[0036] 192.168.0.2 has an X of 0, a Y of 0, a width of 33.33% (1080 / 3240), and a height of 25% (640 / 2560) 192.168.0.3 has an X of 33%, a Y of 0, a width of 33%, and a height of 75%.

[0037] 192.168.0.4 has an X of 0, a Y of 66%, a width of 33%, and a height of 25%.

[0038] 192.168.0.5 has an X of 66%, a Y of 33%, a width of 33%, and a height of 25%.

[0039] 192.168.0.6 has an X of 33%, a Y of 66%, a width of 33%, and a height of 25%.

[0040] The X of 192.168.0.7 is 66%, the Y position is 62.5% (assuming the Y coordinate is 1600), the width is 33%, and the height is 25%.

[0041] like Figure 3 and Figure 4 As shown, after knowing the cutting ratio and location percentage of the relevant equipment, the video or image file is cut according to the cutting ratio of the percentage through the FFMPEG tool, and the material of each connected screen playback device accounts for the percentage of the entire material.

[0042] Furthermore, the playback device downloads the corresponding playback file through the FTP protocol or the HTTP protocol. Both protocols are commonly used file transfer protocols, but they differ in transmission efficiency, reliability and ease of use. FTP is used for batch file transfer, and HTTP protocol is used for file transfer in the Internet environment.

[0043] The method of synchronizing the time of the screen-connected grouping, wherein one of the playback devices serves as a screen-connected host and the other playback devices serve as screen-connected slaves, and synchronizing the time between the screen-connected host and the screen-connected slaves includes: The linked screen host sends the host time to the linked screen slave, and the linked screen slave calculates the time difference according to the host time; If the time difference is less than the first preset value, the synchronization time of the joint screen grouping is successful.

[0044] If the time difference is greater than the first preset value, the screen-connected host sends the host time to the screen-connected slave repeatedly, and the screen-connected slave calculates the time difference according to the host time until the time difference is less than the first preset value.

[0045] Specifically, the purpose of synchronizing the time of the screen grouping is to ensure that all playback devices can start and end playback at the same time in a multi-device screen playback environment, providing a seamless viewing experience. More specifically, the screen host sends its current time to all screen slaves periodically or as needed. After receiving the timestamp, each screen slave calculates the difference between its current time and the host time. This difference takes into account the network delay and the processing delay of the slave. The screen host or system sets a first preset value, which is a threshold value used to determine whether the time difference is within an acceptable range. This value can be set based on the requirements of the playback content and network conditions. For example, for applications that require high-precision synchronization, this value may be very small; if the calculated time difference is less than the preset value, then the time synchronization is successful, and the time of the screen slave is synchronized with the time of the screen host. If the time synchronization fails, the screen host can adopt a variety of strategies, such as resending the timestamp, increasing the sending frequency, or notifying the administrator to intervene, until the time difference is less than the first preset value.

[0046] Furthermore, the management server can be switched to manual mode after multiple failures.

[0047] The linked screen host sends the host time to the linked screen slave, and before the linked screen slave calculates the time difference according to the host time, the further step includes: The linked screen slave sends a broadcast to search for the linked screen host IP address; The linked screen host replies the IP address to the linked screen slave; The time when the linked screen slave requests the linked screen master, and the current request time is recorded at the same time.

[0048] Among them, after the connected screen playback device is started or reconfigured, each connected screen device needs to identify which device is the connected screen host. The connected screen slave sends a search request through the LAN broadcast to ask who is the connected screen host in the network. The connected screen host listens to the broadcast requests in the network and identifies the broadcast message for searching the connected screen host. The connected screen host responds to these requests and sends its own IP address to the connected screen slave that issued the request through a unicast message. Before sending the request, the connected screen slave will record the current system time, which is usually done by querying the operating system's clock. This timestamp will be used for subsequent calculations of the time difference with the connected screen host. Once the connected screen slave obtains the IP address of the connected screen host, it will send a time request message to the connected screen host to request the current host time.

[0049] In this embodiment, the time synchronization process reference steps are as follows: 1. The linked screen slave sends a broadcast to search for the host IP through the LAN UDP. The data format is JSON data format.

[0050] Sample data {"cmd":"getHostIp","param":""} 2. After receiving the cmd command as getHostIp data, the connected screen host sends the local IP to the connected screen slave. Assume that 192.168.0.3 is the connected screen host. The data is {"cmd":"setHostIp","param":{"IP":"192.168.0.3"}} 3. After receiving the data, the screen slave sends a request to the screen host time and records the current time. The data is {"cmd":"getHostTime","param":[{"localtime":"Local time (milliseconds)"}]} 4. After receiving the getHostTime command from the slave, the linked screen host sends the host time to the slave. The data is {"cmd":"setHostTime","param":[{"localtime":"Local time (milliseconds)"},{"Hosttime":"Host time (milliseconds)"}]} 5. After receiving the setHostTime data from the host, the slave subtracts localtime from the current time. If the time taken is less than the threshold (usually set to 40-100 milliseconds), then the time synchronization is considered valid. If the time difference is greater than the threshold, steps 3-5 will be repeated. After confirming that the time is valid, the difference between the local machine and the server can be calculated in milliseconds. Subtract localtime from the server time Hosttime to get the difference in milliseconds between the host and the current slave time (offtime).

[0051] The first preset value ranges from 40 milliseconds to 100 milliseconds. In multimedia playback scenarios, especially for video or joint-screen playback systems that require high synchronization, the range of 40 milliseconds to 100 milliseconds can meet the synchronization requirements of most commercial and entertainment purposes. Network latency in a local area network is usually low, but it still exists. Setting this range can ensure that the system can maintain good synchronization performance even when network conditions are not optimal. For viewers, a synchronization error of more than 100 milliseconds may cause visible playback asynchrony and affect the viewing experience. Therefore, setting the upper limit of the preset value to 100 milliseconds can ensure a good user experience.

[0052] The connected screen host sends a play instruction to the connected screen slave, and the connected screen host performs a play operation according to the reply status, including: The linked screen host sends the play time broadcast to the linked screen slave; The linked screen slave device replies to the linked screen host device within a third preset time, and calculates the playback time on the current device; If the linked screen host receives replies from all the linked screen slaves within a third preset time, the playback starts; If the connected screen host does not receive replies from all the connected screen slaves within the third preset time, the connected screen host repeats broadcasting the playback time to the connected screen slaves, and the connected screen slaves reply to the connected screen host within the third preset time, and calculate the playback time on the current device, until the connected screen host receives replies from all the connected screen slaves within the third preset time.

[0053] Specifically, after completing time synchronization and confirming that all playback devices are ready to receive the playback file, the connected screen host generates playback instructions. These instructions include but are not limited to information such as the scheduled playback time, identifier of the playback content, playback order, and may include special playback parameters such as volume level, brightness settings, etc.

[0054] The connected screen host broadcasts the playback time as part of the playback instruction to all connected screen slaves. This playback time can be an absolute time (such as a specific date and time) or a relative time (such as "play 5 seconds after receiving the instruction"). The third preset value refers to the time range within which the connected screen slave needs to reply to the connected screen host after receiving the playback instruction. This time is usually set short enough to ensure a quick response, but long enough to accommodate possible network delays and device processing time. In this embodiment, it can be set to 1 second.

[0055] After receiving the playback command, the linked screen slave device replies to the linked screen host based on its own readiness. The reply includes information such as device status, whether it is ready to play, and whether there is any delay.

[0056] When replying, the linked screen slave calculates the local playback time according to the received playback instruction and prepares to start playback synchronously.

[0057] The linked screen host waits for replies from all linked screen slaves and monitors the response status of each slave. This waiting process needs to be completed within the third preset time to ensure the synchronization of playback.

[0058] If the connected screen host receives replies from all the connected screen slaves within the third preset time, and all the slaves report that they are ready to play, the connected screen host will start playback. If any slave fails to respond in time or reports that it is not ready, the connected screen host can decide to delay playback, resend playback instructions or take other error handling measures until the connected screen host receives replies from all the connected screen slaves within the third preset time.

[0059] The connected screen host sends a command to the connected screen slave, and the connected screen host performs a playback operation according to the reply status, including: The host and slave devices communicate via UDP protocol.

[0060] Specifically, since UDP does not need to establish a connection, there is no need for a handshake process before sending data. This simplifies the communication process and reduces additional delays. It is suitable for real-time applications such as multimedia playback, where slight data loss has less impact on user experience than delay. The joint-screen playback system usually has high requirements for real-time performance. The UDP protocol can provide lower transmission delay, which is critical for maintaining audio and video synchronization. Furthermore, in the joint-screen playback system, if packet loss occurs when using the UDP protocol, the system can be designed to quickly retransmit key data packets after packet loss, or compensate for data loss through other mechanisms (such as forward error correction).

[0061] In this embodiment, the management server can automatically identify the state change (such as the screen orientation change, i.e., the switching between the horizontal screen and the vertical screen) and the position change of each playback device, and update the joint screen cutting ratio and send the corresponding playback content according to these changes, including the following steps: The management server periodically sends status and location query instructions to all playback devices through a preset network protocol (such as TCP / IP, UDP, etc.). These instructions are intended to obtain the current status information of each playback device, including screen orientation, resolution, connection status, and physical location; The management server receives status and position response information from playback devices and parses the information to determine the screen orientation, resolution, and physical location of each device; Based on the parsed status and location information, the management server dynamically adjusts the screen splitting ratio and layout of each playback device. For example, if a device switches from landscape to portrait, or a device is moved to a new location, the management server will recalculate the screen splitting ratio of the device and adjust the splitting method and layout of the playback content accordingly; Based on the adjusted joint screen cutting ratio and layout, the video processing module will re-cut or adjust the existing playback files to ensure that the content can adapt to the current status and position of each device. This may include rotating, scaling or cropping the video content to ensure that it is displayed correctly in the new direction or position; The management server then sends the adapted playback file to the corresponding playback device via FTP, HTTP or other file transfer protocols. Before sending the playback content, the management server will synchronize the time of all playback devices to ensure that all devices can play according to the same time reference. This step follows the aforementioned synchronization mechanism to ensure the synchronization and consistency of playback; The management server sends corresponding playback content and playback instructions based on the screen orientation, screen-to-screen ratio, and physical location of each playback device. This ensures that each device receives the correct playback content and starts playback at the right time even after the device status or location changes.

[0062] A system for multimedia special-shaped combined joint screen playback based on a local area network, comprising: A management server is used to organize playback devices into joint screen groups, obtain the number and resolution of playback devices, and calculate the joint screen cutting ratio of playback devices based on the number and resolution of playback devices; synchronize the time of the joint screen group, and send the playback file to the corresponding playback device; A video processing module, used for acquiring materials, cutting the materials based on the joint screen cutting ratio to obtain multiple playback files, and establishing a corresponding list of materials; The playback device is used to receive the corresponding list of materials and download the corresponding playback files for playback.

[0063] Specifically, the management server is the center of the system, responsible for coordinating and managing the entire joint-screen playback process. It organizes playback devices into joint-screen groups and calculates the joint-screen cutting ratio of each device based on the resolution and number of devices; the management server identifies and registers all available playback devices through the device discovery protocol in the local area network; the server adjusts the video content according to the resolution of each device to ensure the best display effect, and the management server is responsible for synchronizing the clocks of all devices in the joint-screen group to ensure the synchronization of playback; the server sends the cut playback files to the corresponding playback devices, which involves file transmission optimization and error handling.

[0064] The video processing module is responsible for acquiring video materials, which can be stored locally or downloaded through the network. According to the screen-joint cutting ratio calculated by the management server, the video processing module uses video editing tools (such as FFmpeg) to cut the materials into multiple playback files. The video processing module creates a material corresponding list and associates each cut playback file with the corresponding playback device to facilitate file distribution and tracking.

[0065] The playback device receives a list of corresponding materials from the management server and downloads the corresponding playback files according to the list. The playback devices download the playback files assigned to them from the management server through FTP, HTTP or other protocols. The playback devices control the start, end and other playback operations according to the instructions and synchronization signals of the management server. The playback devices feedback their status to the management server, including whether they are ready to play, whether there are delays or other problems.

[0066] The invention is operational with numerous general purpose or special purpose computer system environments or configurations.

[0067] For example: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronics devices, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, etc.

[0068] The invention may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer.

[0069] Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network.

[0070] In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.

[0071] Specifically, a person skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through computer-readable instructions, and the computer-readable instructions can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, the aforementioned storage medium can be a non-volatile storage medium such as a disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

[0072] It should be understood that although the steps in the flowchart of the accompanying drawings are shown in sequence according to the instructions of the arrows, these steps are not necessarily performed in the order indicated by the arrows. Unless otherwise clearly stated in this document, the execution of these steps is not strictly limited in order and can be performed in other orders.

[0073] Moreover, at least part of the steps in the flowchart of the accompanying drawings may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The order of execution is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.

[0074] Obviously, the embodiments described above are only some embodiments of the present invention, rather than all embodiments. The drawings provide preferred embodiments of the present invention, but do not limit the scope of the present invention. The present invention can be implemented in many different forms. On the contrary, the purpose of providing these embodiments is to make the understanding of the disclosure of the present invention more thorough and comprehensive.

[0075] Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art can still modify the technical solutions described in the aforementioned specific embodiments, or replace some of the technical features therein with equivalents. Any equivalent structure made using the contents of the present invention's specification and drawings, directly or indirectly applied to other related technical fields, is also within the scope of patent protection of the present invention.

Claims

1. A method for playing multimedia special-shaped combined screens based on a local area network, characterized in that: include: Configuration management server and multiple playback devices, including: The management server organizes the playback devices into joint-screen groups, obtains the number and resolution of the playback devices, and calculates the joint-screen cutting ratio of the playback devices based on the number and resolution of the playback devices; Acquire the material, cut the material based on the joint screen cutting ratio to obtain multiple playback files, integrate the playback files to establish a material corresponding list, and the playback device acquires the playback file according to the material corresponding list; The management server synchronizes the time of the screen-connected group, one of the playback devices serves as the screen-connected host, and the other playback devices serve as screen-connected slaves, and synchronizes the time between the screen-connected host and the screen-connected slaves; The connected screen host sends a play command to the connected screen slave, and the connected screen host performs the play operation according to the reply status of the connected screen slave.

2. According to claim 1, a method for playing multimedia special-shaped combined screens based on a local area network is characterized in that: The acquiring of the material, cutting the material based on the joint screen cutting ratio to acquire a plurality of playback files, integrating the playback files to establish a material corresponding list, and the playback device acquiring the playback file according to the material corresponding list, comprises: Cut the material according to the joint screen cutting ratio based on the FFMPEG tool; The playback device downloads the playback file of the list corresponding to the material to the playback device through the Ftp protocol or the HTTP protocol.

3. The method for playing multimedia special-shaped combined screens based on a local area network according to claim 1, characterized in that: The method of synchronizing the time of the screen-connected grouping, wherein one of the playback devices serves as a screen-connected host and the other playback devices serve as screen-connected slaves, and synchronizing the time between the screen-connected host and the screen-connected slaves includes: The linked screen host sends the host time to the linked screen slave, and the linked screen slave calculates the time difference according to the host time; If the time difference is less than the first preset value, the synchronization time of the joint screen grouping is successful.

4. The method for playing multimedia special-shaped combined screens based on a local area network according to claim 3, characterized in that: The linked screen host sends the host time to the linked screen slave, and the linked screen slave calculates the time difference according to the host time, and further includes: If the time difference is greater than the first preset value, the screen-connected host sends the host time to the screen-connected slave repeatedly, and the screen-connected slave calculates the time difference according to the host time until the time difference is less than the first preset value.

5. The method for playing multimedia special-shaped combined screens based on a local area network according to claim 3, characterized in that: The linked screen host sends the host time to the linked screen slave, and before the linked screen slave calculates the time difference according to the host time, the further step includes: The linked screen slave sends a broadcast to search for the linked screen host IP address; The linked screen host replies the IP address to the linked screen slave; The time when the linked screen slave requests the linked screen master, and the current request time is recorded at the same time.

6. According to the method for multimedia special-shaped combination screen playback based on a local area network as described in claim 3, the first preset value ranges from 40 milliseconds to 100 milliseconds.

7. The method for playing multimedia special-shaped combined screens based on a local area network according to claim 1, characterized in that: The connected screen host sends a play instruction to the connected screen slave, and the connected screen host performs a play operation according to the reply status, including: The linked screen host sends the play time broadcast to the linked screen slave; The linked screen slave device replies to the linked screen host device within a third preset time, and calculates the playback time on the current device; If the linked screen host receives replies from all the linked screen slaves within a third preset time, playback begins.

8. The method for playing multimedia special-shaped combined screens based on a local area network according to claim 7, characterized in that: The linked screen slave machine replies to the linked screen master machine within a third preset time, and after the playback time is calculated, it also includes: If the connected screen host does not receive replies from all the connected screen slaves within the third preset time, the connected screen host repeats broadcasting the playback time to the connected screen slaves, and the connected screen slaves reply to the connected screen host within the third preset time, and calculate the playback time on the current device, until the connected screen host receives replies from all the connected screen slaves within the third preset time.

9. The method for playing multimedia special-shaped combined screens based on a local area network according to claim 1, characterized in that: The connected screen host sends a command to the connected screen slave, and the connected screen host performs a playback operation according to the reply status, including: The host and slave devices communicate via UDP protocol.

10. A system for playing multimedia special-shaped combined screens based on a local area network, characterized in that: include: A management server is used to organize playback devices into joint-screen groups, obtain the number and resolution of playback devices, and calculate the joint-screen cutting ratio of playback devices based on the number and resolution of playback devices; Synchronize the time of the joint screen grouping and send the playback file to the corresponding playback device; The playback device is used to receive the corresponding list of materials and download the corresponding playback files for playback.

Citation Information

Patent Citations

  • Multi-source tiled display system and display screen gap aberration eliminating method

    CN104112441A

  • Large screen splicing display method, device and system

    CN105468327A

  • Spliced display system of mobile phone screen

    CN106293571A

  • Game interface display method, display device, and display system

    CN109101208A

  • Multi-screen linkage playing method and device, intelligent terminal and storage medium

    CN111314751A