Methods, terminal devices, and storage media for television communication based on the Internet of Things

Abstract

The application belongs to the field of communication, and particularly relates to a method for television communication based on the Internet of Things, a terminal device and a storage medium. In the method, through identification of equivalent pixels, when a data packet is received, the television can not only acquire display parameters of each pixel of a current video frame, but also can confirm display parameters of equivalent pixels of a subsequent video frame, so that the terminal device does not need to transmit full-pixel parameters when transmitting the subsequent video frame, the data transmission amount can be significantly reduced, the data loss amount can be reduced under the same packet loss rate, and the display effect of the video is ensured.

Description

Technical Field

[0001] This application belongs to the field of communications, and in particular relates to methods, terminal devices and storage media for communicating with televisions based on the Internet of Things. Background Technology

[0002] Most smart TVs currently support Wi-Fi screen mirroring, allowing video content from tablets and other devices to be wirelessly transmitted to the TV for playback, resulting in a better video playback experience.

[0003] The current method of transmitting video from a terminal to a television mainly involves slicing each video frame, encapsulating the information parameters of each frame segment into a data packet, and then sending the data packet to the television so that the television can display the video based on the content of the data packet. This method involves full data transmission throughout the entire video transmission process (i.e., transmitting all pixel data of each video frame), resulting in a large amount of data being transmitted. When network fluctuations occur, the probability of data packet loss increases, leading to frequent frame drops and stuttering in the video, which affects the user's viewing experience. Summary of the Invention

[0004] In view of this, embodiments of this application provide a method, terminal device, and storage medium for communicating with a television set based on the Internet of Things, which can solve the above-mentioned technical problems.

[0005] A first aspect of this application provides a method for communicating with a television set based on the Internet of Things (IoT), the method comprising:

[0006] S1: Identify the frame number of the video and number each frame of the video;

[0007] S2: For the first video frame, identify the pixel parameters of each pixel in the video frame, identify the equivalent pixels of the pixel in subsequent video frames, and group the video frame numbers of the equivalent pixels into the same number set.

[0008] S3: Slice the video frame into frame segments;

[0009] S4: Encapsulate the pixel parameters and corresponding number set of all pixels in each frame segment into a data packet, and assign a unique identifier to the data packet;

[0010] S5: Send each data packet to the television, so that the television can display video frames according to the pixel parameters in the received data packets, and confirm the equivalent pixels according to the received set of numbers. The television returns the identifier of the data packet after receiving it.

[0011] S6: For the next video frame, determine the region composed of pixels confirmed by the TV in the video frame based on the returned identifier, identify the pixel parameters of each pixel in the remaining region, identify the equivalent pixels of the pixel in subsequent video frames, and summarize the video frame numbers of each equivalent pixel into the same number set.

[0012] S7: Slice the remaining area into frame segments, execute S4, send each data packet to the television, so that the television displays part of the video frame according to the received pixel parameters, and displays the remaining part of the video frame according to the pixel parameters corresponding to the previously confirmed equivalent pixels, execute S6 to S7 until the television finishes playing the video.

[0013] A second aspect of this application provides a terminal device for sending video to a television set, including a memory and a processor. The memory stores a computer program, and when the computer program is executed by the processor, the processor causes the processor to perform the steps of the method for communicating with a television set based on the Internet of Things.

[0014] A third aspect of this application provides a storage medium storing a computer program, which, when executed by a processor, causes the processor to perform the steps of the method for communicating with a television set based on the Internet of Things.

[0015] The beneficial effects of this application embodiment compared with the prior art are as follows: The method provided by the present invention includes identifying the frame number of a video and numbering each frame of the video; for the first video frame, identifying the pixel parameters of each pixel in the video frame, identifying equivalent pixels of the pixel in subsequent video frames, and grouping the numbering of the video frames containing equivalent pixels into the same numbering set; slicing the video frame into frame segments; encapsulating the pixel parameters of all pixels in each frame segment and the corresponding numbering set into a data packet, and assigning a unique identifier to the data packet; sending each data packet to a television, so that the television displays the video frame according to the pixel parameters in the received data packet, and confirms equivalent pixels according to the received numbering set, wherein the television returns the identifier of the data packet after receiving it; for the next video frame, determining the region composed of pixels confirmed by the television in the video frame according to the returned identifier, identifying the pixel parameters of each pixel in the remaining region, and identifying equivalent pixels of the pixel in subsequent video frames. The process involves grouping the video frame numbers of all equivalent pixels into a single set of numbers; slicing the remaining area into frame segments; encapsulating the pixel parameters and corresponding number sets of all pixels in each frame segment into a data packet; assigning a unique identifier to the data packet; and sending each data packet to the television. The television then displays a portion of the video frame based on the received pixel parameters and displays the remaining portion based on the previously confirmed equivalent pixels. This process is repeated until the television finishes playing the video. In this application, by recognizing equivalent pixels, the television, upon receiving a data packet, can not only obtain the display parameters of each pixel in the currently transmitted video frame but also confirm the display parameters of equivalent pixels in subsequent video frames. This eliminates the need for the terminal device to transmit full pixel parameters when transmitting subsequent video frames, significantly reducing data transmission volume and minimizing data loss even with the same packet loss rate, thereby ensuring optimal video display quality. Attached Figure Description

[0016] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0017] Figure 1 This is a schematic diagram illustrating the implementation process of the method for communicating with a television set based on the Internet of Things, provided in an embodiment of this application.

[0018] Figure 2 This is a schematic diagram illustrating the implementation environment of the method for communicating with a television set based on the Internet of Things, as provided in the embodiments of this application.

[0019] Figure 3This is a virtual frame diagram illustrating the method for communicating with a television set based on the Internet of Things, provided in an embodiment of this application.

[0020] Figure 4 This is a schematic diagram of pixel parameter bars for a method of communicating with a television set based on the Internet of Things provided in an embodiment of this application;

[0021] Figure 5 This is a schematic diagram of the terminal device provided in the embodiments of this application. Detailed Implementation

[0022] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.

[0023] To illustrate the technical solution described in this application, specific embodiments are provided below.

[0024] Figure 1 This application illustrates a method for communicating with a television set based on the Internet of Things (IoT) according to Embodiment 1. The method includes:

[0025] S1: Identify the frame number of the video and number each frame of the video;

[0026] S2: For the first video frame, identify the pixel parameters of each pixel in the video frame, identify the equivalent pixels of the pixel in subsequent video frames, and group the video frame numbers of the equivalent pixels into the same number set.

[0027] S3: Slice the video frame into frame segments;

[0028] S4: Encapsulate the pixel parameters and corresponding number set of all pixels in each frame segment into a data packet, and assign a unique identifier to the data packet;

[0029] S5: Send each data packet to the television, so that the television can display video frames according to the pixel parameters in the received data packets, and confirm the equivalent pixels according to the received set of numbers. The television returns the identifier of the data packet after receiving it.

[0030] S6: For the next video frame, determine the region composed of pixels confirmed by the TV in the video frame based on the returned identifier, identify the pixel parameters of each pixel in the remaining region, identify the equivalent pixels of the pixel in subsequent video frames, and summarize the video frame numbers of each equivalent pixel into the same number set.

[0031] S7: Slice the remaining area into frame segments, execute S4, send each data packet to the television, so that the television displays part of the video frame according to the received pixel parameters, and displays the remaining part of the video frame according to the pixel parameters corresponding to the previously confirmed equivalent pixels, execute S6 to S7 until the television finishes playing the video.

[0032] In this embodiment, the method is executed in a terminal device, which can be a mobile phone, computer, tablet computer, etc. The terminal device can wirelessly communicate with the TV via WiFi, thereby enabling it to transmit video to the TV.

[0033] In this embodiment, after the user selects the video to be sent on the terminal device, the terminal device can identify the total number of frames of the video and number each video frame according to the order of the video frames. For example, the first video frame is numbered 1, the second video frame is numbered 2, and so on. Each pixel of the video frame corresponds to a set of numbers (which can be an empty set), including the number of the video frame where the corresponding pixel is located.

[0034] In this embodiment, each video frame contains a frame coordinate system (the origin is at a corner of the video frame, and the two coordinate axes are respectively along the two adjacent sides of the video frame that intersect at the corner). The frame coordinate system of each video frame is consistent with the relative position of the corresponding video frame, so that the frame coordinates of corresponding pixels in different video frames are consistent.

[0035] In this embodiment, the subsequent video frame is the video frame after the current video frame to be transmitted. For the first video frame, the video frame can be sliced ​​into 16*9 frame segments according to the shape of the video frame, and each frame segment includes several pixels. For the second and subsequent video frames, the video frame is first sliced ​​into 16*9 frame segments, and then the area composed of pixels recognized by the TV in each frame segment is removed to obtain the frame segment of the remaining area.

[0036] In this embodiment, the unique identifier can be a unique string of characters, such as '%768#', used to identify the data packet. If the terminal device receives any identifier, it indicates that the data packet corresponding to the identifier has been received by the TV and has not been lost. If the data packet is lost, the TV cannot receive and send back the unique identifier, which also indicates that it has been lost.

[0037] In this embodiment, the television displays a portion of the video frame based on the received pixel parameters, that is, a portion of the video frame composed of all pixels in all received data packets. The pixel parameters include the frame coordinates of the pixel and the RGB color value. Two pixels are considered equivalent pixels only when both the frame coordinates and the RGB color values ​​are the same. In this application, by recognizing equivalent pixels, the television can obtain not only the display parameters of each pixel in the currently transmitted video frame when receiving data packets, but also the display parameters of equivalent pixels in subsequent video frames. This eliminates the need for the terminal device to transmit full pixel parameters when transmitting subsequent video frames, significantly reducing the amount of data transmitted. Under the same packet loss rate, this reduces the amount of data loss, thereby ensuring the display effect of the video.

[0038] In a preferred embodiment, the step between S1 and S2 further includes:

[0039] All frame numbers are sent to the television, causing the television to generate a virtual frame for each video frame corresponding to each frame number. Each virtual frame includes a first parameter space that has the same number of pixels as the video frame, and each first parameter space corresponds to a pixel in the video frame.

[0040] The frame number of each video frame segment is determined as the target number of the data packet corresponding to that frame segment; each data packet is sent to the television, so that the television displays the video frame based on the pixel parameters in the received data packets, including:

[0041] Add padding instructions to each data packet;

[0042] The system simultaneously sends data packets to the television, so that when the television receives any data packet, it receives the corresponding filling instruction. This allows the television to find the virtual frame corresponding to the video frame with the target number of the data packet, and fill the pixel parameters of each pixel in the data packet into the corresponding first parameter space in the virtual frame. As a result, the television displays the picture corresponding to the video frame with the target number according to the filling situation of the first parameter space in the virtual frame.

[0043] The equivalent pixels for this pixel in subsequent video frames include:

[0044] The pixel parameters of the pixel are determined as the first parameter, and the frame coordinates of the pixel in the video frame to which it belongs are identified;

[0045] In each subsequent frame of video, identify the candidate pixels corresponding to the coordinates of that frame;

[0046] For each candidate pixel, determine whether the pixel parameters of the candidate pixel are consistent with the first parameter. If they are, the candidate pixel is an equivalent pixel of the first pixel; otherwise, the candidate pixel is not an equivalent pixel of the first pixel.

[0047] The television is instructed to identify equivalent pixels based on the received set of numbers. The filling instruction causes the television to determine the subsequent video frame corresponding to each number in the set of numbers, and to determine the virtual frame corresponding to the subsequent video frame as the target virtual frame. Then, based on the frame coordinates of the pixels corresponding to the set of numbers, the television determines the first parameter space corresponding to the frame coordinates in the target virtual frame, and fills the first parameter space with the pixel parameters of the pixels corresponding to the set of numbers.

[0048] In this embodiment, the television displays the image corresponding to the video frame with the target number according to the filling situation of the first parameter space in the virtual frame. That is, when the television displays each pixel of the video frame, it queries the pixel parameter in the first parameter space corresponding to the pixel on the corresponding virtual frame and displays the RGB color value in the pixel parameter.

[0049] In this embodiment, the television confirms the equivalent pixel by filling the pixel parameters in the virtual frame corresponding to the subsequent video frame, so that the terminal device does not need to transmit these pre-filled pixel parameters during the subsequent transmission of video frames, thereby reducing the amount of data during video frame transmission and reducing the loss of pixel parameters due to packet loss.

[0050] As a preferred embodiment, the following is further included between S5 and S6:

[0051] For each frame coordinate in the video frame, a pixel parameter bar is generated. The pixel parameter bar has a number of second parameter spaces that are the same as the number of frames in the video. Each second parameter space corresponds to the number of video frames.

[0052] Before each data packet is sent, the data of the data packet is backed up to obtain the backup data of the data packet; based on the returned identifier, the region composed of pixels recognized by the television in the video frame is determined, including:

[0053] For any returned identifier, retrieve the backup data of the data packet corresponding to that identifier;

[0054] For each pixel in the backup data, take that pixel as the target pixel and identify all the numbers in the set of numbers corresponding to the target pixel as the first number;

[0055] Retrieve the pixel parameter bar corresponding to the target pixel, identify the second parameter space corresponding to each first number in the pixel parameter bar, and fill in the pixel parameter corresponding to the target pixel in each second parameter space;

[0056] Identify the video frame number as the target number;

[0057] For each pixel in the video frame, identify the frame coordinates of the pixel to retrieve the corresponding pixel parameter bar. In the pixel parameter bar, determine whether the second parameter space corresponding to the target number is filled. If so, the pixel is confirmed by the TV; otherwise, the pixel is not confirmed by the TV.

[0058] Identify the region comprised of all pixels recognized by the television within this video frame.

[0059] In this embodiment, if the terminal device receives a returned identifier, it indicates that the data packet corresponding to the identifier has been received by the television. Then, under the action of the filling instruction, the equivalent pixel corresponding to the data packet can be confirmed by the television. Therefore, when the terminal device receives any identifier, it can directly determine the equivalent pixel confirmed by the television.

[0060] In this embodiment, the filling status of the second parameter space in the generated pixel parameter bar corresponding to a frame coordinate can directly represent the confirmation status of the equivalent pixel of the pixel corresponding to that frame coordinate by the television (if the second parameter space is filled, the corresponding equivalent pixel is confirmed); the pixel parameter bar only needs to be generated once (generated when sending the data packet corresponding to the first video frame). When the pixel parameter bar needs to be retrieved later, the previously generated pixel parameter bar can be retrieved directly. Moreover, after each filling is completed on the pixel parameter bar, the filling trace is retained so that it can always show the confirmation status of the equivalent pixel of the corresponding pixel.

[0061] In this embodiment, for video frames after the first video frame, a portion of the first parameter spaces in the corresponding virtual frame have already been filled when the equivalent pixels were previously confirmed, while another portion of the first parameter spaces are filled according to the pixel parameters in the newly received data packet, thereby completing the overall filling of the virtual frame, so that the television displays the picture corresponding to the video frame with the target number according to the filling situation of the first parameter spaces in the virtual frame.

[0062] Embodiment 2 of this application provides a terminal device for sending video to a television set, including a memory and a processor. The memory stores a computer program, and when the computer program is executed by the processor, the processor performs the steps of the method for communicating with the television set based on the Internet of Things, specifically including:

[0063] S1: Identify the frame number of the video and number each frame of the video;

[0064] S2: For the first video frame, identify the pixel parameters of each pixel in the video frame, identify the equivalent pixels of the pixel in subsequent video frames, and group the video frame numbers of the equivalent pixels into the same number set.

[0065] S3: Slice the video frame into frame segments;

[0066] S4: Encapsulate the pixel parameters and corresponding number set of all pixels in each frame segment into a data packet, and assign a unique identifier to the data packet;

[0067] S5: Send each data packet to the television, so that the television can display video frames according to the pixel parameters in the received data packets, and confirm the equivalent pixels according to the received set of numbers. The television returns the identifier of the data packet after receiving it.

[0068] S6: For the next video frame, determine the region composed of pixels confirmed by the TV in the video frame based on the returned identifier, identify the pixel parameters of each pixel in the remaining region, identify the equivalent pixels of the pixel in subsequent video frames, and summarize the video frame numbers of each equivalent pixel into the same number set.

[0069] S7: Slice the remaining area into frame segments, execute S4, send each data packet to the television, so that the television displays part of the video frame according to the received pixel parameters, and displays the remaining part of the video frame according to the pixel parameters corresponding to the previously confirmed equivalent pixels, execute S6 to S7 until the television finishes playing the video.

[0070] Embodiment 3 of this application provides a storage medium storing a computer program. When the computer program is executed by a processor, the processor performs the steps of the method for communicating with a television based on the Internet of Things, specifically including:

[0071] S1: Identify the frame number of the video and number each frame of the video;

[0072] S2: For the first video frame, identify the pixel parameters of each pixel in the video frame, identify the equivalent pixels of the pixel in subsequent video frames, and group the video frame numbers of the equivalent pixels into the same number set.

[0073] S3: Slice the video frame into frame segments;

[0074] S4: Encapsulate the pixel parameters and corresponding number set of all pixels in each frame segment into a data packet, and assign a unique identifier to the data packet;

[0075] S5: Send each data packet to the television, so that the television can display video frames according to the pixel parameters in the received data packets, and confirm the equivalent pixels according to the received set of numbers. The television returns the identifier of the data packet after receiving it.

[0076] S6: For the next video frame, determine the region composed of pixels confirmed by the TV in the video frame based on the returned identifier, identify the pixel parameters of each pixel in the remaining region, identify the equivalent pixels of the pixel in subsequent video frames, and summarize the video frame numbers of each equivalent pixel into the same number set.

[0077] S7: Slice the remaining area into frame segments, execute S4, send each data packet to the television, so that the television displays part of the video frame according to the received pixel parameters, and displays the remaining part of the video frame according to the pixel parameters corresponding to the previously confirmed equivalent pixels, execute S6 to S7 until the television finishes playing the video.

[0078] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0079] It should be understood that, when used in this application specification, the term "comprising" indicates the presence of the described feature, integral, step, operation, element, and / or component, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components, and / or collections thereof.

[0080] It should also be understood that the term “and / or” as used in this application specification means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0081] As used in this application specification, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrase "if determined" or "if [the described condition or event] is detected" may be interpreted, depending on the context, as "once determined," "in response to determination," "once [the described condition or event] is detected," or "in response to detection of [the described condition or event]."

[0082] Furthermore, in the description of this application, the terms "first," "second," "third," etc., are used only for distinguishing descriptions and should not be construed as indicating or implying relative importance. It should also be understood that although the terms "first," "second," etc., are used in the text to describe various elements in some embodiments of this application, these elements should not be limited by these terms. These terms are merely used to distinguish one element from another. For example, a first table may be named a second table, and similarly, a second table may be named a first table, without departing from the scope of the various described embodiments. Both the first table and the second table are tables, but they are not the same table.

[0083] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0084] The method for communicating with a television based on the Internet of Things provided in this application can be applied to terminal devices such as mobile phones, tablets, wearable devices, in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPCs), netbooks, and personal digital assistants (PDAs). This application does not impose any restrictions on the specific type of terminal device.

[0085] For example, the terminal device may be a station (STAION, ST) in a WLAN, a cellular phone, a cordless phone, a Session Initiation Protocol (SIP) phone, a Wireless Local Loop (WLL) station, a Personal Digital Assistant (PDA) device, a handheld device with wireless communication capabilities, a computing device or other processing device connected to a wireless modem, an in-vehicle device, a vehicle networking terminal, a computer, a laptop computer, a handheld communication device, a handheld computing device, a satellite wireless device, a wireless modem card, a set-top box (STB), customer premises equipment (CPE), and / or other devices used for communication over a wireless system, as well as next-generation communication systems, such as mobile terminals in 5G networks or mobile terminals in future evolved Public Land Mobile Network (PLMN) networks.

[0086] As an example and not a limitation, when the terminal device is a wearable device, the term "wearable device" can also refer to any device that utilizes wearable technology to intelligently design and develop everyday wearables, such as glasses, gloves, watches, clothing, and shoes. Wearable devices are portable devices worn directly on the body or integrated into a user's clothing or accessories. Wearable devices are not merely hardware devices; they achieve powerful functions through software support, data interaction, and cloud interaction. Broadly defined, wearable smart devices include those with comprehensive functions, large sizes, and the ability to perform complete or partial functions without relying on a smartphone, such as smartwatches or smart glasses, as well as those focused on a specific application function that require interaction with other devices such as smartphones, such as various smart bracelets and smart jewelry for vital sign monitoring.

[0087] Figure 5 This is a schematic diagram of the structure of a terminal device provided in an embodiment of this application. For example... Figure 5 As shown, the terminal device of this embodiment includes: at least one processor ( Figure 5 Only one is shown in the image, and a memory is stored in which a computer program executable on the processor is stored. When the processor executes the computer program, it implements the steps in the various embodiments of the methods for communicating with a television based on the Internet of Things described above, for example... Figure 1 Steps S1 to S7 are shown.

[0088] The terminal device may be a desktop computer, laptop, handheld computer, or cloud server, etc. The terminal device may include, but is not limited to, a processor and memory. Those skilled in the art will understand that... Figure 5 This is merely an example of a terminal device and does not constitute a limitation on the terminal device. It may include more or fewer components than shown, or combine certain components, or different components. For example, the terminal device may also include input transmitting devices, network access devices, buses, etc.

[0089] The processor can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor.

[0090] In some embodiments, the memory may be an internal storage unit of the terminal device, such as a hard drive or RAM. The memory may also be an external storage device of the terminal device, such as a plug-in hard drive, Smart Media Card (SMC), Secure Digital (SD) card, or Flash Card. Furthermore, the memory may include both internal and external storage units. The memory is used to store the operating system, applications, bootloader, data, and other programs, such as the program code of the computer program. The memory can also be used to temporarily store data that has been sent or will be sent.

[0091] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0092] This application provides a computer program product that, when run on a mobile terminal device, enables the mobile terminal device to implement the steps described in the above-described method embodiments.

[0093] If the integrated module / unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include: any entity or device capable of carrying the computer program code, a recording medium, a USB flash drive, a portable hard drive, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium, etc.

[0094] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0095] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0096] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0097] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. Method for the communication of a television set based on the Internet of Things, characterized in that, The method for television communication based on Internet of Things comprises: S1: identifying the frame number of a video and numbering each frame of the video; S2: for the first video frame, identifying the pixel parameter of each pixel in the video frame, identifying the equivalent pixel of the pixel in the subsequent video frame, and collecting the frame number of the video frame where the equivalent pixel is located into the same number set, wherein the pixel parameter comprises the frame coordinate and RGB value of the pixel, and two pixels are regarded as equivalent pixels only when the frame coordinate and RGB value are the same; S3: slicing the video frame into frame segments; S4: packaging the pixel parameter of all pixels in each frame segment and the corresponding number set into a data packet, and assigning a unique identifier to the data packet; S5: sending each data packet to the television, so that the television displays the video frame according to the pixel parameter in the received data packet, and the television confirms the equivalent pixel according to the received number set, wherein the television returns the identifier of the data packet after receiving the data packet; S6: for the next video frame, determining the area composed of the pixels confirmed by the television according to the returned identifier, identifying the pixel parameter of each pixel in the remaining area, and identifying the equivalent pixel of the pixel in the subsequent video frame, and collecting the frame number of the video frame where each equivalent pixel is located into the same number set; S7: slicing the remaining area into frame segments, performing S4, sending each data packet to the television, so that the television displays part of the picture of the video frame according to the received pixel parameter, and displays the remaining part of the picture of the video frame according to the pixel parameter corresponding to the previously confirmed equivalent pixel, and performing S6 to S7 until the television finishes playing the video.

2. The method of claim 1, wherein, Between S1 and S2, it also comprises: sending all frame numbers to the television, so that the television generates a virtual frame for each frame number corresponding video frame, wherein each virtual frame comprises a first parameter space consistent with the number of pixels in the video frame, and each first parameter space corresponds to a pixel in the video frame.

3. The method of claim 2, wherein, Determining the frame number of the video frame where each frame segment is located as the target number of the data packet corresponding to the frame segment; sending each data packet to the television, so that the television displays the video frame according to the pixel parameter in the received data packet comprises: adding a filling instruction in each data packet; sending each data packet to the television at the same time, so that the television receives the corresponding filling instruction when receiving any data packet, finds the virtual frame corresponding to the video frame with the target number of the data packet, and fills the pixel parameter of each pixel in the data packet into the corresponding first parameter space in the virtual frame, so that the television displays the picture corresponding to the video frame with the target number according to the filling situation of the first parameter space in the virtual frame.

4. The method of claim 3, wherein, Identifying the equivalent pixel of the pixel in the subsequent video frame comprises: determining the pixel parameter of the pixel as the first parameter, and identifying the frame coordinate of the pixel in the video frame; identifying the candidate pixel corresponding to the frame coordinate in each subsequent video frame; for each candidate pixel, judging whether the pixel parameter of the candidate pixel is consistent with the first parameter, if yes, the candidate pixel is the equivalent pixel of the pixel, otherwise, the candidate pixel is not the equivalent pixel of the pixel.

5. The method of claim 4, wherein, The television machine confirms the equivalent pixels according to the received number set, that is, the filling instruction makes the television machine determine the subsequent video frame corresponding to each number in the number set, and determines the virtual frame corresponding to the subsequent video frame as the target virtual frame, and then determines the first parameter space corresponding to the frame coordinates of the pixels corresponding to the number set in the target virtual frame according to the frame coordinates of the pixels corresponding to the number set, and fills the pixel parameters of the pixels corresponding to the number set into the first parameter space.

6. The method of claim 5, wherein, Between S5 and S6, further comprising: A pixel parameter strip is generated for each pixel corresponding to the frame coordinates in the video frame, wherein the pixel parameter strip is provided with a number of second parameter spaces consistent with the number of frames of the video, and each second parameter space corresponds to the number of a video frame.

7. The method of claim 6, wherein, Before each data packet is sent, the data of the data packet is backed up to obtain the backup data of the data packet; and the region composed of the pixels confirmed by the television machine in the video frame is determined according to the returned identifier, comprising: For any returned identifier, the backup data of the data packet corresponding to the identifier is called out; For each pixel in the backup data, the pixel is taken as a target pixel, and all numbers in the number set corresponding to the target pixel are identified as first numbers; The pixel parameter strip corresponding to the target pixel is called out, and each first number corresponding to the second parameter space in the pixel parameter strip is identified, and the pixel parameter corresponding to the target pixel is filled in each second parameter space; The number of the video frame is identified as a target number; For each pixel in the video frame, the frame coordinates of the pixel are identified to call out the corresponding pixel parameter strip, and it is judged in the pixel parameter strip whether the second parameter space corresponding to the target number is filled, if yes, the pixel is confirmed by the television machine, otherwise, the pixel is not confirmed by the television machine; The region composed of all pixels confirmed by the television machine in the video frame is identified.

8. A terminal device, comprising: A television machine for sending a video, comprising a memory and a processor, the memory stores a computer program, and the computer program is executed by the processor to make the processor execute the steps of the method for communicating with the television machine based on the Internet of Things according to any one of claims 1 to 7.

9. A storage medium, characterized by The storage medium stores a computer program, and the computer program is executed by the processor to make the processor execute the steps of the method for communicating with the television machine based on the Internet of Things according to any one of claims 1 to 7.

Images