Image information processing system based on electronic commerce live broadcast

Abstract

The invention discloses an image information processing system based on electronic commerce live broadcast, relates to the technical field of image information processing, and solves the technical problems that unreasonable image transmission can reduce the watching experience of a user and influence the overall network transmission. According to the method, the difference image is obtained by performing difference analysis on the obtained image, then whether the generation time of the difference image in the same time period has a rule or not is judged, and the condition that the rule exists and the condition that the rule does not exist are independently analyzed; when the difference image is analyzed, parameters of the difference image are adjusted, comprehensive adjustment is performed according to the packet loss rate and the repeated data capacity corresponding to the difference image, on one hand, the overall image quality of the image can be guaranteed, on the other hand, the transmission speed of the image can be guaranteed, and the transmission efficiency of the image is improved. And the network transmission congestion condition is avoided while the user impression is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of image information processing, and in particular to an image information processing system based on e-commerce live broadcast. Background Art

[0002] With the rapid development of the Internet and mobile communication technologies, Internet video live streaming can publish e-commerce products and other content on the Internet, taking advantage of the Internet's intuitiveness, speed, good presentation, rich content, strong interactivity, no geographical restrictions, and audience segmentation.

[0003] According to Chinese patent application number CN202011329001.2, an image interaction information processing method, system and platform based on e-commerce live broadcast are disclosed. The image interaction area is determined according to the live graphic interaction label of the online interactive live broadcast product, and then the interaction behavior sequence and interaction type conversion information of each live broadcast audience account corresponding to the image interaction area are obtained, and then the first interaction feature vector of each live broadcast audience account and the second interaction feature vector of each live broadcast audience account are extracted, and after fusing them to obtain the target interaction feature vector, the live broadcast interaction hotspot node corresponding to each live broadcast audience account for the online interactive live broadcast product is determined, thereby pushing the live broadcast product recommendation information.

[0004] However, when some live image processing systems are in use, they can only unilaterally see whether there are abnormalities in image uploading, and cannot make reasonable adjustments based on the image status. Secondly, abnormal image status will affect the user's viewing experience and will also affect the overall network transmission. Summary of the invention

[0005] In view of the deficiencies in the prior art, the present invention provides an image information processing system based on e-commerce live broadcast, which solves the problem that unreasonable image transmission will reduce the user's viewing experience and affect the overall network transmission.

[0006] To achieve the above objectives, the present invention is implemented through the following technical solutions: an image information processing system based on e-commerce live broadcast, comprising:

[0007] The live image acquisition unit is used to transmit the acquired live image to the image information calibration and analysis unit.

[0008] Yuan

[0009] An image information calibration and analysis unit is used to analyze the clarity of multiple sets of live images obtained by online personnel in real time, select the difference images from the multiple sets of live images, monitor the difference values, generate an adjustment monitoring signal, and then transmit the adjustment monitoring signal to the adaptive processing unit;

[0010] The adaptive processing unit is used to perform regularity analysis on abnormal time points corresponding to abnormal images in different time periods to generate abnormal regular signals and abnormal irregular signals, perform numerical calibration on abnormal images corresponding to abnormal irregular signals and obtain calibration images, analyze the packet loss rate of abnormal images corresponding to abnormal regular signals to generate packet loss adjustment information and packet loss normal information, and transmit the two to the transmission analysis unit;

[0011] The transmission analysis unit is used to adjust and analyze the normal information of packet loss according to the resolution of the abnormal image, and generate a calibration image. Based on the packet loss adjustment information, the normal packet loss interval is judged for the packet loss rate of the abnormal image, and an adjustment signal and an image optimization signal are generated. At the same time, based on the image optimization signal, the repeated data in the abnormal image is analyzed, and different modes of transmission are performed according to the impact of the repeated data on the whole, and a repeated data removal signal and a transmission signal are generated, and then the generated signal is transmitted to the processing result output unit.

[0012] The processing result output unit is used to display the acquired calibration image and transmit the acquired duplicate data removal signal and transmission signal to the execution module for operation execution.

[0013] As a further solution of the present invention: the specific manner in which the image information calibration and analysis unit analyzes multiple groups of live images is as follows:

[0014] Obtain multiple groups of live images corresponding to any time period, obtain all the clarity of the live images, and obtain the real-time online personnel corresponding to different clarity, select the clarity corresponding to the largest number of real-time online personnel as the target clarity, and then determine whether there is an image difference in the live images within the time period t corresponding to the target clarity;

[0015] When there are differences in the live images, the live images with differences are selected and marked as abnormal images. When there are no differences in the live images, a same-period monitoring signal is generated, and then the abnormal images are calibrated and analyzed to obtain the difference values ​​corresponding to the abnormal images and the standard parameters corresponding to the difference values. At the same time, the difference values ​​are adjusted and monitored, and an adjustment monitoring signal is generated.

[0016] As a further solution of the present invention: the specific manner in which the adaptive processing unit generates abnormal regular signals and abnormal irregular signals is as follows:

[0017] Acquire multiple groups of abnormal images within a time period, and simultaneously acquire the abnormal time points corresponding to the abnormal images, and then judge the acquired abnormal time points. If the abnormal time points are the same, it indicates that there is a regularity in the generation of the abnormal images, and an abnormal regularity signal is generated. If the abnormal time points are different, it indicates that there is no regularity in the generation of the abnormal images, and an abnormal irregularity signal is generated.

[0018] As a further solution of the present invention: the specific manner in which the adaptive processing unit analyzes the abnormal regular signal and the abnormal irregular signal is:

[0019] For the generated abnormal irregular signal, an abnormal image and its corresponding abnormal value are obtained, and a standard value corresponding to the abnormal value is obtained, and then the abnormal value is calibrated to obtain a calibration image, and the calibration image is outputted at the same time;

[0020] For the generated abnormal regular signal, the current packet loss rate and the standard packet loss rate corresponding to the abnormal time point are obtained, and the two are compared. If the current packet loss rate is greater than the standard packet loss rate, it means that the current packet loss rate is abnormal, and packet loss adjustment information is generated. If the current packet loss rate is less than the standard packet loss rate, it means that the current packet loss rate is normal, and normal packet loss information is generated.

[0021] As a further solution of the present invention: the specific manner in which the transmission analysis unit analyzes the packet loss adjustment information is:

[0022] The abnormal image corresponding to the normal information of packet loss is obtained, and the resolution of the abnormal image is obtained at the same time. Then, the normal image in the same period as the abnormal image is obtained, and the resolution corresponding to the normal image is obtained, and the average resolution of all normal images is calculated. Then, the resolution of the abnormal image is adjusted based on the calculated resolution average as the standard, and a calibration image is generated at the same time, and the calibration image is transmitted to the processing result output unit.

[0023] As a further solution of the present invention: the specific manner in which the adaptive processing unit analyzes the packet loss adjustment information is:

[0024] The current packet loss rate corresponding to the abnormal image is obtained, and the packet loss rate of the normal image in the same period is obtained at the same time, and a normal packet loss interval is generated. Then, it is determined whether the current packet loss rate exists in the normal packet loss interval. If so, an existence adjustment signal is generated. For the generated existence adjustment signal, the minimum packet loss rate corresponding to the normal packet loss interval is obtained, and the minimum packet loss rate is used as the adjustment standard to adjust the current packet loss rate. If it does not exist, an image optimization signal is generated.

[0025] As a further solution of the present invention: the specific method of analyzing the generated image optimization signal is:

[0026] The repeated data in the abnormal image is obtained and extracted, and the data capacity corresponding to all normal images is obtained at the same time, and the maximum data capacity among them is obtained, and then the capacity of the abnormal image is adjusted based on the maximum data capacity, and the capacity difference between the abnormal image data capacity and the maximum data capacity is calculated, and the repeated data with the same capacity difference is obtained and recorded as the repeated data to be adjusted;

[0027] Determine the impact of removing the duplicate data to be adjusted on the whole. When the duplicate data to be adjusted has no impact on the whole, remove it directly and generate a duplicate data removal signal. Conversely, when the duplicate data to be adjusted has an impact on the whole, transmit the duplicate data to be adjusted separately and generate a transmission signal. Then transmit the generated duplicate data removal signal and transmission signal to the processing result output unit.

[0028] The present invention provides an image information processing system based on e-commerce live broadcast. Compared with the prior art, it has the following beneficial effects:

[0029] The present invention obtains a difference image by performing difference analysis on the acquired images, then determines whether there is a regularity in the generation time of the difference image within the same time period, and separately analyzes the situations where there is a regularity and where there is no regularity. When analyzing the difference image, the parameters of the difference image itself are adjusted, and when adjusting, comprehensive adjustments are made according to the packet loss rate and repeated data capacity corresponding to the difference image. On the one hand, the overall image quality can be guaranteed, and on the other hand, the image transmission speed can be guaranteed, thereby improving the user's viewing experience and avoiding network transmission congestion. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 This is a block diagram of the system principle of the present invention. DETAILED DESCRIPTION

[0031] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0032] See also Figure 1 The present application provides an image information processing system based on e-commerce live broadcast, including: a live image acquisition unit, an image information calibration and analysis unit, an adaptive processing unit, a transmission analysis unit and a processing result output unit.

[0033] Embodiment 1

[0034] The live broadcast image acquisition unit is used to acquire the live broadcast image during the live broadcast process and transmit the acquired live broadcast image to the image information calibration and analysis unit.

[0035] The image information calibration and analysis unit is used to analyze the acquired live images. When analyzing the live images, the real-time online personnel corresponding to different resolutions are analyzed, and the specific analysis method is as follows:

[0036] Obtain the corresponding live images within any time period, and the live images obtained here are multiple groups. At the same time, obtain all the clarity of the live images, and obtain the real-time online personnel corresponding to different clarity. Then select the clarity corresponding to the largest number of real-time online personnel for analysis, record the corresponding clarity as the target clarity, and at the same time obtain whether there is an image difference in the live images within the time period t corresponding to the target clarity;

[0037] When there are differences in the live images, the live images with differences are selected and marked as abnormal images. When there are no differences in the live images, a same-period monitoring signal is generated. The generated same-period monitoring signal indicates that when the live images are subsequently monitored, the live images within the same time period t are collected for difference analysis, and then the marked abnormal images are calibrated and analyzed to obtain the difference values ​​corresponding to the abnormal images and the standard parameters corresponding to the difference values. At the same time, the difference values ​​are adjusted and monitored, and an adjustment monitoring signal is generated. The adjustment monitoring signal is then transmitted to the adaptive processing unit.

[0038] The adaptive processing unit obtains the adjustment monitoring signal of the transmitted abnormal image, and performs differential analysis according to the abnormal time points of the abnormal image in different time periods, and the specific differential analysis method is as follows:

[0039] Abnormal images are systematically collected from multiple different time periods. These anomalies may include blur, pixelation, color distortion or other non-standard display problems. Next, the recorded abnormal time points are compared and detailed statistical analysis is performed. The goal of the analysis is to determine whether these time points show any recognizable patterns or regularities. Based on the results of the time point analysis, if the time points at which the abnormal images appear are found to have obvious regularity, such as repeated appearance at certain intervals, an "abnormal regularity signal" is generated. If the time points at which the abnormal images appear have no obvious regularity, an "abnormal irregularity signal" is generated. This situation may indicate a more random or sporadic problem, such as instantaneous network congestion, temporary software failure, etc.

[0040] For the generated abnormal irregular signal, an abnormal image and its corresponding abnormal value are obtained, and a standard value corresponding to the abnormal value is obtained, and then the abnormal value is calibrated to obtain a calibration image, and the calibration image is outputted at the same time;

[0041] When the system detects an abnormal regular signal, it first monitors and records the current packet loss rate at the corresponding time point in real time. This data reflects the rate of network packet loss at the moment when the abnormal image appears. A pre-set standard packet loss rate is introduced as a reference. This standard value is set based on the historical performance data of the network and business requirements. It represents the maximum acceptable packet loss rate of the network under normal operation. The actual monitored current packet loss rate is compared with the standard packet loss rate. This comparison result can directly indicate whether the network transmission quality meets expectations.

[0042] If it is found that the current packet loss rate exceeds the standard packet loss rate, it means that there is an abnormality in the network transmission, which may be the root cause of the image quality problem. At this time, the system will generate a "packet loss adjustment information". If the current packet loss rate is lower than or equal to the standard packet loss rate, it indicates that although the image is abnormal, there is no major problem with the network transmission itself. At this time, the system will generate a "normal packet loss information".

[0043] Embodiment 2

[0044] As the second embodiment of the present invention, it is implemented on the basis of the first embodiment, and is different from the first embodiment in that.

[0045] The adaptive processing unit transmits the generated packet loss adjustment information and packet loss normalization information to the transmission analysis unit, and analyzes the two at the same time.

[0046] The transmission analysis unit analyzes the acquired packet loss adjustment information and packet loss normalization information separately, and the specific analysis method is as follows:

[0047] The specific method of analyzing the normal information of packet loss is as follows: First, the system will collect abnormal images that appear in a specific time period and normal images in the same time period. These images will be used for subsequent analysis and comparison. For all collected images, the system will detect their resolutions, including the resolution of abnormal images and the resolution of normal images. Based on the collected normal image samples, the average resolution of these images is calculated. This average value will be used as a benchmark to evaluate and correct the resolution of abnormal images. The resolution of abnormal images is adjusted using the average resolution calculated previously as a standard.

[0048] For example, the resolution of abnormal images collected within a time period is 1280x720, while the resolution of normal images is 1920x1080. After calculating the resolution of all normal images, the final resolution is 1920x1080. Based on the average resolution, the system increases the resolution of abnormal images from 1280x720 to 1920x1080 to match the clarity of normal images.

[0049] The specific method of analyzing the packet loss adjustment information is as follows: obtaining the current packet loss rate corresponding to the abnormal image, and simultaneously obtaining the packet loss rate of the normal image in the same period, and generating a normal packet loss interval, and then determining whether the current packet loss rate exists in the normal packet loss interval, and if so, generating an existence adjustment signal, and for the generated existence adjustment signal, obtaining the minimum packet loss rate corresponding to the normal packet loss interval, and using it as an adjustment standard to adjust the current packet loss rate, and if not, generating an image optimization signal;

[0050] First, the current packet loss rate when abnormal images appear is accurately collected. At the same time, the packet loss rate when normal images are transmitted is collected in the same period. Based on the collected data, the maximum and minimum packet loss rates when normal images are transmitted are calculated, thereby establishing a "normal packet loss interval". This interval represents the fluctuation range of the packet loss rate under normal conditions of the network.

[0051] The current packet loss rate corresponding to the abnormal image is compared with the normal packet loss range to determine whether the current packet loss rate falls within this normal range. If the current packet loss rate is within the normal packet loss range, the system will generate an "adjustment signal". This means that although there is a certain amount of packet loss, the packet loss rate is still within the acceptable range, but it may still require minor adjustments to ensure the optimal transmission quality. If the current packet loss rate is not within the normal packet loss range, that is, the packet loss is too severe, an "image optimization signal" will be generated.

[0052] For the generated existing adjustment signal, the minimum packet loss rate in the normal packet loss interval is further obtained and set as the adjustment standard. The purpose is to adjust the current packet loss rate to be as close to this minimum value as possible through technical means (such as enhancing signals, optimizing routes, etc.) to improve transmission efficiency.

[0053] After receiving the image optimization signal, the abnormal image data is first analyzed in depth. This signal indicates that the current image quality may be affected by abnormal packet loss rate or other network problems. The abnormal image data is scanned to identify and extract duplicate data. These duplicate data may be caused by transmission errors or coding redundancy, and may have a negative impact on the overall quality of the image.

[0054] At the same time, the data capacity of all normal images transmitted in the same time period is collected and analyzed. The maximum data capacity value is determined from these data and used as the standard for subsequent adjustments. The previously determined maximum data capacity is used as a benchmark to adjust the data capacity of abnormal images. The purpose is to improve the image quality by adjusting the data capacity of abnormal images to be close to the maximum data capacity of normal images. The difference between the current data capacity of abnormal images and the maximum data capacity is calculated. This difference reflects how much data needs to be reduced to achieve the best image quality.

[0055] Duplicate data equivalent to the calculated capacity difference is found in the abnormal image, and the duplicate data identified as to be adjusted is processed, which may include deleting unnecessary duplicate data, re-encoding or replacing it with a more efficient data format to reduce data redundancy and optimize image quality.

[0056] First, a detailed data analysis is performed to determine whether the duplicate data to be adjusted has a substantial impact on the overall quality of the image. This may involve checking whether the data contains key image feature information or is used in other important processing processes; if the analysis results show that the duplicate data to be adjusted has no significant impact on the overall quality and function of the image, it can be directly removed from the data set. This step helps to reduce unnecessary data redundancy and improve data processing efficiency;

[0057] After removing these data, the system will automatically generate a "duplicate data removal signal". This signal indicates that the duplicate data that does not affect the image quality has been successfully removed and is ready for the next step of processing. On the contrary, if the duplicate data to be adjusted does have a significant impact on the image quality, it is very important to process these data separately. For such important duplicate data, the system will generate a "transfer signal".

[0058] The processing result output unit is used to obtain the transmitted duplicate data removal signal and the transmission signal, and transmit them to the execution module, and the execution module performs the corresponding operation.

[0059] Embodiment 3

[0060] As the third embodiment of the present invention, the focus is on combining the implementation processes of the first embodiment and the second embodiment.

[0061] Some of the data in the above formulas are dimensionless and numerically calculated. Meanwhile, the contents not described in detail in this specification belong to the prior art known to those skilled in the art.

[0062] The above embodiments are only used to illustrate the technical method of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical method of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical method of the present invention.

Claims

1. An image information processing system based on e-commerce live broadcast, characterized in that: include: An image information calibration and analysis unit is used to analyze the clarity of multiple sets of live images obtained by online personnel in real time, select the difference images from the multiple sets of live images, monitor the difference values, generate an adjustment monitoring signal, and then transmit the adjustment monitoring signal to the adaptive processing unit; The adaptive processing unit is used to perform regularity analysis on abnormal time points corresponding to abnormal images in different time periods to generate abnormal regular signals and abnormal irregular signals, perform numerical calibration on abnormal images corresponding to abnormal irregular signals and obtain calibration images, analyze the packet loss rate of abnormal images corresponding to abnormal regular signals to generate packet loss adjustment information and packet loss normal information, and transmit the two to the transmission analysis unit; The transmission analysis unit is used to adjust and analyze the normal information of packet loss according to the resolution of the abnormal image, and generate a calibration image. Based on the packet loss adjustment information, the normal packet loss interval is judged for the packet loss rate of the abnormal image, and an adjustment signal and an image optimization signal are generated. At the same time, based on the image optimization signal, the repeated data in the abnormal image is analyzed, and different modes of transmission are performed according to the impact of the repeated data on the whole, and a repeated data removal signal and a transmission signal are generated, and then the generated signal is transmitted to the processing result output unit.

2. The image information processing system based on e-commerce live broadcast according to claim 1 is characterized in that: The specific manner in which the image information calibration and analysis unit analyzes multiple groups of live images is as follows: Obtain multiple groups of live images corresponding to any time period, obtain all the clarity of the live images, and obtain the real-time online personnel corresponding to different clarity, select the clarity corresponding to the largest number of real-time online personnel as the target clarity, and then determine whether there is an image difference in the live images within the time period t corresponding to the target clarity; When there are differences in the live images, the live images with differences are selected and marked as abnormal images. When there are no differences in the live images, a same-period monitoring signal is generated, and then the abnormal images are calibrated and analyzed to obtain the difference values ​​corresponding to the abnormal images and the standard parameters corresponding to the difference values. At the same time, the difference values ​​are adjusted and monitored, and an adjustment monitoring signal is generated.

3. The image information processing system based on e-commerce live broadcast according to claim 1 is characterized in that: The specific manner in which the adaptive processing unit generates abnormal regular signals and abnormal irregular signals is as follows: Acquire multiple groups of abnormal images within a time period, and simultaneously acquire the abnormal time points corresponding to the abnormal images, and then judge the acquired abnormal time points. If the abnormal time points are the same, it indicates that there is a regularity in the generation of the abnormal images, and an abnormal regularity signal is generated. If the abnormal time points are different, it indicates that there is no regularity in the generation of the abnormal images, and an abnormal irregularity signal is generated.

4. The image information processing system based on e-commerce live broadcast according to claim 1 is characterized in that: The specific method in which the adaptive processing unit analyzes the abnormal regular signal and the abnormal irregular signal is as follows: For the generated abnormal irregular signal, an abnormal image and its corresponding abnormal value are obtained, and a standard value corresponding to the abnormal value is obtained, and then the abnormal value is calibrated to obtain a calibration image, and the calibration image is outputted at the same time; For the generated abnormal regular signal, the current packet loss rate and the standard packet loss rate corresponding to the abnormal time point are obtained, and the two are compared. If the current packet loss rate is greater than the standard packet loss rate, it means that the current packet loss rate is abnormal, and packet loss adjustment information is generated. If the current packet loss rate is less than the standard packet loss rate, it means that the current packet loss rate is normal, and normal packet loss information is generated.

5. The image information processing system based on e-commerce live broadcast according to claim 1 is characterized in that: The specific manner in which the transmission analysis unit analyzes the packet loss adjustment information is as follows: The abnormal image corresponding to the normal information of packet loss is obtained, and the resolution of the abnormal image is obtained at the same time. Then, the normal image in the same period as the abnormal image is obtained, and the resolution corresponding to the normal image is obtained, and the average resolution of all normal images is calculated. Then, the resolution of the abnormal image is adjusted based on the calculated resolution average as the standard, and a calibration image is generated at the same time, and the calibration image is transmitted to the processing result output unit.

6. The image information processing system based on e-commerce live broadcast according to claim 1 is characterized in that: The specific manner in which the adaptive processing unit analyzes the packet loss adjustment information is as follows: The current packet loss rate corresponding to the abnormal image is obtained, and the packet loss rate of the normal image in the same period is obtained at the same time, and a normal packet loss interval is generated. Then, it is determined whether the current packet loss rate exists in the normal packet loss interval. If so, an existence adjustment signal is generated. For the generated existence adjustment signal, the minimum packet loss rate corresponding to the normal packet loss interval is obtained, and the minimum packet loss rate is used as the adjustment standard to adjust the current packet loss rate. If it does not exist, an image optimization signal is generated.

7. The image information processing system based on e-commerce live broadcast according to claim 6 is characterized in that: The specific method of analyzing the generated image optimization signal is as follows: The repeated data in the abnormal image is obtained and extracted, and the data capacity corresponding to all normal images is obtained at the same time, and the maximum data capacity among them is obtained, and then the capacity of the abnormal image is adjusted based on the maximum data capacity, and the capacity difference between the abnormal image data capacity and the maximum data capacity is calculated, and the repeated data with the same capacity difference is obtained and recorded as the repeated data to be adjusted; Determine the impact of removing the duplicate data to be adjusted on the whole. When the duplicate data to be adjusted has no impact on the whole, remove it directly and generate a duplicate data removal signal. Conversely, when the duplicate data to be adjusted has an impact on the whole, transmit the duplicate data to be adjusted separately and generate a transmission signal. Then transmit the generated duplicate data removal signal and transmission signal to the processing result output unit.

8. The image information processing system based on e-commerce live broadcast according to claim 1 is characterized in that: It also includes a live image acquisition unit and a processing result output unit; A live image acquisition unit, used for transmitting the acquired live image to the image information calibration and analysis unit; The processing result output unit is used to display the acquired calibration image and transmit the acquired duplicate data removal signal and transmission signal to the execution module for operation execution.

Images