Man-machine interaction data management system

Abstract

The invention relates to a man-machine interaction data management system. The system comprises a screenshot processing device, a content enhancement device, a real-time filtering device, a data sharpening device, a color identification mechanism and a request triggering mechanism. According to the invention, the image data in the man-machine interaction process can be intelligently managed, so that the efficiency of man-machine interaction activities is improved.

Description

Technical Field

[0001] The present invention relates to the field of human-computer interaction, and in particular to a human-computer interaction data management system. Background Art

[0002] Human-computer interaction technology has been developing rapidly recently, and people often encounter related applications in their lives. For example, CN118778831A relates to a human-computer interaction method, including an electronic device, a mouse of HID protocol and a pointer device of non-HID protocol, including the following steps: S1, establishing a serial communication protocol of non-HID protocol, so that the pointer device of non-HID protocol can communicate with the electronic device through serial port; S2, the pointer device of non-HID protocol uses serial port communication to transmit its non-HID protocol data corresponding to the non-HID protocol to the host computer program of the electronic device; S3, establishing a pointer for the pointer device of non-HID protocol on the display of the electronic device and selecting its active window; S4, capturing the movement of the human hand through the pointer device of non-HID protocol, transmitting the instructions of non-HID protocol to the electronic device, and executing the movement and click operation of its corresponding pointer.

[0003] CN118744426A discloses a human-computer interactive assembly method and system based on a multimodal large model and reinforcement learning, comprising the following steps: a data acquisition module acquires assembly environment information and text instructions, wherein the text instructions include text instructions generated by voice instruction conversion and text instructions directly input by a user; a multimodal processing module performs multimodal fusion on the assembly environment information and text instructions to generate multimodal information, and inputs the multimodal information and completed tasks into a visual language large model; the visual language large model outputs a new task based on the multimodal information and the completed tasks, and then divides the new task into a plurality of subtasks; a computer control system uses a control instruction library to extract corresponding instructions according to the subtask sequence, and executes the corresponding instructions in sequence.

[0004] However, the application of human-computer interaction technology goes far beyond this. Summary of the invention

[0005] In order to solve the technical problems in the related fields, the present invention provides a human-computer interaction data management system, which can recognize the image blocks corresponding to the goods sold on the spot in the received data sharpening image based on the reference shape pattern corresponding to the goods sold on the spot, extract the hue component values, brightness component values ​​and saturation component values ​​corresponding to each pixel point in the image blocks corresponding to the goods sold on the spot, and convert the pixel points with hue component values ​​outside the hue component value range corresponding to the goods sold on the spot, the pixel points with brightness component values ​​outside the brightness component value range corresponding to the goods sold on the spot, or the pixel points with saturation component values ​​outside the saturation component value range corresponding to the goods sold on the spot. Pixels outside the range of saturation component values ​​corresponding to the goods sold on the spot are treated as single color abnormality pixels. When the proportion of color abnormality pixels in the image blocks corresponding to the goods sold on the spot exceeds the limit, a color distortion instruction is issued; and when the proportion of color abnormality pixels in the image blocks corresponding to the goods sold on the spot does not exceed the limit, a color authenticity instruction is issued, thereby completing the distortion identification of the on-site color of the goods sold on the spot, and when receiving the color distortion instruction, a color adjustment request is issued, and when receiving the color authenticity instruction, the triggering of the color adjustment request is temporarily suspended, thereby completing the targeted identification of the live broadcast color effect of the set goods on sale.

[0006] According to the present invention, a human-computer interaction data management system is provided, the system comprising: A screenshot processing device is provided in a test terminal of a preset e-commerce company, and is used to perform screenshot processing on a live broadcast scene of the preset e-commerce company to obtain a scene screenshot picture; a content enhancement device, arranged in the test terminal and connected to the screenshot processing device, for performing image SVD enhancement processing on the received image to obtain and output a corresponding content enhanced image; A real-time filtering device, connected to the content enhancement device, configured to perform Gaussian high-pass filtering on the received content enhancement image to obtain and output a corresponding real-time filtered image; A data sharpening device, connected to the real-time filtering device, for performing a spatial differential sharpening process on the received real-time filtered image to obtain and output a corresponding data sharpened image; a color identification mechanism, which is arranged in the test terminal and connected to the data sharpening device, and includes a component extraction unit, a numerical analysis unit and an instruction triggering unit, and the numerical analysis unit is respectively connected to the component extraction unit and the instruction triggering unit, and the color identification mechanism is used to identify the image block corresponding to the on-site sold commodity in the received data sharpened image based on the reference shape pattern corresponding to the on-site sold commodity, extract the hue component values, brightness component values ​​and saturation component values ​​corresponding to each pixel in the image block corresponding to the on-site sold commodity, and take the pixel with the hue component value outside the hue component value range corresponding to the on-site sold commodity, the pixel with the brightness component value outside the brightness component value range corresponding to the on-site sold commodity, or the pixel with the saturation component value outside the saturation component value range corresponding to the on-site sold commodity as a single color abnormal pixel, and issue a color distortion instruction when the occupation ratio of the color abnormal pixel in the image block corresponding to the on-site sold commodity exceeds the limit, and issue a color authenticity instruction when the occupation ratio of the color abnormal pixel in the image block corresponding to the on-site sold commodity does not exceed the limit; The request trigger mechanism is arranged in the test terminal and connected to the color identification mechanism, and is used to issue a color adjustment request when receiving a color distortion instruction, and is also used to suspend the triggering of the color adjustment request when receiving the color authenticity instruction.

[0007] It can be seen that the present invention has at least the following three important inventive features: Firstly: based on the reference shape pattern corresponding to the commodity sold on the spot, the image blocks corresponding to the commodities sold on the spot in the received data sharpening image are identified, and the hue component values, brightness component values ​​and saturation component values ​​corresponding to the pixels in the image blocks corresponding to the commodities sold on the spot are extracted, and the pixels having hue component values ​​outside the hue component value range corresponding to the commodity sold on the spot, the pixels having brightness component values ​​outside the brightness component value range corresponding to the commodity sold on the spot, or the pixels having saturation component values ​​outside the saturation component value range corresponding to the commodity sold on the spot are taken as single color abnormal pixel points, and when the proportion of the color abnormal pixel points in the image blocks corresponding to the commodities sold on the spot exceeds the limit, a color distortion instruction is issued, and when the proportion of the color abnormal pixel points in the image blocks corresponding to the commodities sold on the spot does not exceed the limit, a color authenticity instruction is issued, thereby completing the distortion identification of the on-site color of the commodities sold on the spot; Secondly: a color identification mechanism including a component extraction unit, a numerical analysis unit and an instruction trigger unit is introduced, wherein the numerical analysis unit is connected to the component extraction unit and the instruction trigger unit respectively, so as to provide reliable basic data for the on-site color distortion identification of the goods sold on site; Again: a request trigger mechanism is referenced in the test terminal, which is used to issue a color adjustment request when a color distortion instruction is received, and is also used to suspend the triggering of the color adjustment request when the color authenticity instruction is received, thereby completing the targeted identification of the live broadcast color effect of the set goods on sale. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The embodiments of the present invention will be described below with reference to the accompanying drawings, wherein: Figure 1 Schematic diagram of the internal structure of a human-computer interaction data management system according to implementation A of the present invention.

[0009] Figure 2 Schematic diagram of the internal structure of a human-computer interaction data management system according to implementation B of the present invention.

[0010] Figure 3 Schematic diagram of the internal structure of a human-computer interaction data management system according to implementation scheme C of the present invention. DETAILED DESCRIPTION

[0011] In the field of human-computer interaction applications, the interaction between users and the Internet is currently a field that has received much research. Among them, the online live broadcast platform has not been around for long and there is no official definition. From a narrow perspective, online live broadcast is an emerging form of highly interactive video entertainment. This type of live broadcast usually involves the host using a video recording tool to broadcast his or her own singing, playing games, and other activities on an Internet live broadcast platform. The audience can interact with the host through bullet comments, or give rewards through virtual props.

[0012] Using online live streaming platforms to carry out sales is the main broadcasting method of online live streaming platforms. At this time, it is usually necessary to display the goods to be sold in the live broadcast room. However, due to the reasons of the live broadcast equipment or the live broadcast light, there is a certain color distortion between the overall color of the goods sold on site in the live broadcast picture and the overall color of their entity. This color distortion can only be distinguished by analyzing the picture data through real-time live broadcast pictures on site. However, the existing technology lacks a corresponding high-precision identification mechanism.

[0013] The implementation scheme of the human-computer interaction data management system of the present invention will be described in detail below with reference to the accompanying drawings.

[0014] Figure 1 This is a schematic diagram of the internal structure of a human-computer interaction data management system according to Embodiment A of the present invention, wherein the system comprises: A screenshot processing device is provided in a test terminal of a preset e-commerce company, and is used to perform screenshot processing on a live broadcast scene of the preset e-commerce company to obtain a scene screenshot picture; For example, the screenshot processing device is arranged in the test terminal of the preset e-commerce, and is used to perform screenshot processing on the live broadcast scene of the preset e-commerce to obtain the scene screenshot picture, including: a PAL chip can be selected to implement the screenshot processing device, which is arranged in the test terminal of the preset e-commerce, and is used to perform screenshot processing on the live broadcast scene of the preset e-commerce to obtain the scene screenshot picture; a content enhancement device, arranged in the test terminal and connected to the screenshot processing device, for performing image SVD enhancement processing on the received image to obtain and output a corresponding content enhanced image; A real-time filtering device, connected to the content enhancement device, configured to perform Gaussian high-pass filtering on the received content enhancement image to obtain and output a corresponding real-time filtered image; A data sharpening device, connected to the real-time filtering device, for performing a spatial differential sharpening process on the received real-time filtered image to obtain and output a corresponding data sharpened image; a color identification mechanism, which is arranged in the test terminal and connected to the data sharpening device, and includes a component extraction unit, a numerical analysis unit and an instruction triggering unit, and the numerical analysis unit is respectively connected to the component extraction unit and the instruction triggering unit, and the color identification mechanism is used to identify the image block corresponding to the on-site sold commodity in the received data sharpened image based on the reference shape pattern corresponding to the on-site sold commodity, extract the hue component values, brightness component values ​​and saturation component values ​​corresponding to each pixel in the image block corresponding to the on-site sold commodity, and take the pixel with the hue component value outside the hue component value range corresponding to the on-site sold commodity, the pixel with the brightness component value outside the brightness component value range corresponding to the on-site sold commodity, or the pixel with the saturation component value outside the saturation component value range corresponding to the on-site sold commodity as a single color abnormal pixel, and issue a color distortion instruction when the occupation ratio of the color abnormal pixel in the image block corresponding to the on-site sold commodity exceeds the limit, and issue a color authenticity instruction when the occupation ratio of the color abnormal pixel in the image block corresponding to the on-site sold commodity does not exceed the limit; A request trigger mechanism, arranged in the test terminal and connected to the color identification mechanism, for issuing a color adjustment request when receiving a color distortion instruction, and for temporarily suspending the triggering of the color adjustment request when receiving the color authenticity instruction; Among them, the color identification mechanism has a built-in storage unit for storing the saturation component value range corresponding to the goods sold on site, the hue component value range corresponding to the goods sold on site, the brightness component value range corresponding to the goods sold on site, and the reference shape pattern corresponding to the goods sold on site.

[0015] Figure 2 Schematic diagram of the internal structure of a human-computer interaction data management system according to implementation B of the present invention.

[0016] Compared with implementation scheme A, the human-computer interaction data management system shown in implementation scheme B may also include the following components: An ASIC processing device, connected to the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism, respectively, for providing configuration operations of working parameters for the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism in a time-sharing manner; The ASIC processing device is respectively connected to the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism, and is used to provide the configuration operation of working parameters for the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism in a time-sharing manner, including: the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism share the same working parameter configuration interface; Wherein, the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism use different configuration address data; Wherein, a parallel connection of a communication data link is established between each of the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism through a parallel data bus; Among them, the parallel connection of the communication data link established between each of the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism through a parallel data bus includes: the parallel data bus is one of an 8-bit parallel data bus, a 16-bit parallel data bus and a 32-bit parallel data bus.

[0017] Figure 3 Schematic diagram of the internal structure of a human-computer interaction data management system according to implementation scheme C of the present invention.

[0018] Compared with implementation scheme A, the human-computer interaction data management system shown in implementation scheme C may also include the following components: A power support device, connected to the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism, respectively, for providing power distribution support of different working voltages for the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism in a time-sharing manner; The power support device is respectively connected to the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism, and is used to provide power distribution support with different working voltages for the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism in a time-sharing manner, including: two or more devices with the same working voltage requirements among the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism use the same power supply line; Wherein, the power support device is respectively connected to the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism, and is used to provide power distribution support with different working voltages for the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism in a time-sharing manner, and further includes: the power support device is an uninterruptible power supply device; Wherein, the power support device is respectively connected to the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism, and is used to provide power distribution support with different working voltages for the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism in a time-sharing manner, and further comprises: providing different working voltages including 3.3V working voltage for the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism in a time-sharing manner; And wherein, the power support device is respectively connected to the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism, and is used to provide power distribution support with different working voltages for the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism in a time-sharing manner, and also includes: providing different working voltages including a 5V working voltage for the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism in a time-sharing manner.

[0019] In addition, in the human-computer interaction data management system, the color identification mechanism has a built-in storage unit for storing the saturation component value range corresponding to the on-site sold goods, the hue component value range corresponding to the on-site sold goods, the brightness component value range corresponding to the on-site sold goods, and the reference shape pattern corresponding to the on-site sold goods, including: the storage unit is a TF storage chip, an SD storage chip or a FLASH flash memory; And wherein, the color identification mechanism has a built-in storage unit for storing the saturation component value range corresponding to the goods sold on site, the hue component value range corresponding to the goods sold on site, the brightness component value range corresponding to the goods sold on site, and the reference shape pattern corresponding to the goods sold on site also includes: the values ​​of any of the saturation component value range corresponding to the goods sold on site, the hue component value range corresponding to the goods sold on site, and the brightness component value range corresponding to the goods sold on site are all between 0-255.

[0020] The human-computer interaction data management system of the present invention can solve the technical problem in the prior art that it is difficult to accurately identify whether the live broadcast color effect of the goods on sale is distorted. It can identify each abnormal color pixel based on the image content of the goods on sale, and when the proportion of the abnormal color pixels in the image blocks corresponding to the goods on sale exceeds the limit, a color distortion instruction is issued and a color adjustment request is triggered, thereby completing the targeted identification of the live broadcast color effect of the set goods on sale.

[0021] Although some embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the claims and their equivalents.

Claims

1. A human-computer interaction data management system, characterized in that: The system comprises: A screenshot processing device is provided in a test terminal of a preset e-commerce company, and is used to perform screenshot processing on a live broadcast scene of the preset e-commerce company to obtain a scene screenshot picture; a content enhancement device, arranged in the test terminal and connected to the screenshot processing device, for performing image SVD enhancement processing on the received image to obtain and output a corresponding content enhanced image; A real-time filtering device, connected to the content enhancement device, configured to perform Gaussian high-pass filtering on the received content enhancement image to obtain and output a corresponding real-time filtered image; A data sharpening device, connected to the real-time filtering device, for performing a spatial differential sharpening process on the received real-time filtered image to obtain and output a corresponding data sharpened image; a color identification mechanism, which is arranged in the test terminal and connected to the data sharpening device, and includes a component extraction unit, a numerical analysis unit and an instruction triggering unit, and the numerical analysis unit is respectively connected to the component extraction unit and the instruction triggering unit, and the color identification mechanism is used to identify the image block corresponding to the on-site sold commodity in the received data sharpened image based on the reference shape pattern corresponding to the on-site sold commodity, extract the hue component values, brightness component values ​​and saturation component values ​​corresponding to each pixel in the image block corresponding to the on-site sold commodity, and take the pixel with the hue component value outside the hue component value range corresponding to the on-site sold commodity, the pixel with the brightness component value outside the brightness component value range corresponding to the on-site sold commodity, or the pixel with the saturation component value outside the saturation component value range corresponding to the on-site sold commodity as a single color abnormal pixel, and issue a color distortion instruction when the occupation ratio of the color abnormal pixel in the image block corresponding to the on-site sold commodity exceeds the limit, and issue a color authenticity instruction when the occupation ratio of the color abnormal pixel in the image block corresponding to the on-site sold commodity does not exceed the limit; The request trigger mechanism is arranged in the test terminal and connected to the color identification mechanism, and is used to issue a color adjustment request when receiving a color distortion instruction, and is also used to suspend the triggering of the color adjustment request when receiving the color authenticity instruction.

2. The human-computer interaction data management system according to claim 1, characterized in that: The color identification mechanism has a built-in storage unit for storing a saturation component value range corresponding to the goods sold on site, a hue component value range corresponding to the goods sold on site, a brightness component value range corresponding to the goods sold on site, and a reference shape pattern corresponding to the goods sold on site.

3. The human-computer interaction data management system according to claim 2, characterized in that: The system further comprises: An ASIC processing device, connected to the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism, respectively, for providing configuration operations of working parameters for the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism in a time-sharing manner; Among them, the ASIC processing device is respectively connected to the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism, and is used to provide the configuration operation of working parameters for the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism in a time-sharing manner, including: the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism share the same working parameter configuration interface.

4. The human-computer interaction data management system according to claim 3, characterized in that: The content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism use different configuration address data.

5. The human-computer interaction data management system according to claim 3, characterized in that: Establishing parallel connections of communication data links between the content enhancement device, the real-time filtering device, the data sharpening device, and the color identification mechanism through parallel data buses; Among them, the parallel connection of the communication data link established between each of the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism through a parallel data bus includes: the parallel data bus is one of an 8-bit parallel data bus, a 16-bit parallel data bus and a 32-bit parallel data bus.

6. The human-computer interaction data management system according to claim 2, characterized in that: The system further comprises: A power support device, connected to the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism, respectively, for providing power distribution support of different working voltages for the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism in a time-sharing manner; Among them, the power support device is respectively connected to the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism, and is used to provide power distribution support with different working voltages for the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism in a time-sharing manner, including: among the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism, two or more devices with the same working voltage requirements use the same power supply line.

7. The human-computer interaction data management system according to claim 6, characterized in that: The power support device is respectively connected to the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism, and is used to provide power distribution support with different working voltages for the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism in a time-sharing manner, and also includes: the power support device is an uninterruptible power supply device.

8. The human-computer interaction data management system according to claim 7, characterized in that: The power support device is respectively connected to the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism, and is used to provide power distribution support with different working voltages for the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism in a time-sharing manner, and also includes: providing different working voltages including a 3.3V working voltage for the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism in a time-sharing manner.

9. The human-computer interaction data management system according to claim 8, characterized in that: The power support device is respectively connected to the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism, and is used to provide power distribution support with different working voltages for the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism in a time-sharing manner, and also includes: providing different working voltages including a 5V working voltage for the content enhancement device, the real-time filtering device, the data sharpening device and the color identification mechanism in a time-sharing manner.

Images