Image processing method, device and system, and electronic equipment
Through the combination of the seat computer system and the large-screen system, the encoding and decoding functions of the control module and the image acquisition end are used to realize the reverse control of the large-screen device, solving the problem that the large-screen device cannot achieve reverse control, and improving user operations Convenience and precision.
Patent Information
- Application Number
- CN202010904652.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-09-01
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2040-09-01
AI Technical Summary
Due to the large-screen device, it is impossible to achieve reverse control function, which makes it inconvenient for users to operate.
Through the combination of the seat computer system and the large-screen system, the control module in the seat computer system issues display instructions and adjustment instructions, and the image acquisition end is controlled for encoding and decoding, so as to realize reverse control of the large-screen system.
The reverse control of the large-screen system is realized, the convenience of user operation and control accuracy are improved, and the problem that large-screen devices cannot achieve reverse control.
Smart Images

Figure CN112035082B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of image processing technology, and in particular to an image processing method, device and system, and electronic equipment. Background Art
[0002] In the related art, the large screen system includes an image source device, a management server and a large screen device, and the large screen device is composed of multiple screens. The acquisition end (referred to as the S end) in the image source device sends the collected desktop image data of the image source device to the management server, and the management server processes the received desktop image according to the preset large screen display mode, and then sends the processed desktop image data to the large screen device, which is decoded by the large screen device and displayed on each screen. Figure 1 is a schematic diagram of an optional large screen system in the prior art, such as Figure 1 As shown, the large-screen system includes an image source device, a management server and a large-screen device. The large-screen device includes 9 screens, and the arrows represent the transmission links of the image data.
[0003] However, due to the large size of large-screen devices, it is not convenient for users to operate. Therefore, the large-screen system can only be used to display images and cannot achieve reverse control functions.
[0004] To address the above-mentioned problems, no effective solution has been proposed yet. Summary of the invention
[0005] The embodiments of the present invention provide an image processing method, device and system, and electronic device to at least solve the technical problem in the related art that large-screen devices cannot realize the reverse control function.
[0006] According to one aspect of an embodiment of the present invention, there is provided an image processing method, comprising: receiving a first display instruction issued by a seat machine system, wherein the first display instruction comprises at least: image display parameters; obtaining image coding data, wherein the image coding data is coding data of desktop image data of an image source device; decoding the image coding data to obtain a desktop image; and displaying the desktop image on a target area based on the image display parameters, wherein the target area is located on a target screen device of a large-screen system.
[0007] Optionally, before receiving the first display instruction issued by the seat machine system, the image processing method also includes: controlling the image acquisition end to establish a connection with a thumbnail processing module after receiving a connection request, wherein the thumbnail processing module is arranged in the seat machine system; controlling the image acquisition end to encode the collected desktop image data to generate image coding data; controlling the image acquisition end to generate thumbnail data according to the image coding data, and sending the thumbnail data to the thumbnail processing module.
[0008] Optionally, after sending the thumbnail data to the thumbnail processing module, the image processing method further includes: controlling the thumbnail processing module to generate a thumbnail according to the received thumbnail data; controlling the thumbnail processing module to display the thumbnail on a control screen, wherein the control screen is arranged in a seat machine system.
[0009] Optionally, the step of acquiring the image encoding data includes: sending a data acquisition request to the image acquisition end, wherein the data acquisition request carries a device identification of an image source device; and receiving the image encoding data sent by the image acquisition end.
[0010] Optionally, after displaying the desktop image on the target area screen, the image processing method further includes: receiving a first adjustment instruction, wherein the first adjustment instruction includes at least: adjustment parameters of the desktop image; and adjusting image display parameters of the desktop image displayed on the target area screen based on the adjustment parameters of the desktop image.
[0011] Optionally, after displaying the desktop image on the target area screen, the image processing method further includes: receiving a second display instruction; establishing a network connection with an image acquisition end based on the second display instruction; sending an image acquisition request to the image acquisition end, wherein the image acquisition request carries an image identifier; receiving image coding data sent by the image acquisition end; sending the image coding data to an image receiving end corresponding to the window to be displayed in the seat machine system, wherein the image receiving end decodes the image coding data to obtain a desktop image, and displays the desktop image on the window to be displayed.
[0012] According to another aspect of an embodiment of the present invention, an image processing system is also provided, including: a seat machine system, at least including: a first control module, used to reversely control the large-screen system and the image acquisition end; the image acquisition end, at least including: an image source device, used to acquire desktop images; the large-screen system, at least including: a management server and a large-screen device, wherein the second control module in the management server executes any one of the above-mentioned image processing methods.
[0013] Optionally, the seat machine system further includes: a thumbnail module and a control screen, wherein the thumbnail module is used to zoom in and out the displayed image, and the control screen is used to control the large screen system to adjust the displayed image.
[0014] According to another aspect of an embodiment of the present invention, an image processing device is also provided, including: a receiving unit, used to receive a first display instruction issued by a seat machine system, wherein the first display instruction includes at least: image display parameters; an acquisition unit, used to acquire image coding data, wherein the image coding data is coding data of desktop image data of an image source device; a decoding unit, used to decode the image coding data to obtain a desktop image; and a display unit, used to display the desktop image on a target area based on the image display parameters, wherein the target area is located on a target screen device of a large screen system.
[0015] Optionally, the image processing device also includes: a first control unit, used to control the image acquisition end to establish a connection with the thumbnail processing module after receiving a connection request before receiving the first display instruction issued by the seat machine system, wherein the thumbnail processing module is arranged in the seat machine system; a second control unit, used to control the image acquisition end to encode the collected desktop image data to generate image coding data; a third control unit, used to control the image acquisition end to generate thumbnail data according to the image coding data, and send the thumbnail data to the thumbnail processing module.
[0016] Optionally, the image processing device also includes: a fourth control unit, used to control the thumbnail processing module to generate a thumbnail based on the received thumbnail data after sending the thumbnail data to the thumbnail processing module; a fifth control unit, used to control the thumbnail processing module to display the thumbnail on a control screen, wherein the control screen is set in the seat machine system.
[0017] Optionally, the acquisition unit includes: a first sending module, used to send a data acquisition request to the image acquisition end, wherein the data acquisition request carries a device identification of an image source device; and a first receiving module, used to receive image encoding data sent by the image acquisition end.
[0018] Optionally, the image processing device also includes: a second receiving module, used to receive a first adjustment instruction after displaying the desktop image on the target area screen, wherein the first adjustment instruction at least includes: adjustment parameters of the desktop image; a first adjustment module, used to adjust image display parameters of the desktop image displayed on the target area screen based on the adjustment parameters of the desktop image.
[0019] Optionally, the image processing device also includes: a sixth control unit, used to receive a second display instruction after displaying the desktop image on the target area screen; a seventh control unit, used to establish a network connection with the image acquisition end based on the second display instruction; an eighth control unit, used to send an image acquisition request to the image acquisition end, wherein the image acquisition request carries an image identifier; a ninth control unit, used to receive image coding data sent by the image acquisition end; and a tenth control unit, used to send the image coding data to an image receiving end corresponding to the window to be displayed in the seat machine system, wherein the image receiving end decodes the image coding data to obtain a desktop image, and displays the desktop image on the window to be displayed.
[0020] According to another aspect of an embodiment of the present invention, there is further provided an electronic device, comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute any one of the above-mentioned image processing methods by executing the executable instructions.
[0021] According to another aspect of an embodiment of the present invention, a computer-readable storage medium is further provided, wherein the computer-readable storage medium includes a stored computer program, wherein when the computer program is executed, the device where the computer-readable storage medium is located is controlled to execute any one of the above-mentioned image processing methods.
[0022] In an embodiment of the present invention, a first display instruction sent by a seat machine system is received, wherein the first display instruction includes at least: image display parameters; obtaining image coding data, wherein the image coding data is coding data of desktop image data of an image source device; decoding the image coding data to obtain a desktop image; and displaying the desktop image on a target area based on the image display parameters, wherein the target area is located on a target screen device of a large-screen system. In this embodiment, the large-screen system and the seat machine system are combined, and the display window parameters in the seat machine system are convenient for user operation. The user can send a reverse control instruction to the image source device through the seat machine system. After the image source device executes the reverse control instruction, the desktop image changes, and the image in the large-screen system also changes. In this way, the reverse control of the large-screen system can be achieved through the seat machine system, thereby solving the technical problem in the related art that the large-screen device cannot achieve the reverse control function. BRIEF DESCRIPTION OF THE DRAWINGS
[0023] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:
[0024] Figure 1It is a schematic diagram of an optional large-screen system in the prior art;
[0025] Figure 2 is a flow chart of an optional image processing method according to an embodiment of the present invention;
[0026] Figure 3 is a schematic diagram of an optional image processing system according to an embodiment of the present invention;
[0027] Figure 4 A schematic diagram of an optional image processing device according to an embodiment of the present invention. DETAILED DESCRIPTION
[0028] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.
[0029] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0030] According to an embodiment of the present invention, an image processing method embodiment is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.
[0031] The image processing method provided by the embodiment of the present invention can set a first control module in the seat machine system, and issue a first display instruction through the first control module, wherein the first control module establishes a connection with the second control module in advance, and the second control module is set in the management server of the large-screen system.
[0032] Figure 2is a flowchart of an optional image processing method according to an embodiment of the present invention. Figure 2 As shown, the method comprises the following steps:
[0033] Step S202, receiving a first display instruction sent by the seat machine system, wherein the first display instruction at least includes: image display parameters;
[0034] Step S204, obtaining image coding data, wherein the image coding data is coding data of desktop image data of the image source device;
[0035] Step S206, decoding the image encoding data to obtain a desktop image;
[0036] Step S208: displaying the desktop image on the target area based on the image display parameters, wherein the target area is located on the target screen device of the large screen system.
[0037] Through the above steps, the first display instruction issued by the seat machine system can be received, wherein the first display instruction at least includes: image display parameters; obtaining image coding data, wherein the image coding data is the coding data of the desktop image data of the image source device; decoding the image coding data to obtain the desktop image; based on the image display parameters, the desktop image is displayed on the target area, wherein the target area is located on the target screen device of the large screen system. In this embodiment, the large screen system and the seat machine system are combined, and the display window parameters in the seat machine system are convenient for user operation. The user can issue a reverse control instruction to the image source device through the seat machine system. After the image source device executes the reverse control instruction, the desktop image changes, and the image in the large screen system also changes. In this way, the reverse control of the large screen system can be achieved through the seat machine system, thereby solving the technical problem that the large screen device cannot achieve the reverse control function in the related technology.
[0038] The image processing method provided by the embodiment of the present invention can be applied to a large-screen control system, and the large-screen control system is connected to the seat machine system. Among them, the large-screen control system may include: an image source device and a large-screen device, wherein the image source device is connected to the large-screen device through an acquisition terminal (referred to as the S terminal), and a management server and multiple display receiving terminals (referred to as the R terminal) are provided in the large-screen device, and the management server may be provided with a second control module and multiple display receiving terminals; and the seat machine system may include but is not limited to: a thumbnail processing module, a first control module, an input device (for example, a mouse, a keyboard), multiple display receiving terminals, and a control screen, wherein the control screen may display thumbnails. The first control module is connected to the second control module, and the first control module is connected to the thumbnail processing module, and the thumbnail processing module may be connected to the image source device. The image source device may be connected to the display receiving terminal in the seat machine system and the display receiving terminal in the management server, respectively.
[0039] The embodiment of the present invention takes the second control module of the management server as the main body of the implementation steps.
[0040] It should be noted that the seat machine system can be a PC, laptop or other device with multiple small screens, which has a reverse control function. Large-screen devices are devices composed of multiple screens. Large-screen devices are usually large in size and inconvenient to operate, so they are usually only used for display and do not have a reverse control function.
[0041] The control screen of the seat machine system can display thumbnails of the desktop images of each image source device, as well as the virtual display screens of the seat machine and the large-screen device. The user can set the desktop image of the image source device represented by the thumbnail according to the thumbnail in the control screen and the virtual display icons of the seat machine and the large-screen, and the display mode in the seat machine and the large-screen. For example, the thumbnail can be dragged to the virtual display icon of the seat machine and the large-screen, and the desktop image of the image source device represented by the thumbnail can be set using a menu or the like.
[0042] The general application scenarios are:
[0043] a. Display multiple image sources on a large-screen device. If you notice that a certain image source needs to be operated, drag the thumbnail to the virtual screen of the seat machine with the mouse. The image source will be displayed on the seat machine display. At this time, there is a reverse control function, and the user can use the keyboard and mouse to operate.
[0044] b. Use the mouse to operate the image source on the seat machine. For example, when you need to have a group discussion at work, you can drag the image source to the virtual display screen of the large screen and explain while operating.
[0045] After the reverse control operation is performed on the image source device through the input device (keyboard, mouse, touch screen, etc.) in the seat machine system, the R end of the seat machine system generates a reverse control instruction based on the obtained reverse control operation, and sends the reverse control instruction to the image source device. After the image source device executes the reverse control instruction, the desktop image of the image source device will change, and then the images displayed on the seat machine and the large-screen device will also change. In this way, reverse control based on the large-screen system can be realized.
[0046] If a reverse control function is added to a large-screen device, it is difficult for a user to operate it with a keyboard and mouse or a touch screen due to the large size of the large-screen device, and it is difficult to achieve precise control. The solution of the present invention is more convenient for users to operate, and the control result is also more precise.
[0047] The above steps are described in detail below in conjunction with the above large-screen control system.
[0048] Optionally, before receiving the first display instruction issued by the seat machine system, the image processing method also includes: controlling the image acquisition end to establish a connection with the thumbnail processing module after receiving a connection request, wherein the thumbnail processing module is arranged in the seat machine system; controlling the image acquisition end to encode the collected desktop image data to generate image coding data; controlling the image acquisition end to generate thumbnail data according to the image coding data, and sending the thumbnail data to the thumbnail processing module.
[0049] The image acquisition end (hereinafter referred to as the acquisition end) encodes the collected desktop image data to generate encoded data; after receiving the connection request sent by the thumbnail processing module, the image acquisition end establishes a connection with the thumbnail processing module; the image acquisition end generates thumbnail data based on the encoded data, and sends the thumbnail data to the thumbnail processing module through the connection.
[0050] In this step, the image acquisition end acquires the desktop image data of each image source device, and encodes the desktop image data to generate encoded data. The image acquisition end receives the connection request sent by the thumbnail processing module, and then establishes a connection with the thumbnail processing module. The image acquisition end intercepts part of the encoded data from the encoded data, generates thumbnail data, and sends the thumbnail data to the thumbnail processing module through the established connection. The thumbnail data can be the encoded data of 1 frame obtained from the encoded data as the thumbnail data, or the encoded data corresponding to the image data of N seconds continuously intercepted from the encoded data as the thumbnail data.
[0051] It should be noted that the image acquisition end can be built into the image source device or can be external to the image source device. The image source device can be a PC, a notebook, a tablet, a camera, etc. The image acquisition end can acquire desktop image data of the image source device and encode the acquired desktop image data.
[0052] There is no specific limitation on the image type and image color collected by the image acquisition end. For example, the desktop images of the two image source devices are green images and yellow images respectively. The image acquisition end encodes the collected green image data and yellow image data respectively to generate encoded data; obtains 5 seconds of continuous encoded data from the encoded data and sends it to the thumbnail processing module.
[0053] Alternatively, after sending the thumbnail data to the thumbnail processing module, the image processing method further includes: controlling the thumbnail processing module to generate thumbnails according to the received thumbnail data; controlling the thumbnail processing module to display the thumbnails on a control screen, wherein the control screen is arranged in a seat machine system.
[0054] It should be noted that the thumbnail processing module is connected to a control screen, and at least one display device among the multiple display devices connected to the seat machine system can be used as a control screen, which can be determined according to actual conditions.
[0055] In this step, after receiving the thumbnail data sent by the image acquisition end, the thumbnail processing module decodes the thumbnail data to obtain a thumbnail of the desktop image, one desktop image data corresponds to one thumbnail; and each thumbnail is displayed on the control screen. For example, the thumbnail can be displayed in a blank part of the control screen, and the green line with an arrow in the figure indicates the transmission direction of the thumbnail data.
[0056] The first control module obtains a first display instruction (the first display instruction is used to display the desktop image on the large-screen device), and sends the first display instruction to the second control module of the management server in the large-screen system. Specifically, the first display instruction may include a device identifier (e.g., device ID) of an image source device corresponding to the desktop image to be displayed in the large-screen system, and image display parameters such as a display position and image size of the desktop image to be displayed in the large-screen system.
[0057] Step S202: receiving a first display instruction sent by the seat machine system, wherein the first display instruction at least includes: image display parameters.
[0058] After receiving the first display instruction, the second control module of the management server sends a request for establishing a connection to the image acquisition terminal; after receiving the request for establishing a connection, the image acquisition terminal establishes a connection with the second control module.
[0059] Step S204, obtaining image coding data, wherein the image coding data is coding data of desktop image data of the image source device.
[0060] Optionally, the step of acquiring the image encoding data includes: sending a data acquisition request to the image acquisition end, wherein the data acquisition request carries a device identification of the image source device; and receiving the image encoding data sent by the image acquisition end.
[0061] The second control module sends a request for obtaining image data to the image acquisition end, wherein the request for obtaining image data carries the device identification of the image source device of the image source device. After receiving the request for obtaining image data, the image acquisition end sends the encoded data of the desktop image data corresponding to the device identification of the image source device to the second control module.
[0062] In this step, after receiving the first display instruction from the first control module, the second control module indicates that the user wants to display the desktop image of the image source device in the large screen system. The second control module can send a request to establish a connection to the image acquisition end, and the image acquisition end allows the connection to be established with the second control module after receiving the request to establish a connection.
[0063] Step S206, decoding the image encoding data to obtain a desktop image.
[0064] Step S208: displaying the desktop image on the target area based on the image display parameters, wherein the target area is located on the target screen device of the large screen system.
[0065] The second control module determines the R' end corresponding to the screen to which the image display position belongs in the large-screen system based on the image display parameters, and forwards the encoded data, as well as the display position and image size included in the display instruction 1, to the determined R' end; after receiving the encoded data, the R' end decodes to obtain the desktop image, and displays the desktop image in the corresponding target area according to the display position and image size.
[0066] After the desktop image is displayed on the target area, an adjustment parameter may be received to adjust the displayed desktop image. In the embodiment of the present invention, when adjusting the desktop image, two methods are included:
[0067] The first is to adjust the image display parameters of the desktop image on the large-screen device.
[0068] Optionally, after displaying the desktop image on the target area screen, the image processing method also includes: receiving a first adjustment instruction, wherein the first adjustment instruction includes at least: adjustment parameters of the desktop image; and adjusting image display parameters of the desktop image displayed on the target area screen based on the adjustment parameters of the desktop image.
[0069] For example, a first control module obtains a first adjustment instruction issued by a user, wherein the first adjustment instruction is used to adjust the display position and image size of the desktop image on the screen of the large-screen system, and sends the first adjustment instruction to a second control module of a management server in the large-screen system; the second control module adjusts the image on the screen according to the first adjustment instruction.
[0070] In this embodiment, the first adjustment instruction may be an adjustment instruction issued through an input device (the input device is connected to the first control module) after the user sees the desktop image of each image source on the screen of the large-screen system. The first adjustment instruction may include displacement information and scaling information; the second control module adjusts the image on the screen according to the first adjustment instruction, including scaling the image size and adjusting the image position.
[0071] The second method is to adjust the image displayed in the display window of the seat machine system and the image in the large-screen device at the same time.
[0072] Alternatively, after displaying the desktop image on the target area screen, the image processing method further includes: controlling the first control module to receive a second display instruction; controlling the first control module to establish a network connection with the image acquisition end based on the second display instruction; controlling the first control module to send an image acquisition request to the image acquisition end, wherein the image acquisition request carries an image identifier; controlling the first control module to receive image coding data sent by the image acquisition end; controlling the first control module to send the image coding data to the image receiving end corresponding to the window to be displayed in the seat machine system, wherein the image receiving end decodes the image coding data to obtain the desktop image, and displays the desktop image on the window to be displayed.
[0073] The first control module obtains a second display instruction, and the second display instruction is used to display the desktop image in the display window of the seat machine system. In this embodiment, after the user sees the thumbnails of the desktop images of each image source on the control screen, the second display instruction can be issued through the input device (the input device is connected to the first control module), and the second display instruction is used to display the desktop image in the display window of the seat machine system.
[0074] Specifically, the second display instruction may include the device identifier of the image source device corresponding to the desktop image to be displayed in the seat machine system, and the window identifier (for example, window ID) of the display window to be displayed of the desktop image in the seat machine system, and the device identifier of the image source device corresponds to the window identifier of the display window.
[0075] It should be noted that one screen can display one display window or multiple display windows. The display mode of the display window on the screen is relatively flexible and can be set according to user needs.
[0076] After acquiring the second display instruction, the first control module sends a request for establishing a connection to the image acquisition end. After receiving the request for establishing a connection, the image acquisition end establishes a connection with the first control module.
[0077] The first control module sends a request for obtaining image data to the image acquisition end, wherein the request for obtaining image data carries the device identification of the image source device of the image source device; after receiving the request for obtaining image data, the image acquisition end sends the encoded data of the desktop image data corresponding to the device identification of the image source device to the first control module.
[0078] The first control module forwards the encoded data to the receiving end corresponding to the window identifier of the display window where the desktop image is to be displayed in the seat machine system; after receiving the encoded data, the receiving end decodes to obtain the desktop image and displays the desktop image on the corresponding display window.
[0079] Optionally, the receiving end in the seat machine system obtains the reverse control instruction and sends the reverse control instruction to the image source device, and the reverse control instruction carries the device identification of the image source device.
[0080] In this embodiment, after the user sees the desktop image of the image source on the seat machine, the image source device can be reversely controlled. The user can operate through the input device (keyboard, mouse, touch screen, connected to the receiving end) in the seat machine system, the input device generates an operation event, and the receiving end in the seat machine system generates a reverse control instruction according to the operation event; and sends the reverse control instruction to the image source device.
[0081] It should be noted that the seat machine system can determine the image source device corresponding to the reverse control instruction according to the source of the desktop image displayed in the display window corresponding to the operation event, and carry the device identifier of the image source device in the reverse control instruction.
[0082] The optional image source device determines the target image source device corresponding to the device identifier of the image source device according to the received reverse control instruction, and the target image source device executes the reverse control action in the reverse control instruction.
[0083] In the present invention, the image source device can determine the target image source device targeted by the reverse control instruction according to the device identification of the image source device carried in the reverse control instruction, and then the target image source device executes the reverse control action in the reverse control instruction.
[0084] In a specific implementation, after the user has finished using the system, the user can send a reverse control instruction to disconnect the second control module through the input device (the input device is connected to the receiving end). After receiving the reverse control instruction to disconnect the image acquisition end, the image acquisition end interrupts the connection with the receiving end. The seat machine system and the large screen system no longer receive the encoded data sent by the image acquisition end. However, at this time, the control screen in the seat machine system still displays thumbnails. When the user needs to exit the seat machine system, the user can interrupt the connection between the thumbnail processing module and the receiving end through the input device (connected to the first control module). At this time, the control screen no longer displays thumbnails, and the seat machine system is shut down.
[0085] It should be noted that the present invention is suitable for customers who have already installed a large-screen system and a seat machine system. By making improvements according to the method described in the present invention, the large-screen system and the seat machine system are combined to achieve the purpose of users reversely controlling the image in the large-screen system through the seat machine system without any additional expenses.
[0086] In addition, the display images of the large screen and seat machine system of the present invention can be displayed separately (the large screen and the seat machine do not display the desktop image of the same image source) or shared (the large screen and the seat machine display the desktop image of the same image source), which is very flexible to use.
[0087] According to another aspect of an embodiment of the present invention, an image processing system is also provided, including: a seat machine system, at least including: a first control module, used to reversely control the large-screen system and the image acquisition end; the image acquisition end, at least including: an image source device, used to acquire desktop images; the large-screen system, at least including: a management server and a large-screen device, wherein the second control module in the management server executes any one of the above-mentioned image processing methods.
[0088] Optionally, the seat machine system also includes: a thumbnail module and a control screen, wherein the thumbnail module is used to zoom in and out the displayed image, and the control screen is used to control the large-screen system to adjust the displayed image.
[0089] Figure 3 is a schematic diagram of an optional image processing system according to an embodiment of the present invention. Figure 3 As shown, the image processing system includes an image source device, an image acquisition terminal, a large screen system and a seat machine system.
[0090] The seat machine system includes: thumbnail processing module, first control module, keyboard and mouse (i.e. external control devices such as keyboard and mouse), control screen (zoom display thumbnails), display R1, display R2; image source device includes: image acquisition terminal; large screen system includes: management server and large screen device.
[0091] The control screen of the seat machine system can display thumbnails of the desktop images of each image source device, and can also display thumbnails of the current images of the large-screen device. It can be a virtual control screen. Figure 3 The two rectangular boxes in the upper left corner of the middle control screen are shown, and the virtual display icons on the large screen are as follows: Figure 3As shown in the multi-grid rectangular box in the upper right corner of the control screen (9-grid). Users can set the display mode of the desktop image of the image source device represented by the thumbnail in the seat machine and the large screen according to the thumbnails in the control screen and the virtual display icons of the seat machine and the large screen. For example, the thumbnail can be dragged to the virtual display icon of the seat machine and the large screen. For example, the desktop image of the image source device represented by the thumbnail can be set in the form of a menu, etc. Figure 3 As shown, Figure 3 The control screen can display the display decoding of the seat machine system and the thumbnail status of the display image of the large-screen device. It can be understood that the user wants to display the two desktop images of the image source on the screen of the seat machine and the large-screen device at the same time.
[0092] When the user performs a reverse control operation on the image source device through the input device (keyboard, mouse, touch screen, etc.) in the seat machine system, the R end in the seat machine system generates a reverse control instruction based on the obtained reverse control operation, and sends the reverse control instruction to the image source device. After the image source device executes the reverse control instruction, the desktop image of the image source device will change, and then the images displayed on the seat machine and the large-screen device will also change. In this way, reverse control based on the large-screen system can be achieved.
[0093] refer to Figure 3 , the image processing flow is as follows:
[0094] Step 1, the S end (image acquisition end) encodes the collected desktop image data to generate encoded data; after receiving the connection request sent by the thumbnail processing module, the S end establishes a connection with the thumbnail processing module; the S end generates thumbnail data based on the encoded data, and sends the thumbnail data to the thumbnail processing module through the connection.
[0095] In this step, the S end collects the desktop image data of each image source device, encodes the desktop image data, and generates encoded data. The S end receives the connection request sent by the thumbnail processing module, and then establishes a connection with the thumbnail processing module. The S end intercepts part of the encoded data from the encoded data, generates thumbnail data, and sends the thumbnail data to the thumbnail processing module through the established connection. The thumbnail data can be the encoded data of 1 frame obtained from the encoded data as the thumbnail data, or the encoded data corresponding to the image data of N seconds continuously intercepted from the encoded data as the thumbnail data.
[0096] Step 2: The thumbnail processing module generates a thumbnail according to the received thumbnail data and displays it on the control screen.
[0097] In this step, after receiving the thumbnail data sent by the S end, the thumbnail processing module decodes the thumbnail data to obtain a thumbnail of the desktop image, where one desktop image data corresponds to one thumbnail; and displays each thumbnail on the control screen.
[0098] Step 3, the first control module obtains a first display instruction issued by the user, where the first display instruction is used to display the desktop image on the large-screen device; and sends the first display instruction to the second control module of the management server in the large-screen system.
[0099] In this step, after the user sees the thumbnails of the desktop images of each image source on the control screen, a first display instruction can be issued through an input device (the input device is connected to the first control module), and the first display instruction is used to display the desktop image on the large-screen device.
[0100] Specifically, the first display instruction includes the image source device ID of the image source device corresponding to the desktop image to be displayed in the large-screen system, and the display position and image size of the desktop image to be displayed in the large-screen system.
[0101] It should be noted that the user issues the first display instruction based on the thumbnail of the desktop image displayed on the control screen, the thumbnail of the display window of the seat machine system, and the thumbnail of the screen of the large screen system. Therefore, the screen setting of the control screen can be preset in the first control module, or the setting of the control screen can be obtained from the thumbnail processing module, so that the first display instruction can be generated through the user's operation in the input device.
[0102] Step 4: After receiving the first display instruction, the second control module of the management server sends a request to establish a connection to the S end; after receiving the request to establish a connection, the S end establishes a connection with the second control module.
[0103] In this step, after receiving the first display instruction from the first control module, the second control module indicates that the user wants to display the desktop image of the image source device in the large screen system. The second control module can send a request to establish a connection to the S end, and after receiving the request to establish a connection, the S end allows the connection to be established with the second control module.
[0104] Step 5, the second control module sends a request for obtaining image data to the S end, wherein the request for obtaining image data carries the image source device ID of the image source device; after receiving the request for obtaining image data, the S end sends the encoded data of the desktop image data of the image source device corresponding to the image source device ID to the second control module.
[0105] In this step, first, the second control module sends a request for obtaining image data to the S end, and the request carries the image source device ID of the image source device; after receiving the request for obtaining image data, the S end sends the encoded data of the desktop image data of the image source device corresponding to the image source device ID to the second control module.
[0106] For example, if the image source device ID=1 is carried in the request for obtaining image data received by the S end, then the desktop image data of the image source device with ID=1 can be determined to be green image data, and the encoded data of the green image data is sent to the second control module.
[0107] Step 6, the second control module determines the R' end corresponding to the screen to which the display position belongs in the large-screen system according to the display position included in the first display instruction; forwards the encoded data, as well as the display position and image size included in the first display instruction to the determined R' end; after receiving the encoded data, the R' end decodes to obtain the desktop image, and displays the desktop image on the corresponding screen according to the display position and image size.
[0108] Step 7, the first control module obtains the adjustment instruction 1 issued by the user, wherein the adjustment instruction 1 is used to adjust the display position and image size of the desktop image on the screen of the large-screen system, and sends the adjustment instruction 1 to the second control module of the management server in the large-screen system; the second control module adjusts the image on the screen according to the adjustment instruction 1.
[0109] In this step, after the user sees the desktop images of each image source on the screen of the large-screen system, an adjustment instruction 1 can be issued through an input device (the input device is connected to the first control module), and the adjustment instruction 1 includes displacement information and scaling information; the second control module adjusts the image on the screen according to the adjustment instruction 1, including scaling the image size and adjusting the image position.
[0110] like Figure 3 As shown, the user can adjust the positions of the green desktop image and the yellow desktop image displayed in display R1 ′ and display R2 ′, as well as the sizes of the images by issuing adjustment instruction 1 .
[0111] At this point, the user controls the display image of the large-screen system through the seat machine system.
[0112] Step 8: The first control module obtains a second display instruction issued by the user, where the second display instruction is used to display the desktop image in a display window of the seat machine system.
[0113] In this step, after the user sees the thumbnail of the desktop image of each image source on the control screen, a second display instruction can be issued through the input device (the input device is connected to the first control module), and the second display instruction is used to display the desktop image in the display window of the seat machine system.
[0114] Specifically, the second display instruction includes the image source device ID of the image source device corresponding to the desktop image to be displayed in the seat machine system, and the display window ID of the desktop image to be displayed in the seat machine system, and the image source device ID corresponds to the display window ID.
[0115] It should be noted that one screen can display one display window or multiple display windows. The display mode of the display window on the screen is relatively flexible and can be set according to user needs.
[0116] Step 9: After acquiring the second display instruction, the first control module sends a request for establishing a connection to the S end; after receiving the request for establishing a connection, the S end establishes a connection with the first control module.
[0117] In this step, after the first control module obtains the second display instruction, it indicates that the user wants to display the desktop image of the image source device in the display window of the seat machine system. The first control module can send a request to establish a connection to the S end, and after receiving the request to establish a connection, the S end allows the connection to be established with the first control module.
[0118] Step 10, the first control module sends a request for obtaining image data to the S end, wherein the request for obtaining image data carries the image source device ID of the image source device; after receiving the request for obtaining image data, the S end sends the encoded data of the desktop image data of the image source device corresponding to the image source device ID to the first control module.
[0119] In this step, first, the first control module sends a request for obtaining image data to the S end, and the request carries the image source device ID of the image source device; after receiving the request for obtaining image data, the S end sends the encoded data of the desktop image data of the image source device corresponding to the image source device ID to the first control module.
[0120] Step 11, the first control module forwards the encoded data to the R end corresponding to the display window of the display window ID where the desktop image is to be displayed in the seat machine system; after receiving the encoded data, the R end decodes to obtain the desktop image and displays the desktop image on the corresponding display window.
[0121] At this point, the user displays the image on the large screen system and the seat machine system.
[0122] It should be noted that step 8-11 and step 3-7 can be preceded by step 3-7 or by step 8-11, which can be set according to the user's scenario requirements.
[0123] Step 12: The R terminal in the seat machine system obtains the reverse control instruction and sends the reverse control instruction to the image source device. The reverse control instruction carries the image source device ID.
[0124] In this step, after the user sees the desktop image of the image source on the seat machine, he can reversely control the image source device. The user can operate through the input device (keyboard, mouse, touch screen, connected to the R end) in the seat machine system, the input device generates an operation event, and the R end in the seat machine system generates a reverse control instruction according to the operation event; and sends the reverse control instruction to the image source device.
[0125] It should be noted that the seat machine system can determine the image source device corresponding to the reverse control instruction according to the source of the desktop image displayed in the display window corresponding to the operation event, and carry the image source device ID of the image source device in the reverse control instruction.
[0126] Step 13: the image source device determines the target image source device corresponding to the image source device ID according to the received reverse control instruction; the target image source device executes the reverse control action in the reverse control instruction.
[0127] In the present invention, the image source device can determine the target image source device targeted by the reverse control instruction according to the image source device ID carried in the reverse control instruction, and then the target image source device executes the reverse control action in the reverse control instruction.
[0128] In a specific implementation, after the user has finished using the system, the user can send a reverse control instruction to disconnect the system to the second control module through the input device (the input device is connected to the R end). After receiving the reverse control instruction to disconnect the system, the S end interrupts the connection with the R' end and the R end. The seat machine system and the large screen system no longer receive the coded data sent by the S end. However, the control screen in the seat machine system still displays thumbnails. When the user needs to exit the seat machine system, the user can interrupt the connection between the thumbnail processing module and the S end through the input device (connected to the first control module). At this time, the control screen no longer displays thumbnails and the seat machine system is shut down.
[0129] Figure 4 A schematic diagram of an optional image processing device according to an embodiment of the present invention is shown in FIG. Figure 4 As shown, the image processing device may include: a receiving unit 41, an acquiring unit 43, a decoding unit 45, and a display unit 47, wherein:
[0130] The receiving unit 41 is used to receive a first display instruction sent by the seat machine system, wherein the first display instruction at least includes: an image display parameter;
[0131] An acquiring unit 43 is used to acquire image coding data, wherein the image coding data is coding data of desktop image data of an image source device;
[0132] A decoding unit 45, used for decoding the image encoding data to obtain a desktop image;
[0133] The display unit 47 is used to display the desktop image on the target area based on the image display parameters, wherein the target area is located on the target screen device of the large screen system.
[0134] Through the above-mentioned image processing device, the first display instruction issued by the seat machine system can be received through the receiving unit 41, wherein the first display instruction at least includes: image display parameters, image coding data is obtained through the acquisition unit 43, wherein the image coding data is the coding data of the desktop image data of the image source device, the image coding data is decoded by the decoding unit 45 to obtain the desktop image, and the desktop image is displayed on the target area based on the image display parameters through the display unit 47, wherein the target area is located on the target screen device of the large screen system. In this embodiment, the large screen system and the seat machine system are combined, and the display window parameters in the seat machine system are convenient for user operation. The user can send a reverse control instruction to the image source device through the seat machine system. After the image source device executes the reverse control instruction, the desktop image changes, and the image in the large screen system also changes. In this way, the reverse control of the large screen system can be achieved through the seat machine system, thereby solving the technical problem that the large screen device in the related technology cannot achieve the reverse control function.
[0135] Optionally, the image processing device also includes: a first control unit, used to control the image acquisition end to establish a connection with the thumbnail processing module after receiving the connection request before receiving the first display instruction issued by the seat machine system, wherein the thumbnail processing module is arranged in the seat machine system; a second control unit, used to control the image acquisition end to encode the collected desktop image data to generate image coding data; a third control unit, used to control the image acquisition end to generate thumbnail data according to the image coding data, and send the thumbnail data to the thumbnail processing module.
[0136] Alternatively, the image processing device also includes: a fourth control unit, used to control the thumbnail processing module to generate thumbnails based on the received thumbnail data after sending the thumbnail data to the thumbnail processing module; a fifth control unit, used to control the thumbnail processing module to display the thumbnails on a control screen, wherein the control screen is arranged in the seat machine system.
[0137] Optionally, the acquisition unit includes: a first sending module, used to send a data acquisition request to the image acquisition end, wherein the data acquisition request carries a device identification of the image source device; and a first receiving module, used to receive image encoding data sent by the image acquisition end.
[0138] In an embodiment of the present invention, the image processing device also includes: a second receiving module, used to receive a first adjustment instruction after displaying the desktop image on the target area screen, wherein the first adjustment instruction at least includes: adjustment parameters of the desktop image; a first adjustment module, used to adjust the image display parameters of the desktop image displayed on the target area screen based on the adjustment parameters of the desktop image.
[0139] Optionally, the image processing device also includes: a sixth control unit, used to control the first control module to receive a second display instruction after displaying the desktop image on the target area screen; a seventh control unit, used to control the first control module to establish a network connection with the image acquisition end based on the second display instruction; an eighth control unit, used to control the first control module to send an image acquisition request to the image acquisition end, wherein the image acquisition request carries an image identifier; a ninth control unit, used to control the first control module to receive image coding data sent by the image acquisition end; and a tenth control unit, used to control the first control module to send the image coding data to the image receiving end corresponding to the window to be displayed in the seat machine system, wherein the image receiving end decodes the image coding data to obtain the desktop image, and displays the desktop image on the window to be displayed.
[0140] The above-mentioned image processing device may also include a processor and a memory. The above-mentioned receiving unit 41, acquisition unit 43, decoding unit 45, display unit 47, etc. are all stored in the memory as program units, and the processor executes the above-mentioned program units stored in the memory to realize corresponding functions.
[0141] The processor includes a kernel, which retrieves the corresponding program unit from the memory. One or more kernels can be set, and the desktop image is displayed on the target area based on the image display parameters by adjusting the kernel parameters, wherein the target area is located on the target screen device of the large screen system, thereby realizing reverse control of the large screen device.
[0142] The above-mentioned memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM, and the memory includes at least one storage chip.
[0143] According to another aspect of an embodiment of the present invention, there is also provided an electronic device, comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to perform any one of the above-mentioned image processing methods by executing the executable instructions.
[0144] According to another aspect of an embodiment of the present invention, a computer-readable storage medium is provided, the computer-readable storage medium including a stored computer program, wherein when the computer program is executed, the device where the computer-readable storage medium is located is controlled to execute any one of the above-mentioned image processing methods.
[0145] The present application also provides a computer program product, which, when executed on a data processing device, is suitable for executing a program that is initialized with the following method steps: receiving a first display instruction issued by a seat machine system, wherein the first display instruction includes at least: image display parameters; obtaining image coding data, wherein the image coding data is coding data of desktop image data of an image source device; decoding the image coding data to obtain a desktop image; and displaying the desktop image on a target area based on the image display parameters, wherein the target area is located on a target screen device of a large screen system.
[0146] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.
[0147] In the above embodiments of the present invention, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0148] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.
[0149] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
[0150] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0151] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.
[0152] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.
Claims
1. An image processing method, characterized in that: include: Receiving a first display instruction sent by the seat machine system, wherein the first display instruction at least includes: image display parameters; Before receiving the first display instruction issued by the seat machine system, it includes: controlling the image acquisition end to establish a connection with the thumbnail processing module after receiving the connection request, wherein the thumbnail processing module is arranged in the seat machine system; controlling the image acquisition end to encode the collected desktop image data to generate image encoding data; controlling the image acquisition end to generate thumbnail data according to the image encoding data, and sending the thumbnail data to the thumbnail processing module; After the thumbnail data is sent to the thumbnail processing module, the method includes: controlling the thumbnail processing module to generate a thumbnail according to the received thumbnail data; controlling the thumbnail processing module to display the thumbnail on a control screen, wherein the control screen is provided in a seat machine system; Acquire image coding data, wherein the image coding data is coding data of desktop image data of an image source device; Decoding the image encoding data to obtain a desktop image; Based on the image display parameters, displaying the desktop image on a target area, wherein the target area is located on a target screen device of a large screen system; A reverse control operation is performed on the image source device through the input device in the seat machine system. The receiving end in the seat machine system generates a reverse control instruction based on the reverse control operation and sends the reverse control instruction to the image source device. The image source device executes the reverse control instruction.
2. The image processing method according to claim 1, characterized in that: The steps of obtaining the image encoding data include: Sending a data acquisition request to the image acquisition end, wherein the data acquisition request carries a device identification of the image source device; Receive the image encoding data sent by the image acquisition end.
3. The image processing method according to claim 1, characterized in that: After displaying the desktop image on the target area screen, the image processing method further includes: receiving a first adjustment instruction, wherein the first adjustment instruction at least includes: an adjustment parameter of a desktop image; Based on the adjustment parameters of the desktop image, image display parameters of the desktop image displayed on the screen of the target area are adjusted.
4. The image processing method according to claim 1, characterized in that: After displaying the desktop image on the target area screen, the image processing method further includes: receiving a second display instruction; Based on the second display instruction, establishing a network connection with the image acquisition terminal; Sending an image acquisition request to the image acquisition end, wherein the image acquisition request carries an image identifier; Receiving the image encoding data sent by the image acquisition end; The image encoding data is sent to an image receiving end corresponding to the window to be displayed in the seat machine system, wherein the image receiving end decodes the image encoding data to obtain a desktop image, and displays the desktop image on the window to be displayed.
5. An image processing system, characterized in that: include: The seat machine system at least includes: a first control module for reversely controlling the large screen system and the image acquisition terminal; The image acquisition end includes at least: an image source device for acquiring desktop images; A large-screen system comprises at least: a management server and a large-screen device, wherein the second control module in the management server executes the image processing method described in any one of claims 1 to 4.
6. The image processing system according to claim 5, characterized in that: The seat machine system further includes: a thumbnail module and a control screen, wherein the thumbnail module is used to zoom in and out the displayed image, and the control screen is used to control the large screen system to adjust the displayed image.
7. An image processing device, characterized in that: include: A receiving unit, configured to receive a first display instruction sent by a seat machine system, wherein the first display instruction at least includes: an image display parameter; The first control unit is used to control the image acquisition end to establish a connection with the thumbnail processing module after receiving the connection request before receiving the first display instruction issued by the seat machine system, wherein the thumbnail processing module is arranged in the seat machine system; the second control unit is used to control the image acquisition end to encode the collected desktop image data to generate image encoding data; the third control unit is used to control the image acquisition end to generate thumbnail data according to the image encoding data, and send the thumbnail data to the thumbnail processing module; a fourth control unit, for controlling the thumbnail processing module to generate a thumbnail according to the received thumbnail data after sending the thumbnail data to the thumbnail processing module; a fifth control unit, for controlling the thumbnail processing module to display the thumbnail on a control screen, wherein the control screen is provided in the seat machine system; An acquisition unit, used for acquiring image coding data, wherein the image coding data is coding data of desktop image data of an image source device; A decoding unit, used for decoding the image encoding data to obtain a desktop image; A display unit, configured to display the desktop image on a target area based on the image display parameters, wherein the target area is located on a target screen device of a large screen system; The image processing device is also used to perform a reverse control operation on the image source device through an input device in the seat machine system. The receiving end in the seat machine system generates a reverse control instruction based on the reverse control operation and sends the reverse control instruction to the image source device. The image source device executes the reverse control instruction.
8. An electronic device, characterized in that: include: processor; as well as A memory, configured to store executable instructions of the processor; The processor is configured to perform the image processing method according to any one of claims 1 to 4 by executing the executable instructions.
9. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored computer program, wherein when the computer program is executed, the device where the computer-readable storage medium is located is controlled to execute the image processing method according to any one of claims 1 to 4.
