A method and device for uploading multimedia information

Abstract

This specification discloses a method and device for uploading multimedia information, and specifically discloses that a client obtains at least one multimedia information, and identifies a preview area contained in a display interface displayed by a second device through the camera, and for each preview area, generates a virtual import control for the preview area in a screen used by a first device to display the display interface, and finally, for each virtual import control, in response to a preset operation performed by a user on the virtual import control, determines the target multimedia information, and transmits the identification information of the virtual import control and the target multimedia information to the second device. Then, the second device determines the target preview area corresponding to the virtual import control based on the identification information, and imports the target multimedia information into the target preview area. In this way, when uploading multimedia information, the user's operation steps are greatly simplified, the business efficiency is improved, and the user experience is improved.

Description

Technical Field

[0001] This specification relates to the field of Internet technology, and in particular to a method and device for uploading multimedia information. Background Art

[0002] When shopping on an online platform, the platform will display product details and product images to users. These images are pre-taken and uploaded by the merchant.

[0003] Currently, when uploading product images, merchants need to first use a camera to capture product images of the product, and then transfer and save the captured product images to a computer. Then, merchants process the product images on the computer according to the image upload standards corresponding to the business involved in the product (such as cutting out, background replacement, size adjustment, data compression, format conversion, etc.), so that the processed product images can meet the image upload standards. Finally, the merchant fills in the product details information (such as product name, product category, product specifications, etc.) of the product in the merchant management interface after logging in through the computer, and clicks the product image upload control, and then finds the processed product image on the computer in the image selection pop-up window displayed on the computer to confirm the upload, completing the product image upload process.

[0004] Thus, when uploading product images, users need to first establish a communication connection between the computer and the camera. Then, after clicking the product image upload control, the user needs to find the folder storing the captured product images in the image selection pop-up window, select the product image to be uploaded from the folder, and finally complete the product image upload operation. Therefore, the existing product image upload process is cumbersome and inefficient, and it brings inconvenience to users. Summary of the Invention

[0005] This specification provides a method and device for uploading multimedia information to partially solve the above-mentioned problems existing in the prior art.

[0006] This manual adopts the following technical solutions:

[0007] This specification provides a method for uploading multimedia information, including:

[0008] A client acquires at least one multimedia information collected by a camera set on a first device, wherein the client is installed in the first device;

[0009] identifying, by the camera, at least one preview area for uploading multimedia information contained in a display interface displayed by the second device;

[0010] For each preview area displayed in the display interface, generating a virtual import control for the preview area in a screen of the first device used to display the display interface;

[0011] For each virtual import control, in response to a preset operation performed by a user on the virtual import control, multimedia information that needs to be imported into a preset area corresponding to the virtual import control in the display interface is determined as target multimedia information, and identification information of the virtual import control and the target multimedia information are transmitted to the second device, so that the second device determines, based on the identification information, a preview area corresponding to the virtual import control in the display interface as the target preview area, and imports the target multimedia information into the target preview area, so that the target multimedia information is uploaded through the target preview area.

[0012] Optionally, identifying, by the camera, at least one preview area for uploading multimedia information included in a display interface displayed by the second device, specifically includes:

[0013] collecting, by the camera, image data including the display interface displayed by the second device;

[0014] Extracting feature points from the image data, and comparing the extracted feature points with pre-stored standard feature points corresponding to the preview area;

[0015] At least one preview area is identified from the image data according to the comparison result.

[0016] Optionally, for each preview area displayed in the display interface, generating a virtual import control for the preview area in a screen of the first device used to display the display interface specifically includes:

[0017] For each preview area displayed in the display interface, determining the physical coordinates of a preset anchor point of the preview area in a pre-constructed three-dimensional physical coordinate system as first physical coordinates;

[0018] Determining, based on the first physical coordinates and the acquired three-dimensional model of the virtual import control corresponding to the preview area, the physical coordinates of the virtual import control corresponding to the preview area in the three-dimensional physical coordinate system as the second physical coordinates;

[0019] Determining, based on the second physical coordinates and a predetermined coordinate conversion matrix, pixel coordinates of the virtual import control corresponding to the preview area in the image coordinate system corresponding to the screen, as the pixel coordinates of the virtual import control corresponding to the preview area, wherein the coordinate conversion matrix is ​​used to represent a coordinate conversion relationship between the three-dimensional physical coordinate system and the image coordinate system;

[0020] According to the pixel coordinates of the virtual import control corresponding to the preview area and the three-dimensional model of the virtual import control corresponding to the preview area, the virtual import control for the preview area is rendered and generated in the picture.

[0021] Optionally, determining the physical coordinates of a preset anchor point of the preview area in a pre-constructed three-dimensional physical coordinate system as the first physical coordinates specifically includes:

[0022] The center position of the preview area is determined as a preset anchor point of the preview area, and the physical coordinates of the preset anchor point of the preview area in the pre-constructed three-dimensional physical coordinate system are used as first physical coordinates.

[0023] Optionally, the identification information of the virtual import control includes: pixel coordinates of the virtual import control in an image coordinate system corresponding to the screen;

[0024] Transmitting the identification information of the virtual import control and the target multimedia information to the second device, so that the second device determines, based on the identification information, a preview area corresponding to the virtual import control in the display interface as a target preview area, specifically includes:

[0025] The identification information of the virtual import control and the target multimedia information are transmitted to the second device, so that the second device determines the physical coordinates of the virtual import control in the three-dimensional physical coordinate system as third physical coordinates based on the pixel coordinates of the virtual import control in the image coordinate system corresponding to the screen and a predetermined coordinate transformation matrix, and determines the preview area corresponding to the virtual import control in the display interface as the target preview area based on the third physical coordinates.

[0026] Optionally, obtaining at least one multimedia information collected by a camera set up on the first device specifically includes:

[0027] In response to the information processing rule selected by the user, starting the camera and collecting multimedia information about the target object through the camera, wherein the information processing rule is used to indicate an upload standard specified when uploading the multimedia information;

[0028] According to the information processing rule, each piece of multimedia information collected is processed to obtain at least one multimedia information that complies with the information processing rule.

[0029] Optionally, transmitting the identification information of the virtual import control and the target multimedia information to the second device specifically includes:

[0030] The identification information of the virtual import control and the target multimedia information are transmitted to the second device through a communication connection method pre-established between the first device and the second device, and the communication connection method includes a wireless communication connection, and the wireless communication connection includes: at least one of a wireless local area network (WLAN) direct connection and Bluetooth.

[0031] This specification provides a method for uploading multimedia information, including:

[0032] The second device receives identification information of the virtual import control and target multimedia information sent by the client, wherein the target multimedia information is multimedia information determined by the client, for each virtual import control, in response to a preset operation performed by the user on the virtual import control, from at least one multimedia information captured by the first device through a camera to be imported into a preset area corresponding to the virtual import control in a display interface displayed on the second device. The identification information is identification information of the virtual import control on which the user performed the preset operation. The virtual import control is generated in a screen of the first device used to display the display interface, and the virtual import control corresponds to a preview area included in the display interface for uploading multimedia information. The client is installed in the first device.

[0033] Determining, according to the identification information, a preview area corresponding to the virtual import control in the display interface as a target preview area;

[0034] The target multimedia information is imported into the target preview area, so as to upload the target multimedia information through the target preview area.

[0035] Optionally, the identification information of the virtual import control includes: pixel coordinates of the virtual import control in an image coordinate system corresponding to the screen;

[0036] Determining, according to the identification information, a preview area corresponding to the virtual import control in the display interface as a target preview area, specifically includes:

[0037] Determining, based on the pixel coordinates of the virtual import control in the image coordinate system corresponding to the screen and a predetermined coordinate conversion matrix, the physical coordinates of the virtual import control in a pre-constructed three-dimensional physical coordinate system as third physical coordinates, wherein the coordinate conversion matrix is ​​used to represent a coordinate conversion relationship between the three-dimensional physical coordinate system and the image coordinate system;

[0038] According to the third physical coordinate, a preview area corresponding to the virtual import control in the display interface is determined as a target preview area.

[0039] This specification provides a multimedia information uploading device, including:

[0040] an acquisition module, configured to acquire at least one multimedia information collected by a camera provided on a first device, wherein a client is installed on the first device;

[0041] a preview area identification module, configured to identify, through the camera, at least one preview area for uploading multimedia information contained in a display interface displayed by the second device;

[0042] a virtual import control generating module, configured to generate, for each preview area displayed in the display interface, a virtual import control for the preview area in a screen used by the first device to display the display interface;

[0043] The transmission module is configured to determine, for each virtual import control, in response to a preset operation performed by a user on the virtual import control, multimedia information that needs to be imported into a preset area corresponding to the virtual import control in the display interface as target multimedia information, and transmit identification information of the virtual import control and the target multimedia information to the second device, so that the second device determines, based on the identification information, a preview area corresponding to the virtual import control in the display interface as the target preview area, and import the target multimedia information into the target preview area, so as to upload the target multimedia information through the target preview area.

[0044] This specification provides a multimedia information uploading device, including:

[0045] a receiving module, configured to receive identification information of a virtual import control and target multimedia information sent by a client, wherein the target multimedia information is multimedia information determined by the client, for each virtual import control, in response to a preset operation performed by a user on the virtual import control, from at least one multimedia information captured by a camera of a first device to be imported into a preset area corresponding to the virtual import control in a display interface displayed on a second device; the identification information is identification information of the virtual import control on which the user performed the preset operation; the virtual import control is generated in a screen of the first device used to display the display interface; the virtual import control corresponds to a preview area included in the display interface for uploading multimedia information; and the client is installed in the first device;

[0046] a determination module, configured to determine, based on the identification information, a preview area corresponding to the virtual import control in the display interface as a target preview area;

[0047] The uploading module is used to import the target multimedia information into the target preview area, so as to upload the target multimedia information through the target preview area.

[0048] This specification provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the method for uploading multimedia information is implemented.

[0049] This specification provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned method for uploading multimedia information when executing the program.

[0050] At least one of the above technical solutions adopted in this specification can achieve the following beneficial effects:

[0051] In a multimedia information uploading method provided herein, a client acquires at least one multimedia information captured by a camera provided on a first device. The client is installed on the first device. The client then uses the camera to identify at least one preview area for uploading multimedia information, included in a display interface displayed by a second device. For each preview area displayed on the display interface, a virtual import control corresponding to the preview area is generated on the screen of the first device used to display the display interface. Finally, for each virtual import control, in response to a user's preset operation performed on the virtual import control, the client determines the multimedia information to be imported into the preset area corresponding to the virtual import control on the display interface as the target multimedia information. The client then transmits identification information of the virtual import control and the target multimedia information to the second device. The second device then determines, based on the identification information, the preview area corresponding to the virtual import control on the display interface as the target preview area, and imports the target multimedia information into the target preview area, thereby uploading the target multimedia information through the target preview area.

[0052] As can be seen from the above method, in this method, after the user directly obtains at least one multimedia message on the client, they can then determine the target multimedia message from the at least one multimedia message obtained, and transmit the selected target multimedia message to the first device through the virtual import control generated by the client, and the first device completes the upload of the target multimedia message. In this way, when uploading product images, compared to the existing technology, the user no longer needs to search for a folder storing pre-captured product images in the image selection pop-up window displayed after clicking the product image upload control, nor does the user need to manually select the product images to be uploaded from the found folder for upload. Therefore, the user's operation steps are greatly simplified, business efficiency is improved, and the user experience is enhanced. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] The drawings described herein are used to provide a further understanding of this specification and constitute a part of this specification. The exemplary embodiments and descriptions of this specification are used to explain this specification and do not constitute an improper limitation of this specification. In the drawings:

[0054] Figure 1 A flowchart of a method for uploading multimedia information in this manual;

[0055] Figures 2A-2B A schematic diagram of a method for setting multimedia information upload standards in this manual;

[0056] Figures 3A to 3G This is a schematic diagram of changes in the screen of the first device during the process of uploading multimedia information in this manual;

[0057] Figure 4 A schematic diagram of a multimedia information uploading device provided in this manual;

[0058] Figure 5 A schematic diagram of a multimedia information uploading device provided in this manual;

[0059] Figure 6 The corresponding Figure 1 Schematic diagram of electronic equipment. DETAILED DESCRIPTION

[0060] To make the objectives, technical solutions, and advantages of this specification more clear, the following will clearly and completely describe the technical solutions of this specification in conjunction with the specific embodiments of this specification and the corresponding drawings. Obviously, the embodiments described are only part of the embodiments of this specification, not all of the embodiments. Based on the embodiments in this specification, all other embodiments obtained by ordinary technicians in this field without making any creative efforts are within the scope of protection of this specification.

[0061] In order to solve the problems of cumbersome user operations and low efficiency when uploading product images, this specification proposes a solution for uploading multimedia information, which is applied to a system including a first device and a second device, where a client is installed on the first device.

[0062] Among them, the above-mentioned client is used to obtain multimedia information collected by the camera set on the first device, and generate a corresponding virtual import control for each preview area for uploading multimedia information included in the display interface displayed by the second device, and for each virtual import control, after the user performs a preset operation on the virtual import control, determine the target multimedia information that needs to be imported into the preset area corresponding to the virtual import control in the display interface, and then send the target multimedia information and the identification information of the virtual import control to the second device.

[0063] The above-mentioned second device is used to determine the target preview area corresponding to the virtual import control in the display interface according to the identification information of the received virtual import control, and import the target multimedia information into the target preview area, so as to upload the target multimedia information through the target preview area.

[0064] In this way, the user can directly identify the target multimedia information from the at least one multimedia information obtained by the client, and transmit the selected target multimedia information to the first device through the virtual import control generated by the client, and the first device completes the upload of the target multimedia information. In this way, when uploading product images, compared with the existing technology, the user no longer needs to search for a folder storing pre-captured product images in the image selection pop-up window displayed after clicking the product image upload control, nor does the user need to manually select the product images to be uploaded from the found folder. Therefore, the user's operation steps are greatly simplified, business efficiency is improved, and the user experience is enhanced.

[0065] The multimedia information uploading solution provided in this specification will be described in detail below with reference to embodiments.

[0066] Figure 1 The flowchart of a method for uploading multimedia information in this specification includes the following steps:

[0067] Step S100: The client obtains at least one multimedia information collected by a camera set on a first device, and the client is installed in the first device.

[0068] In a specific implementation, when a user needs to upload multimedia information, they launch a client on a first device (such as a mobile phone or tablet). The client presents the user with available information processing rules. Then, in response to the information processing rule selected by the user, the client activates a camera on the first device and uses the camera to capture multimedia information about the target object. The client then processes the collected multimedia information according to the user-selected information processing rule, obtaining at least one multimedia message that complies with the information processing rule.

[0069] The above-mentioned information processing rules are used to indicate the upload standards specified when uploading multimedia information. The multimedia information can be multimedia information related to the target object, such as an image of the target object, a video of the target object, etc. The information processing rules may include whether the target object in the multimedia information needs to be cut out, the background image requirements that the multimedia information must meet (for example, the background color must be white), the size that the multimedia information must meet (for example, the size must be 1800 pixels × 1200 pixels), the data format that the multimedia information must meet (for example, the image format must be JPEG format), and the data size that the multimedia information must meet (for example, the size must be 2M).

[0070] Specifically, in different business scenarios, the upload standards specified when uploading multimedia information may be different. Therefore, users can set the information processing rules required for each business scenario according to the upload standards specified when uploading multimedia information in each business scenario. The business scenarios can be diverse, such as beverage scenarios, pastry scenarios, kitchenware scenarios, clothing scenarios, etc. Among them, business scenarios with the same or overlapping upload standards can be merged into one business scenario. Correspondingly, when determining the information processing rules corresponding to the merged business scenario, the intersection of the upload standards corresponding to each business scenario can be determined based on the upload standards corresponding to each business scenario, and then, based on the intersection of the upload standards corresponding to each business scenario, the information processing rules corresponding to the merged business scenario can be set.

[0071] An example of a possible implementation of setting information processing rules is given below.

[0072] like Figures 2A-2B As shown, when setting the corresponding information processing rules for the business scenario, the user can click to create a scene control after opening the client. Then, the client responds to the user's operation and displays the setting page of the information processing rules to the user. The user can set the name of the business scenario and the information processing rules corresponding to the business scenario in the setting page (including whether it is necessary to cut out the target object in the multimedia information, the background image requirements that the multimedia information needs to meet, the size that the multimedia information needs to meet, the data format that the multimedia information needs to meet, the data volume that the multimedia information needs to meet, etc.). Subsequently, the client responds to the save instruction triggered by the user and saves the business scenario set by the user and the information processing rules corresponding to the business scenario. In this way, the setting of information processing rules corresponding to a business scenario is completed in the client.

[0073] In this specification, after the client obtains at least one multimedia message, it can save these multimedia messages in a folder under the set storage path corresponding to the client in the first device. At the same time, it can also reduce these multimedia messages and display them to the user in a set area on the screen of the first device (such as the display area at the bottom of the screen of the first device, the display area on the right side of the screen of the first device, etc.) to show the user the multimedia information that can be uploaded.

[0074] In actual business operations, the client can first determine whether to cut out the target object in the multimedia information captured by the camera set on the first device based on the information processing rules selected by the user. If necessary, the client will perform target object recognition for each multimedia message and extract the multimedia information of the recognized target object. The client then continues to perform background image adjustment, size scaling, data compression, data format conversion, and other operations on the extracted multimedia information of the target object based on the information processing rules selected by the user to obtain the multimedia information that can be uploaded.

[0075] During this process, when multimedia information about the target object is collected through the camera set on the first device, if the shooting background is relatively messy, the collected multimedia information may contain other objects besides the target object. At this time, the client may not be able to accurately identify and extract the required multimedia information of the target object from the collected multimedia information.

[0076] To avoid such problems, in this specification, when collecting multimedia information, after the client activates the camera, a target object selection box will be generated in the screen of the first device. The user can then adjust the target object selection box so that the target object selection box selects the multimedia information of the target object. Then, the client responds to the shooting command triggered by the user (for example, the user clicks or long presses the shooting button or camera interface to trigger the shooting command) and obtains the multimedia information displayed in the screen of the first device. Then, according to the target object selection box in the multimedia information, the multimedia information is cropped to obtain multimedia information specific to the target object. In this way, the situation where the client cannot accurately identify the target object can be effectively avoided.

[0077] Step S102: identifying, through the camera, at least one preview area for uploading multimedia information contained in a display interface displayed by the second device.

[0078] Specifically, the client captures image data of the display interface displayed by the second device using a camera on the first device. Feature points are then extracted from the image data and compared with pre-stored standard feature points corresponding to the preview area. Finally, based on the comparison results, at least one preview area is identified from the image data. Feature point extraction can be achieved using the Scale-invariant Feature Transform (SIFT) algorithm.

[0079] In actual applications, the images of the preview areas displayed on different second devices may be different. In this case, the feature points corresponding to the preview areas with different images may also be different. Therefore, when determining the standard feature points corresponding to the preview areas, the feature points in the image of the preview area can be determined for each preview area with different images and saved as the standard feature points corresponding to the preview area. In this way, when identifying the preview area, the extracted feature points need to be matched one by one with the pre-stored standard feature points corresponding to each preview area. When it is determined that there is at least one standard feature point corresponding to the preview area that matches the extracted feature point (for example, the ratio between the number of successfully matched feature points and the total number of standard feature points corresponding to the preview area being compared is greater than a set value), it is determined that the preview area is identified.

[0080] Of course, in this specification, it is also possible to first determine the feature points in the image of each preview area with different images, and then find common feature points from the feature points in the determined images of each preview area, and use these common feature points as the standard feature points corresponding to the preview area. Then, when identifying the preview area, the extracted feature points are directly compared with the standard feature points corresponding to the preview area. When the standard feature points are determined to match the extracted feature points (for example, the ratio between the number of successfully matched feature points and the total number of standard feature points corresponding to the preview area images being compared is greater than a set value), it is determined that the preview area has been identified.

[0081] Step S104 : For each preview area displayed in the display interface, a virtual import control for the preview area is generated in the screen of the first device used to display the display interface.

[0082] In actual applications, the client first constructs a 3D physical coordinate system. Specifically, when constructing the 3D physical coordinate system, the client can determine the coordinate origin corresponding to the preset 3D physical coordinate system from the extracted feature points corresponding to the preview area. Then, based on the coordinate origin, the client determines the X-axis direction and the Y-axis direction of the 3D physical coordinate system in directions parallel to the two sides of the image in the preview area. Then, based on the determined X-axis direction and Y-axis direction, the client determines the Z-axis direction of the 3D physical coordinate system to complete the construction of the 3D physical coordinate system.

[0083] Next, the client will determine the coordinate conversion matrix between the image coordinate system corresponding to the screen of the first device and the three-dimensional physical coordinate system, so as to further generate the corresponding virtual import control for each preview area. Specifically, when determining the coordinate conversion matrix, the client determines each preset feature point from the feature points corresponding to the extracted preview area, and then, for each preset feature point, determines the physical coordinates of the preset feature point in the three-dimensional physical coordinate system and the pixel coordinates of the preset feature point in the image coordinate system. Next, the client determines the coordinate conversion matrix between the three-dimensional physical coordinate system and the image coordinate system based on the physical coordinates of each preset feature point in the three-dimensional physical coordinate system and the pixel coordinates of each preset feature point in the image coordinate system. The coordinate conversion matrix is ​​used to characterize the coordinate conversion relationship between the three-dimensional physical coordinate system and the image coordinate system, and the coordinate conversion matrix can also be determined by a random sample consensus (RANSAC) algorithm.

[0084] In this specification, after constructing the above-mentioned three-dimensional physical coordinate system and determining the coordinate conversion matrix between the three-dimensional physical coordinate system and the image coordinate system, a virtual import control for each preview area can be further generated for the preview area.

[0085] Specifically, for each preview area displayed on the display interface, the client determines the physical coordinates of a preset anchor point of the preview area in a pre-constructed 3D physical coordinate system as the first physical coordinates. Then, based on the first physical coordinates and the acquired 3D model of the virtual import control corresponding to the preview area, the client determines the physical coordinates of the virtual import control corresponding to the preview area in the 3D physical coordinate system as the second physical coordinates. Next, based on the second physical coordinates and a pre-determined coordinate transformation matrix, the client determines the pixel coordinates of the virtual import control corresponding to the preview area in the image coordinate system corresponding to the screen of the first device as the pixel coordinates of the virtual import control corresponding to the preview area. Finally, based on the pixel coordinates of the virtual import control corresponding to the preview area and the 3D model of the virtual import control corresponding to the preview area, the client renders the virtual import control for the preview area on the screen of the first device.

[0086] The preset anchor point of the preview area can be pre-set, and the preset anchor point can be the center of the preview area. Of course, in actual business operations, the preset anchor point of the preview area can be any point within the preview area (for example, when the image in the preview area is a rectangle, the preset anchor point of the preview area can be a vertex of the rectangle), and can be flexibly determined based on actual business needs. In addition, in this specification, the preview area and the virtual import control can be one-to-one corresponding, so that the multimedia information to be imported into each preview area can be flexibly controlled.

[0087] Step S106: For each virtual import control, in response to a preset operation performed by the user on the virtual import control, determine the multimedia information that needs to be imported into the preset area corresponding to the virtual import control in the display interface as the target multimedia information, and transmit the identification information of the virtual import control and the target multimedia information to the second device, so that the second device determines the preview area corresponding to the virtual import control in the display interface as the target preview area based on the identification information, and imports the target multimedia information into the target preview area, so as to upload the target multimedia information through the target preview area.

[0088] In a specific implementation, the user performs a preset operation (such as clicking, long pressing, sliding, etc.) on one of the virtual import controls according to actual needs. Then, in response to the preset operation, the client determines the multimedia information that needs to be imported into the preset area corresponding to the virtual import control in the display interface (i.e., the target multimedia information to be uploaded), and transmits the identification information of the virtual import control and the target multimedia information to the second device via the communication connection pre-established between the first device and the second device.

[0089] Correspondingly, after receiving the identification information of the virtual import control and the target multimedia information, the second device determines the preview area corresponding to the virtual import control in the display interface displayed by the second device according to the identification information of the virtual import control as the target preview area, and then imports the target multimedia information into the target preview area to upload the target multimedia information through the target preview area. The communication connection method established between the first device and the second device may include a wireless communication connection. Specifically, the wireless communication connection includes at least one of: WLAN direct connection and Bluetooth.

[0090] In this specification, the identification information of the virtual import control can be the pixel coordinates of the virtual import control in the image coordinate system corresponding to the screen of the first device. In this case, the client also needs to transmit a predetermined coordinate conversion matrix between the constructed three-dimensional physical coordinate system and the image coordinate system to the second device. The second device then determines the physical coordinates (i.e., third physical coordinates) of the virtual import control in the three-dimensional physical coordinate system based on the pixel coordinates and the coordinate conversion matrix. Based on the determined third physical coordinates, the second device determines the preview area corresponding to the virtual import control in the display interface as the target preview area.

[0091] There are multiple ways to determine the preview area corresponding to the virtual import control in the display interface based on the third physical coordinates. For example, the physical coordinates of the preset anchor point of the preview area corresponding to the virtual import control in the three-dimensional physical coordinate system can be first determined based on the third physical coordinates. The target preview area can then be determined based on the determined physical coordinates and the physical coordinates of the preset anchor points of each preview area in the three-dimensional physical coordinate system. For another example, the virtual import control can be projected onto the plane where the preview area is located based on the third physical coordinates and the physical coordinates of each preview area in the three-dimensional physical coordinate system. Then, the preview area with the highest degree of overlap can be selected to determine the target preview area corresponding to the virtual import control. Other methods are not described one by one.

[0092] Of course, the identification information of the virtual import control can also be an identifier pre-set for each virtual import control (e.g., a pre-set number). Specifically, the identifier of each preview area can be pre-set for each preview area in a set order. Then, when generating the virtual import control corresponding to each preview area, a corresponding identifier is set for each preview area, thereby obtaining a correspondence between the identifiers of each preview area and the identifiers of each virtual import control. In this way, after the client sends the identifier of the virtual import control selected by the user to the second device, the second device can determine the identifier of the preview area corresponding to the virtual import control based on the identifier of the virtual import control and the correspondence between the identifiers of each preview area and the identifiers of each virtual import control, and further determine the preview area corresponding to the virtual import control.

[0093] In a specific implementation, when the second device imports the target multimedia information into the target preview area, it also obtains relevant information about the target multimedia information so that when uploading the target multimedia information through the target preview area, it can obtain the target multimedia information to be uploaded based on the relevant information about the target multimedia information and upload it. The relevant information about the target multimedia information may include the storage path of the target multimedia information, the name of the target multimedia information, the data size of the target multimedia information, etc.

[0094] Through the above steps, after the user directly obtains at least one multimedia message on the client, he or she can then determine the target multimedia message from the at least one multimedia message obtained, and transmit the selected target multimedia message to the first device through the virtual import control generated by the client, and the first device completes the upload of the target multimedia message. In this way, when uploading product images, compared to existing solutions, the user no longer needs to search for a folder storing pre-captured product images in the image selection pop-up window displayed after clicking the product image upload control, nor does he or she need to manually select the product images to be uploaded from the found folder for upload. Therefore, the user's operation steps are greatly simplified, business efficiency is improved, and the user experience is enhanced.

[0095] In addition, when the position of the first device shifts, the position of the preview area displayed in the screen of the display interface displayed by the second device used by the first device will change accordingly. Therefore, the position of the virtual import control generated based on the preview area in the screen will also change.

[0096] In actual application, after the target multimedia information is transmitted to the second device and the second device imports the target multimedia information into the preview area corresponding to the virtual import control, the virtual import control corresponding to the preview area disappears from the screen of the first device.

[0097] In this specification, after the display interface of the second device disappears from the screen of the first device (i.e., the first device or the second device is moved away), the virtual import control displayed on the screen of the first device for displaying the display interface displayed by the second device disappears accordingly. In actual applications, the virtual import control in this specification may disappear after the client determines that the transmission of multimedia information is complete. Otherwise, even if the display interface of the second device disappears from the screen of the first device, the virtual import control displayed on the screen of the first device may not disappear accordingly. Specifically, the client determines whether the upload of multimedia information is completed, and in response to the incomplete upload of multimedia information, the virtual import control displayed on the screen of the first device for displaying the display interface displayed by the second device does not disappear.

[0098] Among them, there are many ways for the client to determine whether the upload of multimedia information is completed. For example, after the second device uploads the target multimedia information, it returns identification information to the client indicating that the target multimedia information has been uploaded. Then, after receiving the identification information, the client determines that the upload of the multimedia information has been completed, and the virtual import control displayed on the screen of the first device disappears. For another example, when the client identifies the preview area, it records the number of identified preview areas. Then, each time a multimedia information is transmitted to the second device, the number of preview areas is reduced by one. When the number of preview areas is zero, it is determined that the upload of the multimedia information has been completed. Subsequently, the virtual import control displayed on the screen of the first device disappears. Other methods are not given examples one by one.

[0099] The following will take uploading product images to an online shopping platform as an example, with the second device being a computer and the first device being a mobile phone, to illustrate the execution process of uploading multimedia information in this manual. Figures 3A to 3G .

[0100] For example, if a merchant needs to list a new product, Product A, on their online store, they open the product information configuration interface on their computer and, at the same time, open the client on their mobile phone and click on the camera control corresponding to the kitchen scene. Then, the client obtains the information processing rules for the kitchen scene selected by the user. Figures 3A-3B .

[0101] Then, the client activates the camera set on the mobile phone, and responds to the merchant's triggering shooting command after the merchant clicks the shooting button to generate a shooting command. Through the camera, an image of product A is collected from multiple different angles, and the image is processed according to the information processing rules selected by the user to obtain the image of product A to be uploaded. Figures 3C to 3E .

[0102] Next, the merchant points the mobile phone camera toward the computer's display interface. The client identifies at least one preview area contained in the display interface displayed by the computer and generates a corresponding virtual import control for each preview area. After the merchant clicks the first virtual import control, the client responds to the merchant's click operation and sends the image of product A to be uploaded and the identification information of the virtual import control clicked by the merchant to the computer. Based on the identification information of the virtual import control, the computer determines that the first preview area is the target preview area and imports the image of product A to be uploaded into the target preview area, so that the image of product A to be uploaded can be uploaded through the target preview area. See Figures 3F to 3G .

[0103] The merchants in the above embodiments are the users in the method for uploading multimedia information in this specification.

[0104] The above is a method for uploading multimedia information provided by one or more embodiments of this specification. Based on the same idea, this specification also provides a corresponding device for uploading multimedia information, such as Figure 4 and 5 shown.

[0105] Figure 4 This specification provides a schematic diagram of a device for uploading multimedia information, specifically including:

[0106] An acquisition module 400 is configured to acquire at least one multimedia information collected by a camera provided on a first device, wherein the client is installed on the first device;

[0107] A preview area identification module 401 is configured to identify, through the camera, at least one preview area for uploading multimedia information contained in a display interface displayed by the second device;

[0108] A virtual import control generating module 402 is configured to generate, for each preview area displayed in the display interface, a virtual import control for the preview area in a screen used by the first device to display the display interface;

[0109] The transmission module 403 is used to determine, for each virtual import control, in response to a preset operation performed by the user on the virtual import control, multimedia information that needs to be imported into a preset area corresponding to the virtual import control in the display interface as target multimedia information, and transmit the identification information of the virtual import control and the target multimedia information to the second device, so that the second device determines, based on the identification information, a preview area corresponding to the virtual import control in the display interface as the target preview area, and imports the target multimedia information into the target preview area, so as to upload the target multimedia information through the target preview area.

[0110] Optionally, the preview area identification module 401 is specifically used to collect image data of the display interface displayed by the second device through the camera; extract feature points from the image data, and compare the extracted feature points with pre-stored standard feature points corresponding to the preview area; and identify at least one preview area from the image data based on the comparison result.

[0111] Optionally, the virtual import control generation module 402 is specifically configured to, for each preview area displayed in the display interface, determine, as first physical coordinates, the physical coordinates of a preset anchor point of the preview area in a pre-constructed three-dimensional physical coordinate system; determine, based on the first physical coordinates and the acquired three-dimensional model of the virtual import control corresponding to the preview area, the physical coordinates of the virtual import control corresponding to the preview area in the three-dimensional physical coordinate system as second physical coordinates; determine, based on the second physical coordinates and a pre-determined coordinate transformation matrix, pixel coordinates of the virtual import control corresponding to the preview area in an image coordinate system corresponding to the screen as pixel coordinates of the virtual import control corresponding to the preview area, wherein the coordinate transformation matrix is ​​used to represent a coordinate transformation relationship between the three-dimensional physical coordinate system and the image coordinate system; and render and generate, on the screen, a virtual import control for the preview area based on the pixel coordinates of the virtual import control corresponding to the preview area and the three-dimensional model of the virtual import control corresponding to the preview area.

[0112] Optionally, the virtual import control generation module 402 is specifically used to determine the center position of the preview area as a preset anchor point of the preview area, and use the physical coordinates of the preset anchor point of the preview area in a pre-constructed three-dimensional physical coordinate system as the first physical coordinates.

[0113] Optionally, the identification information of the virtual import control includes: pixel coordinates of the virtual import control in an image coordinate system corresponding to the screen;

[0114] The transmission module 403 is specifically configured to transmit the identification information of the virtual import control and the target multimedia information to the second device, so that the second device determines the physical coordinates of the virtual import control in the three-dimensional physical coordinate system as third physical coordinates based on the pixel coordinates of the virtual import control in the image coordinate system corresponding to the screen and a predetermined coordinate transformation matrix, and determines the preview area corresponding to the virtual import control in the display interface as the target preview area based on the third physical coordinates.

[0115] Optionally, the acquisition module 400 is specifically used to start the camera in response to the information processing rules selected by the user, and collect multimedia information about the target object through the camera, and the information processing rules are used to represent the upload standards specified when uploading multimedia information; according to the information processing rules, each collected multimedia information is processed to obtain at least one multimedia information that complies with the information processing rules.

[0116] Optionally, the transmission module 403 is specifically used to transmit the identification information of the virtual import control and the target multimedia information to the second device through a communication connection method pre-established between the first device and the second device, and the communication connection method includes a wireless communication connection, and the wireless communication connection includes: at least one of: WLAN direct connection and Bluetooth.

[0117] Figure 5 This specification provides a schematic diagram of a device for uploading multimedia information, specifically including:

[0118] A receiving module 500 is configured to receive identification information of a virtual import control and target multimedia information sent by a client. The target multimedia information is multimedia information determined by the client, for each virtual import control, in response to a user performing a preset operation on the virtual import control, from at least one multimedia information captured by a camera of a first device to be imported into a preset area corresponding to the virtual import control in a display interface displayed on a second device. The identification information is identification information of the virtual import control on which the user performed the preset operation. The virtual import control is generated in a screen of the first device used to display the display interface. The virtual import control corresponds to a preview area included in the display interface for uploading multimedia information. The client is installed in the first device.

[0119] A determination module 501 is configured to determine, based on the identification information, a preview area corresponding to the virtual import control in the display interface as a target preview area;

[0120] The uploading module 502 is configured to import the target multimedia information into the target preview area, so as to upload the target multimedia information through the target preview area.

[0121] Optionally, the identification information of the virtual import control includes: pixel coordinates of the virtual import control in an image coordinate system corresponding to the screen;

[0122] The determination module 501 shown is specifically used to determine the physical coordinates of the virtual import control in a pre-constructed three-dimensional physical coordinate system as a third physical coordinate based on the pixel coordinates of the virtual import control in the image coordinate system corresponding to the screen and a predetermined coordinate conversion matrix. The coordinate conversion matrix is ​​used to represent the coordinate conversion relationship between the three-dimensional physical coordinate system and the image coordinate system; based on the third physical coordinates, determine the preview area corresponding to the virtual import control in the display interface as the target preview area.

[0123] This specification also provides a computer-readable storage medium, which stores a computer program that can be used to execute the above Figure 1 Provides a method for uploading multimedia information.

[0124] This manual also provides Figure 6 The schematic structure diagram of the electronic device shown in FIG. Figure 6 As mentioned above, at the hardware level, the electronic device includes a processor, an internal bus, a network interface, a memory and a non-volatile memory, and may also include other hardware required for the business. The processor reads the corresponding computer program from the non-volatile memory into the memory and then runs it to achieve the above Figure 1 Of course, in addition to software implementation, this specification does not exclude other implementation methods, such as logic devices or a combination of software and hardware, etc., that is, the execution subject of the following processing flow is not limited to each logic unit, but can also be hardware or logic devices.

[0125] In the 1990s, technological improvements could be clearly distinguished as either hardware improvements (for example, improvements to circuit structures like diodes, transistors, and switches) or software improvements (improvements to process flows). However, with the advancement of technology, many process flow improvements today can now be considered direct improvements to hardware circuit structures. Designers almost always create the corresponding hardware circuit structure by programming the improved process flow into the hardware circuit. Therefore, it cannot be said that a process flow improvement cannot be implemented using hardware modules. For example, a programmable logic device (PLD), such as a field programmable gate array (FPGA), is an integrated circuit whose logical function is determined by user programming. Designers can "integrate" a digital system on a PLD through their own programming, without having to hire a chip manufacturer to design and manufacture a dedicated integrated circuit chip. Moreover, nowadays, instead of manually fabricating integrated circuit chips, this programming is mostly done using "logic compiler" software. This is similar to the software compiler used when developing programs. Before compilation, the original code must also be written in a specific programming language, called a hardware description language (HDL). There is not just one HDL, but many, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc. The most commonly used ones are VHDL (Very-High-Speed ​​Integrated Circuit Hardware Description Language) and Verilog. Those skilled in the art will also understand that by simply programming the method flow in one of these hardware description languages ​​and then programming it into an integrated circuit, a hardware circuit that implements the logic method flow can be easily obtained.

[0126] The controller can be implemented in any suitable manner. For example, the controller can take the form of a microprocessor or processor and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro)processor, logic gates, switches, application-specific integrated circuits (ASICs), programmable logic controllers, and embedded microcontrollers. Examples of controllers include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320. The memory controller can also be implemented as part of the control logic of the memory. Those skilled in the art will also know that in addition to implementing the controller in a purely computer-readable program code format, the controller can be implemented in the form of logic gates, switches, application-specific integrated circuits, programmable logic controllers, and embedded microcontrollers by logically programming the method steps. Therefore, such a controller can be considered a hardware component, and the devices included therein for implementing various functions can also be considered as structures within the hardware component. Or even, the devices for implementing various functions can be considered as both software modules that implement the method and structures within the hardware component.

[0127] The systems, devices, modules, or units described in the above embodiments may be implemented by computer chips or entities, or by products having certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0128] For the convenience of description, the above devices are described as being divided into various units according to their functions. Of course, when implementing this specification, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0129] It will be understood by those skilled in the art that embodiments of the present invention may be provided as methods, systems, or computer program products. Thus, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0130] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowcharts and / or block diagrams, as well as combinations of processes and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowcharts and / or block diagrams. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0131] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0132] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0133] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0134] Memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

[0135] Computer-readable media includes permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media (transitory media), such as modulated data signals and carrier waves.

[0136] It should also be noted that the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus that includes a series of elements includes not only those elements but also other elements not explicitly listed, or includes elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, an element defined by the phrase "comprises a ..." does not exclude the presence of other identical elements in the process, method, commodity, or apparatus that includes the element.

[0137] Those skilled in the art will appreciate that the embodiments of this specification may be provided as methods, systems, or computer program products. Thus, this specification may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Furthermore, this specification may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0138] This specification may be described in the general context of computer-executable instructions, such as program modules, executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, and the like that perform specific tasks or implement specific abstract data types. This specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices connected through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media, including storage devices.

[0139] The various embodiments in this specification are described in a progressive manner. Similar parts between the various embodiments can be referred to in conjunction with each other. Each embodiment focuses on the differences between the other embodiments. In particular, the system embodiments are generally similar to the method embodiments, so the description is relatively simple. For relevant parts, refer to the description of the method embodiments.

[0140] The foregoing is merely an example of the present invention and is not intended to limit the present invention. Various modifications and variations are possible for those skilled in the art. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of the present invention are intended to be included within the scope of the claims of the present invention.

Claims

1. A method for uploading multimedia information, characterized in that: include: The client obtains at least one multimedia information collected by a camera set on the first device, and the client is installed in the first device; identifying, by the camera, at least one preview area for uploading multimedia information contained in a display interface displayed by the second device; For each preview area displayed in the display interface, generating a virtual import control for the preview area in a screen used by the first device to display the display interface; For each virtual import control, in response to a preset operation performed by a user on the virtual import control, multimedia information that needs to be imported into a preview area corresponding to the virtual import control in the display interface is determined as target multimedia information, and identification information of the virtual import control and the target multimedia information are transmitted to the second device, so that the second device determines, based on the identification information, a preview area corresponding to the virtual import control in the display interface as a target preview area, and imports the target multimedia information into the target preview area, so as to upload the target multimedia information through the target preview area.

2. The method according to claim 1, characterized in that Identifying, by the camera, at least one preview area for uploading multimedia information contained in a display interface displayed by the second device, specifically includes: Collecting, by the camera, image data including the display interface displayed by the second device; Extracting feature points from the image data, and comparing the extracted feature points with pre-stored standard feature points corresponding to the preview area; At least one preview area is identified from the image data according to the comparison result.

3. The method according to claim 1, characterized in that For each preview area displayed in the display interface, generating a virtual import control for the preview area in a screen used by the first device to display the display interface specifically includes: For each preview area displayed in the display interface, determining a physical coordinate of a preset anchor point of the preview area in a pre-constructed three-dimensional physical coordinate system as a first physical coordinate; According to the first physical coordinates and the acquired three-dimensional model of the virtual import control corresponding to the preview area, determine the physical coordinates of the virtual import control corresponding to the preview area in the three-dimensional physical coordinate system as the second physical coordinates; Determine, according to the second physical coordinates and a predetermined coordinate conversion matrix, pixel coordinates of the virtual import control corresponding to the preview area in the image coordinate system corresponding to the screen as the pixel coordinates of the virtual import control corresponding to the preview area, wherein the coordinate conversion matrix is ​​used to represent a coordinate conversion relationship between the three-dimensional physical coordinate system and the image coordinate system; According to the pixel coordinates of the virtual import control corresponding to the preview area and the three-dimensional model of the virtual import control corresponding to the preview area, the virtual import control for the preview area is rendered and generated in the picture.

4. The method according to claim 3, characterized in that Determining the physical coordinates of the preset anchor point of the preview area in the pre-constructed three-dimensional physical coordinate system as the first physical coordinates specifically includes: The center position of the preview area is determined as a preset anchor point of the preview area, and the physical coordinates of the preset anchor point of the preview area in a pre-constructed three-dimensional physical coordinate system are used as first physical coordinates.

5. The method according to claim 3, characterized in that The identification information of the virtual import control includes: the pixel coordinates of the virtual import control in the image coordinate system corresponding to the picture; The step of transmitting the identification information of the virtual import control and the target multimedia information to the second device so that the second device determines, according to the identification information, a preview area corresponding to the virtual import control in the display interface as a target preview area, specifically includes: The identification information of the virtual import control and the target multimedia information are transmitted to the second device, so that the second device determines the physical coordinates of the virtual import control in the three-dimensional physical coordinate system as the third physical coordinates according to the pixel coordinates of the virtual import control in the image coordinate system corresponding to the screen and a predetermined coordinate transformation matrix, and determines the preview area corresponding to the virtual import control in the display interface as the target preview area according to the third physical coordinates.

6. The method according to claim 1, characterized in that Acquiring at least one multimedia information collected by a camera set based on the first device specifically includes: In response to the information processing rule selected by the user, the camera is started, and multimedia information about the target object is collected through the camera, wherein the information processing rule is used to indicate an upload standard specified when uploading multimedia information; According to the information processing rule, each piece of multimedia information collected is processed to obtain at least one piece of multimedia information that complies with the information processing rule.

7. The method according to claim 1, characterized in that Transmitting the identification information of the virtual import control and the target multimedia information to the second device specifically includes: The identification information of the virtual import control and the target multimedia information are transmitted to the second device through a communication connection method pre-established between the first device and the second device, and the communication connection method includes a wireless communication connection, and the wireless communication connection includes: at least one of a wireless local area network WLAN direct connection and Bluetooth.

8. A method for uploading multimedia information, characterized in that: include: The second device receives identification information of the virtual import control sent by the client, and target multimedia information, wherein the target multimedia information is multimedia information that needs to be imported into a preview area corresponding to the virtual import control in a display interface displayed by the second device, determined by the client for each virtual import control in response to a preset operation performed by the user on the virtual import control, from at least one multimedia information collected by the first device through a camera, the identification information is identification information of the virtual import control on which the user has performed the preset operation, the virtual import control is generated in a screen of the first device for displaying the display interface, the virtual import control corresponds to a preview area for uploading multimedia information contained in the display interface, and the client is installed in the first device; According to the identification information, determining a preview area corresponding to the virtual import control in the display interface as a target preview area; The target multimedia information is imported into the target preview area, so as to upload the target multimedia information through the target preview area.

9. The method according to claim 8, characterized in that The identification information of the virtual import control includes: the pixel coordinates of the virtual import control in the image coordinate system corresponding to the picture; Determining, according to the identification information, a preview area corresponding to the virtual import control in the display interface as a target preview area, specifically includes: Determine the physical coordinates of the virtual import control in a pre-constructed three-dimensional physical coordinate system as a third physical coordinate according to the pixel coordinates of the virtual import control in the image coordinate system corresponding to the screen and a predetermined coordinate conversion matrix, wherein the coordinate conversion matrix is ​​used to represent the coordinate conversion relationship between the three-dimensional physical coordinate system and the image coordinate system; According to the third physical coordinate, a preview area corresponding to the virtual import control in the display interface is determined as a target preview area.

10. A multimedia information uploading device, characterized in that: include: An acquisition module, used to acquire at least one multimedia information collected by a camera set on a first device, wherein the client is installed on the first device; A preview area identification module, used to identify, through the camera, at least one preview area for uploading multimedia information contained in the display interface displayed by the second device; A virtual import control generation module, configured to generate, for each preview area displayed in the display interface, a virtual import control for the preview area in a screen used by the first device to display the display interface; The transmission module is used to determine, for each virtual import control, in response to a preset operation performed by a user on the virtual import control, multimedia information that needs to be imported into a preview area corresponding to the virtual import control in the display interface as target multimedia information, and transmit identification information of the virtual import control and the target multimedia information to the second device, so that the second device determines, according to the identification information, a preview area corresponding to the virtual import control in the display interface as the target preview area, and imports the target multimedia information into the target preview area, so as to upload the target multimedia information through the target preview area.

11. A device for uploading multimedia information, characterized in that: include: a receiving module, configured to receive identification information of a virtual import control and target multimedia information sent by a client, wherein the target multimedia information is multimedia information that needs to be imported into a preview area corresponding to the virtual import control in a display interface displayed by the second device, determined by the client for each virtual import control in response to a preset operation performed by a user on the virtual import control, from at least one multimedia information collected by the first device through a camera, the identification information is identification information of the virtual import control on which the user has performed the preset operation, the virtual import control is generated in a screen of the first device for displaying the display interface, the virtual import control corresponds to the preview area for uploading multimedia information contained in the display interface, and the client is installed in the above-mentioned first device; A determination module, configured to determine, according to the identification information, a preview area corresponding to the virtual import control in the display interface as a target preview area; The uploading module is used to import the target multimedia information into the target preview area so as to upload the target multimedia information through the target preview area.

12. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the method described in any one of claims 1 to 7 or 8 to 9 is implemented.

13. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the method described in any one of claims 1 to 7 or 8 to 9 is implemented.

Images