Photo synthesis method, device, electronic device and storage medium for smart TV

Through the photo synthesis method of smart TV, combined with screenshot and shooting functions, the third image is generated, which solves the problem of independence of screenshot editing on smart TVs and improves user experience and editing efficiency.

CN115314741BActive Publication Date: 2024-12-31SHENZHEN KONKA ELECTRONIC TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210933935.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-08-04
Publication Date
2024-12-31
Estimated Expiration
2042-08-04

AI Technical Summary

Technical Problem

The existing smart TV's screenshot and image editing functions are independent, and it is impossible to quickly and directly edit the screen pictures based on screenshots. The shooting and screenshot functions are separated, making it difficult to combine editing.

Method used

By implementing the photographic synthesis method on a smart TV, the first image obtained by screenshot and the second image captured are used, combined with the background coordinate system and the camera area, a third image is generated and edited thereon, so as to realize the screenshot image Quick edit.

Benefits of technology

Improves the user experience, realizes quick and easy editing of screenshots on smart TVs, and combines screenshot and shooting functions to simplify the editing process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115314741B_ABST
    Figure CN115314741B_ABST
Patent Text Reader

Abstract

The present application provides a method, device, electronic device and storage medium for photo synthesis of a smart TV; applied to a smart TV, the smart TV includes a TV screen and a camera; the method includes: taking a screenshot of the TV screen to obtain a first image, and displaying the first image on the TV screen; in response to executing a preset startup instruction, setting a background coordinate system for the first image, and generating a camera area covering the first image; calling the camera to shoot, and displaying a second image obtained by shooting in the camera area; synthesizing the first image and the second image covering the first image into a third image. It can be seen that the method combines screenshot, photo and picture editing, and on the basis of realizing screenshot at any time, quickly and directly edits the captured screen pictures, getting rid of the tedious operation of repeatedly importing screenshots and photos into separate editing programs.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Embodiments of the present application relate to the technical field of smart televisions, and more particularly to a method, device, electronic device, and storage medium for photo synthesis of a smart television. Background Art

[0002] The related smart TV picture editing method, since screenshot and picture editing are independent operating procedures, the screenshot function and picture editing are also independent of the smart TV's shooting function. It is often necessary to import the captured pictures, or screenshots of the TV screen, etc. into the corresponding picture editing application for editing. It is impossible to quickly and directly edit the captured screen pictures based on screenshots at any time.

[0003] Based on this, a solution is needed that can combine TV screen screenshots, picture editing and smart TV photography to achieve a quick and convenient way to edit the captured pictures. Summary of the invention

[0004] In view of this, the purpose of the present application is to propose a method, device, electronic device and storage medium for photo synthesis of a smart TV.

[0005] Based on the above purpose, the present application provides a photo synthesis method for a smart TV, which is applied to a smart TV, wherein the smart TV includes a TV screen and a camera;

[0006] The method comprises:

[0007] Taking a screenshot of the television screen to obtain a first image, and displaying the first image on the television screen;

[0008] In response to executing a preset start instruction, a background coordinate system is set for the first image, and a camera area covered on the first image is generated;

[0009] Calling the camera to shoot, and displaying a second image obtained by shooting in the camera area;

[0010] The first image and the second image overlaid on the first image are combined into a third image.

[0011] Further, generating a camera area covered on the first image includes:

[0012] Determine the generated contour of the imaging area from a plurality of preset different contours;

[0013] Based on the outline, the generated imaging area is placed in the background coordinate system.

[0014] Further, placing the generated camera area in the background coordinate system includes:

[0015] Setting a plurality of calibration points in the contour;

[0016] Determining the two-dimensional camera coordinates of each calibration point in a camera coordinate system of the camera;

[0017] Determine the two-dimensional background coordinates of the origin of the camera coordinate system in the background coordinate system;

[0018] The two-dimensional background coordinates of each calibration point are determined according to the two-dimensional background coordinates of the origin.

[0019] Further, after generating the imaging area covered on the first image, the method further includes:

[0020] In the first image, the imaging area is adjusted based on the background coordinate system.

[0021] Further, adjusting the imaging area based on the background coordinate system includes:

[0022] Adjusting the position of the imaging area in the first image by moving the imaging area in the background coordinate system;

[0023] The size ratio of the imaging area is adjusted by stretching the imaging area in the background coordinate system.

[0024] Further, adjusting the size ratio of the camera area by stretching the camera area in the background coordinate system includes:

[0025] In response to starting to stretch the contour of the imaging area, adjusting the size of the area of ​​the imaging area;

[0026] In response to stretching the second picture in the camera area, the size of the outline is kept unchanged, and the size of the shooting range displayed by the second picture in the camera area is adjusted.

[0027] Furthermore, after the third image is synthesized, the method further includes:

[0028] In response to starting a preset editing instruction, generating a text editing area in the third image;

[0029] Using the text editing area, characters are generated in the third image.

[0030] Based on the same inventive concept, the present application also provides a photo synthesis device for a smart TV, including: a screenshot module, a camera area generation module, a shooting module and a synthesis module;

[0031] The screenshot module is configured to take a screenshot of the TV screen to obtain a first image, and display the first image on the TV screen;

[0032] The camera area generation module is configured to, in response to executing a preset start instruction, set a background coordinate system for the first image and generate a camera area covered on the first image;

[0033] The shooting module is configured to call the camera to shoot, and display the second image obtained by shooting in the shooting area;

[0034] The synthesis module is configured to synthesize the first image and the second image overlaid on the first image into a third image.

[0035] Based on the same inventive concept, the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the photo synthesis method for a smart TV as described in any one of the above items is implemented.

[0036] Based on the same inventive concept, the present application also provides a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the photo synthesis method of the smart TV as described above.

[0037] From the above, it can be seen that the photo synthesis method, device, electronic device and storage medium for the smart TV provided by the present application are based on the first image obtained by taking a screenshot of the TV screen and the second image obtained by shooting, and comprehensively consider the respective coordinate systems of the first image and the camera area, so as to cover the camera area on the first image, so that the photos taken by the smart TV can be directly synthesized on the basis of the screenshot of the smart TV screen to obtain a third image synthesized by the first image and the second image, thereby realizing quick and convenient editing of the screenshot first image and improving the user experience in terms of immediacy. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the technical solutions in the present application or related technologies, the drawings required for use in the embodiments or related technical descriptions are briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0039] Figure 1 This is a flow chart of a method for combining photos of a smart TV according to an embodiment of the present application;

[0040] Figure 2AThis is an example screenshot of the method for combining photos of a smart TV according to an embodiment of the present application;

[0041] Figure 2B An example diagram of the camera area generation of the camera synthesis method of the smart TV in the embodiment of the present application;

[0042] Figure 2C This is an example diagram of photo synthesis of the photo synthesis method of the smart TV according to an embodiment of the present application;

[0043] Figure 2D This is an example diagram of character generation in the method for photographing and synthesizing a smart TV according to an embodiment of the present application;

[0044] Figure 3 This is a schematic diagram of the structure of a photo synthesis device of a smart TV according to an embodiment of the present application;

[0045] Figure 4 This is a schematic diagram of the structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0046] In order to make the objectives, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below in combination with specific embodiments and with reference to the accompanying drawings.

[0047] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present application should be understood by people with ordinary skills in the field to which the present application belongs. The "first", "second" and similar words used in the embodiments of the present application do not indicate any order, quantity or importance, but are only used to distinguish different components. "Include" or "comprising" and similar words mean that the elements or objects appearing before the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects.

[0048] As described in the background technology section, the photo synthesis method of related smart TVs is still difficult to meet the needs of users in actual applications.

[0049] In the process of implementing this application, the applicant discovered that the main problem with the photo synthesis method of the related smart TV is that the image processing method of the related smart TV often requires the captured pictures, or screenshots of the TV screen, to be imported into the corresponding image editing application for editing. Otherwise, the captured pictures and the captured screen pictures can only be edited independently, and the captured screen pictures cannot be quickly and directly edited based on the screenshots at any time.

[0050] It can be seen that the screenshot and picture editing of related smart TVs are independent operating procedures. In addition, the screenshot function and picture editing are also independent of the shooting function of the smart TV, making it difficult for users to directly combine the taken photos with the screenshots for editing.

[0051] Furthermore, the applicant also found in the research that in the image processing method of related smart TVs, due to the characteristics of TV programs, it is often not convenient to pause during playback. Therefore, after taking a screenshot of the TV screen, the user needs to exit the screenshot function and then shoot again, and after the shooting is completed, enter another independent editing program.

[0052] It can be seen that the relevant image editing method is to import the image to be edited into the image editing application and then edit it. This method is obviously not suitable for smart TVs, and an operation method that can quickly and conveniently edit the captured images is required.

[0053] In view of this, one or more embodiments of the present application provide a method for synthesizing photos of a smart TV, which is based on the combination of the screenshot function and the shooting function of the smart TV.

[0054] The embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0055] In the embodiment of the present application, the smart TV specifically includes a TV screen, a camera, and a program for calling corresponding hardware devices and running various functional applications.

[0056] Furthermore, the smart TV has a camera function based on the configured camera, and can use the camera to take photos, obtain and store photos; it also has a screenshot function, that is, it can capture the current picture on the TV screen of the smart TV, obtain and store the captured picture.

[0057] refer to Figure 1 A method for synthesizing photos of a smart TV according to an embodiment of the present application comprises the following steps:

[0058] Step S101: Capture the TV screen to obtain a first image, and display the first image on the TV screen.

[0059] In an embodiment of the present application, firstly, a screenshot of a TV picture on a TV screen is taken using the above-mentioned smart TV with a screenshot function.

[0060] Specifically, the smart TV will capture the TV picture on the current TV screen by starting a related screen capture program.

[0061] Furthermore, after the capture operation is completed, the smart TV will automatically determine whether the captured image is effectively generated.

[0062] Furthermore, when the captured image is not successfully generated, the operation is terminated directly.

[0063] Further, when it is detected that the captured picture is successfully generated, the sub-step of “previewing the captured picture” is executed.

[0064] Specifically, when it is determined that the picture is successfully captured, a preview window is generated on the TV screen of the smart TV, and the successfully captured picture is displayed in the preview window.

[0065] In this embodiment, the captured picture displayed in the current preview window is used as the first image.

[0066] Furthermore, the first image may be placed into the first memory object through a preset first path.

[0067] by Figure 2A As a specific example, it can be seen that Figure 2A The figure shows a picture displayed on the TV screen of a smart TV. After successfully obtaining the screenshot, a preview window will be generated on the TV screen, and the captured first image will be displayed in the preview window. Figure 2A Image A in .

[0068] Step S102: in response to executing a preset start instruction, setting a background coordinate system for the first image and generating a camera area covering the first image.

[0069] In an embodiment of the present application, based on the first image obtained in the above step S101, the camera area can be displayed in the generated preview window to serve as the basis for the shooting operation in the following steps.

[0070] Specifically, based on the generated preview window, a first button that triggers the start instruction is also generated in the preview window.

[0071] Furthermore, by clicking the first button, a preset start instruction can be directly triggered, and the start instruction is specifically used to generate a camera area.

[0072] Specifically, after the start instruction is triggered, a background coordinate system may be set for the first image obtained above.

[0073] The background coordinate system may be set as a two-dimensional coordinate system and used to calibrate the specific coordinates of each point in the first image, and the origin of the coordinate system may be customized according to different specific circumstances.

[0074] Furthermore, the shape of the camera area to be generated needs to be specified first; in the preview window, a variety of different outlines will be displayed for the user to choose, each of which can be used to specify the shape of the camera area.

[0075] In a specific example, Figure 2B As shown, in the generated preview window, a photo button is also generated. By clicking the photo button, the above-mentioned start instruction can be triggered, and multiple preset outlines can be displayed, such as a narrow ellipse, a wide ellipse, a rectangle, and a diamond, etc.

[0076] Furthermore, after the user specifies the shape of the outline for the imaging area, the imaging area having the specified outline may be generated on the first image.

[0077] Specifically, the imaging area may be placed in the background coordinate system of the first image.

[0078] Among them, the image displayed in the camera area is obtained by directly calling the camera for shooting. Therefore, the coordinate system of the camera area is the camera coordinate system of the camera itself, that is, the coordinates of each point in the camera area are the coordinates in the camera coordinate system.

[0079] Based on this, it can be seen that when the imaging area is placed in the background coordinate system of the first image, each point in the imaging area that belongs to the camera coordinate system needs to be adapted to the background coordinate system.

[0080] Specifically, multiple calibration points can be set on the contour of the camera area, wherein the positions of the calibration points can be selected according to the selected contour and actual conditions. In some other embodiments, multiple positions of setting calibration points can be pre-fixed for different contours; the number of calibration points can also be set according to specific conditions.

[0081] Furthermore, the coordinates of each calibration point in the camera coordinate system are determined.

[0082] It can be seen that even if the camera coordinate system is a three-dimensional coordinate system, since the first image obtained by screenshot is a two-dimensional image, and the background coordinate system is also a two-dimensional coordinate system, when the camera coordinate system is a three-dimensional coordinate system, the dimension that vertically passes through the camera area can be removed to obtain a two-dimensional camera coordinate system; or, in some other embodiments, the camera coordinate system can be directly set to a two-dimensional coordinate system.

[0083] Furthermore, the coordinates of each calibration point in the two-dimensional camera coordinate system may be determined and used as the two-dimensional camera coordinates of each calibration point.

[0084] Furthermore, the origin of the two-dimensional camera coordinate system is determined, and the coordinates of the origin in the background coordinate system are determined and used as the two-dimensional background coordinates of the origin.

[0085] Furthermore, according to the two-dimensional background coordinates of the origin, the difference between the origin of the camera coordinate system and the origin of the background coordinate system in the background coordinate system can be determined and used as the origin difference.

[0086] Further, based on the determined first difference and the difference between each calibration point and the origin of the camera coordinate system, the coordinates of each calibration point in the background coordinate system can be determined and used as the two-dimensional background coordinates of each calibration point.

[0087] Furthermore, based on the determined two-dimensional background coordinates of each calibration point, a camera area with a specified outline may be generated in the background coordinate system, and the camera area may be overlaid on the first image.

[0088] In a specific example, Figure 2B As shown, based on the image A generated in the preview window, a wide ellipse is selected as the outline of the photographing area from among the displayed multiple outlines.

[0089] Furthermore, a camera area with a wide elliptical outline may be generated in image A, and the camera area is overlaid on image A.

[0090] Furthermore, after the imaging area covering the first image is generated, the imaging area may be adjusted, that is, the position and size ratio of the imaging area may be adjusted.

[0091] Specifically, the position of the camera area in the first image can be changed by moving the camera area in a dragging manner.

[0092] It can be seen that when the camera area is moved, its origin difference changes.

[0093] Furthermore, for each calibration point, the new two-dimensional background coordinates of each calibration point can be determined according to the difference between its two-dimensional camera coordinates and the changed origin, that is, the two-dimensional background coordinates of each calibration point after moving in the background coordinate system.

[0094] Furthermore, based on the determined two-dimensional background coordinates after the movement, the position of the entire imaging area after the movement can be determined.

[0095] In some embodiments, the size ratio of the camera area can also be adjusted by stretching.

[0096] The size ratio of the camera area may specifically include: the size of the camera area, and the size of a shooting range that can be displayed by the camera in the camera area.

[0097] Specifically, when the outline of the imaging area is stretched, the area of ​​the imaging area may be reduced according to a preset proportional method.

[0098] It can be seen that according to the change ratio between the origin of the camera coordinate system and the origin of the background coordinate system in the horizontal and vertical coordinates, the change ratio of each calibration point on the contour in the background coordinate system can be determined, thereby determining the change of the contour of the camera area in the background coordinate system, and then determining the size of the area of ​​the camera area after the change.

[0099] Furthermore, when the interior of the camera area is stretched, the size of the camera area, that is, the size of the outline, can remain unchanged, and at the same time, the shooting range of the camera displayed in the camera area can be enlarged or reduced according to a preset proportion.

[0100] Specifically, when the interior of the camera area is stretched, since the outline of the camera area is not stretched, the two-dimensional background coordinates of each calibration point in the background coordinate system can be kept unchanged, that is, the outline of the current camera area is not expanded or reduced.

[0101] Furthermore, the shooting range presented by the camera area can be directly expanded or reduced to adjust the shooting angle.

[0102] It can be seen that by determining the relationship between the origin of the camera coordinate system and the origin of the background coordinate system, and determining the relationship between each calibration point in the camera coordinate system and the background coordinate system, the camera area can be covered on the first image and the camera area can be moved and scaled.

[0103] Step S103: calling the camera to shoot, and displaying a second image obtained by shooting in the camera area.

[0104] In an embodiment of the present application, based on the camera area generated as described above, shooting can be performed by calling the camera of the smart TV.

[0105] Specifically, the camera of the smart TV can be called to shoot through the hardware abstraction layer interface, and the shot photo is used as the second image and is put into the second memory object through a preset second path.

[0106] Furthermore, by calling the second memory object in the preview window, the captured photo can be displayed in the outline of the camera area.

[0107] Step S104: synthesize the first image and the second image overlaid on the first image into a third image.

[0108] In an embodiment of the present application, based on the first image and the second image obtained as described above, a screen displayed based on the current positional relationship may be synthesized to obtain a third image synthesized by combining the photo and the screenshot.

[0109] In a specific example, Figure 2C As shown, the image B in the preview window is an image obtained by combining the image A with the photo taken in the camera area.

[0110] Furthermore, the obtained image can be saved through a preset third path.

[0111] The first path, the second path and the third path may point to the same storage location or different storage locations, and the memory objects may be the same memory object or different memory objects.

[0112] In some other embodiments, editable text may be further added to the generated third image.

[0113] Specifically, a text editing area may be generated in the third image by starting a preset editing instruction.

[0114] Furthermore, the user can edit the text editing area through the remote control of the smart TV.

[0115] In this text editing area, text characters and punctuation characters can be generated through editing.

[0116] Specifically, a second button may be set in the preview window, and the thread of the editing area may be started by clicking the second button.

[0117] In a specific example, Figure 2D As shown, in the preview window, based on image B, by clicking the edit button, the text editing area can be started. By editing in the text editing area, three letter characters including W, O, W and ! and one punctuation character are added to obtain the edited image C.

[0118] In some other embodiments, the generated third image, or the third image after text editing, can be forwarded by calling other social applications currently available on the smart TV.

[0119] Specifically, a third button may be set in the preview window, and the thread of opening other social applications may be started by clicking the third button.

[0120] Furthermore, the third image may be forwarded or published through other social applications.

[0121] In some specific examples, such as Figure 2DAs shown, in the preview window, by clicking the publish button, a thread of opening other social applications can be started to jump to other social applications, and the image C can be forwarded or published on other social applications.

[0122] It can be seen that the photo synthesis method of the smart TV in the embodiment of the present application is based on the first image obtained by taking a screenshot of the TV screen and the second image obtained by shooting, and comprehensively considers the respective coordinate systems of the first image and the camera area, so as to cover the camera area on the first image, so that the photos taken by the smart TV can be directly synthesized on the basis of the screenshot of the smart TV screen to obtain a third image synthesized by the first image and the second image, thereby realizing fast and convenient editing of the screenshot first image and improving the user experience in terms of immediacy.

[0123] It should be noted that the method of the embodiment of the present application can be performed by a single device, such as a computer or server. The method of this embodiment can also be applied to a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only perform one or more steps in the method of the embodiment of the present application, and the multiple devices will interact with each other to complete the described method.

[0124] It should be noted that the above describes some embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the above embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0125] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, an embodiment of the present application also provides a photo synthesis device for a smart TV.

[0126] refer to Figure 4 The photo synthesis device 3100 of the smart TV includes: a screenshot module 3101, a camera area generation module 3102, a shooting module 3103 and a synthesis module 3104;

[0127] The screenshot module 3101 is configured to take a screenshot of the TV screen to obtain a first image, and display the first image on the TV screen;

[0128] The camera region generating module 3102 is configured to, in response to executing a preset start instruction, set a background coordinate system for the first image and generate a camera region covered on the first image;

[0129] The shooting module 3103 is configured to call the camera to shoot, and display the second image obtained by shooting in the shooting area;

[0130] The synthesis module 3104 is configured to synthesize the first image and the second image overlaid on the first image into a third image.

[0131] For the convenience of description, the above devices are described in terms of functions and are divided into various modules. Of course, when implementing the embodiments of the present application, the functions of each module can be implemented in the same or multiple software and / or hardware.

[0132] The device of the above embodiment is used to implement the corresponding smart TV photo synthesis method in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be repeated here.

[0133] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, an embodiment of the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the photo synthesis method of the smart TV as described in any of the above embodiments is implemented.

[0134] Figure 4 A more specific schematic diagram of the hardware structure of an electronic device provided in this embodiment is shown, and the device may include: a processor 1010, a memory 1020, an input / output interface 1030, a communication interface 1040, and a bus 1050. The processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040 are connected to each other through the bus 1050 in the device.

[0135] The processor 1010 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application.

[0136] The memory 1020 may be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 1020 may store an operating system and other application programs. When the technical solution provided in the embodiment of the present application is implemented by software or firmware, the relevant program code is stored in the memory 1020 and is called and executed by the processor 1010.

[0137] The input / output interface 1030 is used to connect the input / output module to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.

[0138] The communication interface 1040 is used to connect a communication module (not shown) to realize communication interaction between the device and other devices. The communication module can realize communication through a wired mode (such as USB, network cable, etc.) or a wireless mode (such as mobile network, WIFI, Bluetooth, etc.).

[0139] The bus 1050 includes a path that transmits information between the various components of the device (eg, the processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040).

[0140] It should be noted that, although the above device only shows the processor 1010, the memory 1020, the input / output interface 1030, the communication interface 1040 and the bus 1050, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include the components necessary for implementing the embodiment of the present application, and does not necessarily include all the components shown in the figure.

[0141] The device of the above embodiment is used to implement the corresponding smart TV photo synthesis method in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be repeated here.

[0142] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present application also provides a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the photo synthesis method of the smart TV as described in any of the above embodiments.

[0143] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.

[0144] The computer instructions stored in the storage medium of the above embodiment are used to enable the computer to execute the photo synthesis method of the smart TV as described in any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.

[0145] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present application (including the claims) is limited to these examples. In line with the concept of the present application, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of different aspects of the embodiments of the present application as described above, which are not provided in detail for the sake of simplicity.

[0146] In addition, to simplify the description and discussion, and in order not to make the embodiments of the present application difficult to understand, the known power supply / ground connection with the integrated circuit (IC) chip and other components may or may not be shown in the provided drawings. In addition, the device can be shown in the form of a block diagram to avoid making the embodiments of the present application difficult to understand, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform on which the embodiments of the present application will be implemented (that is, these details should be fully within the scope of understanding of those skilled in the art). In the case of elaborating specific details (e.g., circuits) to describe exemplary embodiments of the present application, it is obvious to those skilled in the art that the embodiments of the present application can be implemented without these specific details or when these specific details are changed. Therefore, these descriptions should be considered illustrative rather than restrictive.

[0147] Although the present application has been described in conjunction with specific embodiments of the present application, many replacements, modifications and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.

[0148] The embodiments of the present application are intended to cover all such substitutions, modifications and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present application should be included in the protection scope of the present application.

Claims

1. A method for synthesizing photos of a smart TV, characterized in that: Applied to a smart TV, the smart TV comprising a TV screen and a camera; The method comprises: Taking a screenshot of the television screen to obtain a first image, and displaying the first image on the television screen; In response to executing a preset start instruction, a background coordinate system is set for the first image, and a camera area covered on the first image is generated; Calling the camera to shoot, and displaying a second image obtained by shooting in the camera area; synthesizing the first image and the second image overlaid on the first image into a third image; The generating of the imaging area covered on the first image comprises: Determine the generated contour of the imaging area from a plurality of preset different contours; Based on the outline, placing the generated imaging area in the background coordinate system; Placing the generated imaging area in the background coordinate system includes: Setting a plurality of calibration points in the contour; Determining the two-dimensional camera coordinates of each calibration point in a camera coordinate system of the camera; Determine the two-dimensional background coordinates of the origin of the camera coordinate system in the background coordinate system; The two-dimensional background coordinates of each calibration point are determined according to the two-dimensional background coordinates of the origin.

2. The method according to claim 1, characterized in that After generating the imaging area covered on the first image, the method further includes: In the first image, the imaging area is adjusted based on the background coordinate system.

3. The method according to claim 2, characterized in that The adjusting the imaging area based on the background coordinate system comprises: Adjusting the position of the imaging area in the first image by moving the imaging area in the background coordinate system; The size ratio of the imaging area is adjusted by stretching the imaging area in the background coordinate system.

4. The method according to claim 3, characterized in that The adjusting the size ratio of the camera area by stretching the camera area in the background coordinate system includes: In response to starting to stretch the contour of the imaging area, adjusting the size of the area of ​​the imaging area; In response to stretching the second image in the camera area, the size of the outline is kept unchanged, and the size of the shooting range displayed by the second image in the camera area is adjusted.

5. The method according to claim 1, characterized in that After the synthesis into the third image, the method further includes: In response to starting a preset editing instruction, generating a text editing area in the third image; Using the text editing area, characters are generated in the third image.

6. A photo synthesis device for a smart TV, comprising: Screen capture module, camera area generation module, shooting module and synthesis module; The screenshot module is configured to take a screenshot of the TV screen to obtain a first image, and display the first image on the TV screen; The camera area generation module is configured to, in response to executing a preset start instruction, set a background coordinate system for the first image and generate a camera area covered on the first image; The shooting module is configured to call the camera to shoot, and display the second image obtained by shooting in the shooting area; The synthesis module is configured to synthesize the first image and the second image overlaid on the first image into a third image; The generating of the imaging area covered on the first image comprises: Determine the generated contour of the imaging area from a plurality of preset different contours; Based on the outline, placing the generated imaging area in the background coordinate system; Placing the generated imaging area in the background coordinate system includes: Setting a plurality of calibration points in the contour; Determining the two-dimensional camera coordinates of each calibration point in a camera coordinate system of the camera; Determine the two-dimensional background coordinates of the origin of the camera coordinate system in the background coordinate system; The two-dimensional background coordinates of each calibration point are determined according to the two-dimensional background coordinates of the origin.

7. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable by the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 5 is implemented.

8. A non-transitory computer-readable storage medium, characterized in that: The non-transitory computer-readable storage medium stores computer instructions for causing a computer to execute the method according to any one of claims 1 to 5.