A display device and a photographing method based on user gesture triggering

By detecting the similarity between the user's posture and the target posture in the display device, the photo is automatically triggered, and the problem of redundant items and abnormal body postures in TV photography is solved, and a natural automatic photo group effect is achieved.

CN114302200BActive Publication Date: 2024-11-19HISENSE VISUAL TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202110720108.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-06-28
Publication Date
2024-11-19
Estimated Expiration
2041-06-28

AI Technical Summary

Technical Problem

In a TV photo scene, when a user uses a remote control, voice commands or gestures to trigger a photo, redundant items or abnormal body postures often appear in the photo, which cannot meet the user's needs.

Method used

By setting the camera and controller in the display device, the similarity between the user's current limb posture and the preset target limb posture is detected. When the similarity reaches the preset threshold, the photo will be automatically triggered and a group photo will be generated to reduce redundant items and abnormalities. The appearance of body posture.

Benefits of technology

Automatic group photos are realized, reducing non-essential remote controls, abnormal user mouth shape and unnecessary limb postures in group photos, providing a more natural photo-taking experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114302200B_ABST
    Figure CN114302200B_ABST
Patent Text Reader

Abstract

The present application relates to the technical field of display devices, and in particular, to a display device and a method for taking photos based on user gesture triggering, which can solve the problem that in a TV photo-taking scene, when a user uses a remote control, voice command, or gesture to trigger taking photos, the photos always display redundant items or abnormal body gestures, and the photos cannot meet the needs of the user. The display device includes: a camera; a display; and a controller, which is configured to: when an object is within the detection range of the camera, obtain a target person included in the image; when the similarity between the current body gesture of the target person and the target body gesture reaches a preset threshold, control the user interface to display a group photo generated based on the posed photo and the target person, the group photo includes the target person and the group photo object, and the target person is displayed in the group photo as the current body gesture of the target person.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular, to a display device and a photographing method triggered based on a user's gesture. Background Art

[0002] TV photography refers to the process of smart TVs taking photos through their configured image acquisition devices, such as cameras, and displaying the photos on a large-size, high-resolution, and colorful TV screen. TV photography can better display photo effects and has family entertainment functions and social value.

[0003] In some TV photography implementations, the TV is equipped with a front camera that supports the photography function. When taking pictures, the user usually needs to operate a remote control to control and trigger the TV to take pictures; or needs to issue voice commands to control and trigger the TV to take pictures; or needs to use fixed gestures to control and trigger the TV to take pictures.

[0004] However, when using a remote control to trigger taking photos, the remote control will be displayed in the photos taken; when using voice commands to trigger taking photos, the user's mouth shape will appear abnormal in the photos taken; and when using gestures to trigger taking photos, the user will show unnecessary body gestures in the photos taken. Summary of the invention

[0005] In order to solve the problem that in TV photography scenarios, when users use a remote control, voice command, or gesture to trigger photography, the photos taken always display redundant objects or abnormal body postures, and the photos cannot meet user needs, the present application provides a display device and a photography method based on user gesture triggering.

[0006] The embodiment of the present application is implemented as follows:

[0007] A first aspect of an embodiment of the present application provides a display device, comprising: a camera, for acquiring images within its detection range; a display, capable of displaying a group photo, and a posed photo including a first object and a group photo object, wherein the first object is used to show a target body posture imitated by a user; a controller, configured to: when the user is within the detection range of the camera, acquire a target person contained in the image; and when the similarity between the current body posture of the target person and the target body posture reaches a preset threshold, control a user interface to display a group photo generated based on the posed photo and the target person, wherein the group photo includes the target person and the group photo object, and the target person is displayed in the group photo as the current body posture of the target person.

[0008] A second aspect of an embodiment of the present application provides a photo-taking method triggered by user posture, the method comprising: when the user is in a detection range, obtaining a target person included in an image of the user taken by a camera; when the similarity between the current body posture of the target person and the target body posture of the first object in a posed picture reaches a preset threshold, displaying a group photo generated based on the posed picture and the target person, the group photo comprising the target person and the group photo object, and the target person being displayed in the group photo as the current body posture of the target person.

[0009] The beneficial effects of the present application are as follows: by constructing a posed picture including a first object, a target body posture for imitation can be provided to the user; further, by acquiring the target person, the user's current body posture can be acquired and the automatic photo taking logic can be triggered; further, by acquiring the similarity between the current body posture and the target body posture, it can be determined whether to trigger automatic photo taking; further, by generating a group photo based on the posed picture and the target person, automatic group photo acquisition can be achieved, thereby reducing unnecessary remote controls, abnormal user mouth shapes, and unnecessary body postures in the group photo. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0011] Figure 1 shows a usage scenario of a display device according to some embodiments;

[0012] Figure 2 shows a hardware configuration block diagram of a control device 100 according to some embodiments;

[0013] Figure 3 shows a hardware configuration block diagram of a display device 200 according to some embodiments;

[0014] Figure 4 shows a software configuration diagram in a display device 200 according to some embodiments;

[0015] Figure 5 shows an icon control interface display diagram of an application in a display device 200 according to some embodiments;

[0016] Fig. 6A A schematic diagram showing a user interface of a display device according to an embodiment of the present application is shown;

[0017] Figure 6BA schematic diagram showing a user interface of a display device according to another embodiment of the present application is shown;

[0018] Figure 7 A schematic diagram of a posed photo user interface according to an embodiment of the present application is shown;

[0019] Fig. 8A A schematic diagram showing a user interface for realizing automatic group photo taking on a television according to an embodiment of the present application is shown;

[0020] Figure 8B A schematic diagram showing a user interface for realizing automatic group photo taking on a television according to another embodiment of the present application is shown;

[0021] Figure 8C A schematic diagram showing a user interface for realizing automatic group photo taking on a television according to another embodiment of the present application is shown;

[0022] Fig.8D A schematic diagram showing a user interface for realizing automatic group photo taking on a television according to another embodiment of the present application is shown;

[0023] Fig. 8E A schematic diagram showing a user interface for realizing automatic group photo taking on a television according to another embodiment of the present application is shown;

[0024] Fig. 9A A schematic diagram of an automatic group photo countdown user interface according to an embodiment of the present application is shown;

[0025] Fig. 9B A schematic diagram of an automatic group photo countdown user interface according to another embodiment of the present application is shown;

[0026] Fig. 10A A schematic diagram of a user interface for configuring a posed photo according to another embodiment of the present application is shown;

[0027] Fig. 10B A schematic diagram of a user interface for configuring a posed photo according to another embodiment of the present application is shown;

[0028] Fig.11A A schematic diagram showing another embodiment of the present application showing a display device identifying a user's limbs;

[0029] Fig. 11B A schematic diagram showing another embodiment of the present application showing a display device recognizing a user's limbs. DETAILED DESCRIPTION

[0030] In order to make the purpose and implementation method of the present application clearer, the exemplary implementation method of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, rather than all the embodiments.

[0031] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0032] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0033] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0034] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0035] Figure 1 FIG. 1 is a schematic diagram of an operation scenario between a display device and a control device according to an embodiment. Figure 1 As shown, the user can operate the display device 200 through the smart device 300 or the control apparatus 100 .

[0036] In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, and the display device 200 is controlled wirelessly or wired. The user may control the display device 200 by inputting user commands through buttons on the remote controller, voice input, control panel input, etc.

[0037] In some embodiments, a smart device 300 (such as a mobile terminal, a tablet computer, a computer, a laptop computer, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on the smart device.

[0038] In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300. For example, the user's voice command control can be directly received through a module for obtaining voice commands configured inside the display device 200, or the user's voice command control can be received through a voice control device set outside the display device 200.

[0039] In some embodiments, the display device 200 also communicates data with the server 400. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactions to the display device 200. The server 400 may be one cluster or multiple clusters, and may include one or more types of servers.

[0040] Figure 2 Schematically shows a block diagram of a configuration of the control device 100 according to an exemplary embodiment. Figure 2 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive input operation instructions from the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200.

[0041] Figure 3 A hardware configuration block diagram of a display device 200 according to an exemplary embodiment is shown.

[0042] In some embodiments, the display apparatus 200 includes at least one of a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0043] In some embodiments, the controller includes a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and a first interface to an nth interface for input / output.

[0044] In some embodiments, the display 260 includes a display screen component for presenting images, and a driving component for driving image display, which is used to receive image signals output from a controller, display video content, image content, and a menu control interface component and a user control UI interface.

[0045] In some embodiments, the display 260 may be a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

[0046] In some embodiments, the communicator 220 is a component for communicating with an external device or server according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.

[0047] In some embodiments, the user interface may be used to receive a control signal from the control device 100 (eg, an infrared remote controller, etc.).

[0048] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0049] In some embodiments, the external device interface 240 may include, but is not limited to, any one or more of the following: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It may also be a composite input / output interface formed by the above multiple interfaces.

[0050] In some embodiments, the tuner-demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

[0051] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0052] In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 can perform operations related to the object selected by the user command.

[0053] In some embodiments, the object may be any one of the selectable objects, such as a hyperlink, an icon or other operable controls. Operations related to the selected object include: displaying a page, document, image, etc. connected to the hyperlink, or executing a program corresponding to the icon.

[0054] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory, ROM), a first interface to an nth interface for input / output, a communication bus (Bus), etc.

[0055] CPU processor. Used to execute operating system and application instructions stored in the memory, and to execute various applications, data and content according to various interactive instructions received from external input, so as to finally display and play various audio and video content. CPU processor may include multiple processors. For example, it includes a main processor and one or more sub-processors.

[0056] In some embodiments, the graphics processor is used to generate various graphic objects, such as icons, operation menus, and user input command display graphics. The graphics processor includes an operator, which performs operations by receiving various interactive instructions input by the user and displays various objects according to display attributes; and a renderer, which renders various objects obtained based on the operator, and the rendered objects are used to be displayed on the display.

[0057] In some embodiments, the video processor is used to receive an external video signal and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal to obtain a signal that can be directly displayed or played on the display device 200.

[0058] In some embodiments, the video processor includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, etc. Among them, the demultiplexing module is used to demultiplex the input audio and video data stream. The video decoding module is used to process the demultiplexed video signal, including decoding and scaling processing. The image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator according to the user input or itself with the video image after scaling processing to generate an image signal for display. The frame rate conversion module is used to convert the input video frame rate. The display formatting module is used to receive the video output signal after frame rate conversion and change the signal to conform to the display format signal, such as outputting RGB data signal.

[0059] In some embodiments, the audio processor is used to receive an external audio signal, and perform decompression and decoding, as well as noise reduction, digital-to-analog conversion, and amplification processing according to a standard codec protocol of the input signal to obtain a sound signal that can be played in a speaker.

[0060] In some embodiments, the user may input a user command in a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor.

[0061] In some embodiments, "user interface" is a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. A common form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be an interface element such as an icon, window, or control displayed on a display screen of an electronic device, where a control can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0062] In some embodiments, the system of the display device may include a kernel, a command parser (shell), a file system, and an application. The kernel, shell, and file system together constitute the basic operating system structure, which allows users to manage files, run programs, and use the system. After power-on, the kernel starts, activates the kernel space, abstracts hardware, initializes hardware parameters, etc., runs and maintains virtual memory, schedulers, signals, and inter-process communication (IPC). After the kernel starts, the shell and user applications are loaded. After startup, the application is compiled into machine code to form a process.

[0063] See also Figure 4 In some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the Android runtime (Android runtime) and system library layer (referred to as "system runtime library layer"), and the kernel layer.

[0064] In some embodiments, at least one application is running in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. provided by the operating system, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0065] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Through the API interface, applications can access system resources and obtain system services during execution.

[0066] like Figure 4 As shown, in the embodiment of the present application, the application framework layer includes managers, content providers, etc., wherein the manager includes at least one of the following modules: an activity manager (ActivityManager) is used to interact with all activities running in the system; a location manager (Location Manager) is used to provide system services or applications with access to system location services; a package manager (Package Manager) is used to retrieve various information related to the application package currently installed on the device; a notification manager (NotificationManager) is used to control the display and clearing of notification messages; a window manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers, and desktop components on the user interface.

[0067] In some embodiments, the activity manager is used to manage the life cycle of each application and the common navigation back function, such as controlling the exit, opening, and back of the application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the display window changes (for example, reducing the display window, shaking the display, distorting the display, etc.).

[0068] In some embodiments, the system runtime layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system will run the C / C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.

[0069] In some embodiments, the kernel layer is a layer between hardware and software. Figure 4As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0070] In some embodiments, after the display device is started, the interface of the preset video-on-demand program can be directly entered. The interface of the video-on-demand program can be as follows: Figure 5 As shown in , at least a navigation bar 510 and a content display area located below the navigation bar 510 are included, and the content displayed in the content display area changes with the change of the selected control in the navigation bar. The program in the application layer can be integrated into the video-on-demand program and displayed through a control in the navigation bar, or further displayed after the application control in the navigation bar is selected.

[0071] In some embodiments, after the display device is started, it can directly enter the display interface of the last selected signal source, or the signal source selection interface, where the signal source can be a preset video on demand program, or at least one of an HDMI interface, a live TV interface, etc. After the user selects a different signal source, the display can display the content obtained from different signal sources.

[0072] The embodiments of the present application can be applied to various types of display devices (including but not limited to smart TVs, LCD TVs, etc.). The following will take the control scheme and user interface of a smart TV to trigger taking photos based on user gestures as an example to explain the display device and the method of taking photos based on user gesture triggering.

[0073] Fig. 6A A schematic diagram of a user interface of a display device according to an embodiment of the present application is shown.

[0074] The display device provided in the present application includes a display for displaying a user interface, and a controller. In some embodiments, the application UI interface may include, for example, four applications installed on the TV, namely, news headlines, cinema on demand, automatic group photo, karaoke, etc. By moving the focus on the display screen using a controller such as a remote control, different applications or other function buttons can be selected.

[0075] In some embodiments, the user interface may also display interactive elements, which may include, for example, a TV home page control, a search control, a message button control, a mailbox control, a browser control, a favorites control, a signal bar control, etc. By moving the focus on the display screen using a controller such as a remote control, different applications and function buttons can be selected.

[0076] In order to improve the convenience and image of the TV UI, in some embodiments, the controller of the display device in the embodiments of the present application controls the TV UI in response to the operation of the interactive element. For example, the user clicks the automatic group photo icon through a controller such as a remote control to activate the configuration user interface of the automatic group photo application, and display its UI on top of the global UI, so that the application component UI that controls the interactive element mapping becomes larger, or runs and displays in full screen.

[0077] In some embodiments, the interactive element may also be operated by a sensor, which may be, but is not limited to, an acoustic input sensor, such as a microphone configured with a display device, which may detect a voice command including an indication of the desired interactive element. For example, a user may use "Start automatic photo taking" or any other suitable identifier to identify the desired interactive element, and may also describe the desired action to be performed in relation to the desired interactive element. The controller may recognize the voice command and submit data representing the interaction to the UI or its processing component or engine.

[0078] Figure 6B A schematic diagram of a user interface of a display device according to another embodiment of the present application is shown.

[0079] In some embodiments, the user can control the focus of the display screen through a remote control and select the automatic photo-taking icon so that its icon is displayed with high brightness on the user interface of the TV display screen; then by clicking the high-brightness icon, the automatic photo-taking application configuration user interface with icon mapping can be opened.

[0080] It should be noted that the icons and texts on the UI interface in the embodiment of the present application are only used as examples to explain the display device and the photo-taking method triggered by the user gesture. The icons and texts on the UI interface in the accompanying drawings can also be implemented as other contents, and the accompanying drawings of the present application do not impose specific restrictions.

[0081] Figure 7 A schematic diagram of a posed photo user interface according to an embodiment of the present application is shown.

[0082] In some embodiments, the display of the smart TV can display a user interface, and the user interface can display the posed pictures and group photos involved in this application.

[0083] The posed picture includes a first object and a group photo object. For example, the group photo object can be configured as the user's favorite celebrity poet Rabindranath Tagore, and the first object is used to show the target body posture imitated by the user, that is, when the user imitates the body posture of the first object to meet the preset conditions of the smart TV, the smart TV will synthesize a photo, that is, the group photo mentioned in this application, to achieve the group photo effect of the user and the group photo object.

[0084] It can be understood that the smart TV provided in the present application can take a group photo including the user and the group photo object when the user imitates the target body posture of the first object.

[0085] For example, the poet Rabindranath Tagore, the subject in the posed photo, makes a love gesture in the posed photo, and the first subject in the photo with him also makes a love gesture. The love gesture of the first subject is the target body gesture mentioned in this application. After the TV starts automatic photo taking, when the user makes a body gesture similar to that of the first subject in front of the TV, the camera function of the TV will be automatically triggered and a photo of the user and the poet Rabindranath Tagore will be generated, wherein the user and the poet Rabindranath Tagore both maintain the body gesture in the posed photo in the photo. The body gesture is usually also called Pose.

[0086] In some embodiments, Figure 7 The first object included in the posed picture can be displayed as an outline in the TV user interface, and the user can take a photo with the photo object and obtain a photo by imitating the target body posture shown in the outline. In some embodiments, when the user learns the target body posture of the first object in the posed picture, the user interface outline can display a real-time image of the user in front of the TV in real time, so that the user can better imitate and train the target body posture of the first object. It should be noted that in some embodiments, Figure 7 The first object included in the posed picture may be displayed as a specific example person photo in the TV user interface.

[0087] It should be noted that, although the posed picture described in the present application includes a first object and a group photo object, it does not affect the replacement of the group photo object with a pet, animal, plant, building, or other object of interest.

[0088] Fig. 8A A schematic diagram of a user interface for implementing automatic group photo taking on a television according to an embodiment of the present application is shown.

[0089] In some embodiments, the camera configured for the television may be used to obtain images of users within its detection range, that is, when the automatic photo-taking function is turned on, as long as the user enters the detection range of the camera, the camera will automatically obtain the image of the user in front of the television.

[0090] In some embodiments, the display device provided by the present application includes a controller. When the user is within the detection range of the camera, the controller can calculate the user image obtained by the camera to obtain the target person contained therein, wherein the target person is the automatic photo-taking user who is located in front of the TV and within the detection range of the camera.

[0091] In some embodiments, the controller obtains the current body posture of the target person, and the real-time body posture is that of the user in front of the TV; when the similarity between the target body posture of the first object in the posed picture and the real-time body posture reaches a preset threshold, it can be determined that the user is imitating the first object in the posed picture, that is, the user is currently experiencing an automatic group photo; the controller will control the user interface to display a group photo generated based on the posed picture and the user image, and replace the first object in the posed picture with the generated group photo of the target person obtained by the controller, in which the target person displays the current body posture of the user at the current moment.

[0092] It should be noted that, when generating a group photo based on a posed photo and a target person, the group photo can be generated by replacing the first object in the posed photo with the target person, or by synthesizing multiple layers respectively containing the group photo objects and the target person; the former is to generate a group photo by processing the posed photo alone, while the latter is to generate a group photo by processing multiple images.

[0093] like Fig. 8A As shown, user Zhang San experiences the automatic group photo function, and the user interface currently displays a posed picture; Zhang San's initial body posture is with his left hand raised and his right hand hanging down, and then Zhang San changes his posture with his right hand raised and his left hand hanging down, but the user interface still displays the posed picture, and the TV does not automatically take pictures or display group photos.

[0094] It can be understood that after Zhang San changed his posture, his body posture is not similar to the body posture of the first object in the posed photo. The TV controller obtains the target person and his current body posture through the user image acquired by the camera, and compares the current body posture with the target body posture to obtain the similarity, and then compares the similarity with the preset threshold to determine whether the user's current imitation of the first object's target body posture meets the conditions for automatic photo taking.

[0095] In some embodiments, Figure 8B As shown, user Zhang San continues to change his body movements; Zhang San shows a loving gesture by adjusting his upper limbs. At this time, the user interface no longer displays the posed picture including the first object and the group photo object, and is replaced by a group photo including Zhang San and the group photo object.

[0096] It is understandable that Zhang San changes his body posture to Figure 8BAfter making a love gesture in the middle, Zhang San's body posture is similar to the body posture of the first target object in the posed picture. The TV controller obtains the target person Zhang San and his current body posture through the user image obtained by the camera, and compares the current body posture with the target body posture to obtain the similarity, and then compares the similarity with the preset threshold. For example, the preset threshold is 80% and the similarity is 85%. The controller will determine that the user's current imitation of the first target body posture meets the condition for the TV to automatically take pictures. The controller will control the user image obtained by the camera and the posed picture to synthesize to obtain Figure 8B Group photo as shown in the TV user interface.

[0097] It can be understood that before the controller controls the user interface to display the group photo image generated based on the posed photo image and the user image, the user interface can display a posed photo image including the first object and the group photo object. That is, during the process of realizing the automatic group photo, the TV screen always displays the posed photo image, and the user Zhang San can more accurately imitate the target body posture of the first object.

[0098] It should be noted that in some embodiments, before the controller controls the user interface to display the group photo generated based on the posed photo or the user image, the user interface may not display the posed photo. That is, the smart TV user interface plays TV normally or performs system configuration operations, such as the master-slave signal source configuration user interface, such as Figure 8C As shown; as long as the automatic group photo function of the TV is turned on, user Zhang San enters the camera detection area and the similarity between Zhang San's current body posture and the first object target body posture reaches a preset threshold, the TV controller will generate the above-mentioned group photo in the background and display the group photo in the user interface.

[0099] In some embodiments, when the similarity between the user's current body posture and the target body posture reaches a second preset threshold, the controller controls the user interface to display an auxiliary dotted line until a group photo is obtained, wherein the auxiliary dotted line is used to prompt the user to pose in the corresponding target body posture. The auxiliary dotted line will not be displayed in the group photo finally obtained.

[0100] When the user character enters the camera detection range to capture the image, when the user's current body posture is close to the body posture of the first object in the posed photo, an auxiliary dotted line of the posture outline will be displayed on the TV screen to assist the user character in posing the corresponding posture. When the group photo triggering conditions are met and the countdown to taking the photo begins, the auxiliary dotted line disappears, and this posture dotted line will not be captured in the group photo.

[0101] For example, when the similarity between the current limb posture and the target limb posture reaches 40%, the controller will control the user interface to display an auxiliary dotted line, which is specifically implemented as the first object of the dotted line. The controller controls the auxiliary dotted line to be displayed on the top layer of the user interface. For example, in the system configuration interface, the controller can control the auxiliary dotted line to be displayed on the top layer of the system configuration interface. Fig.8D shown.

[0102] The user adjusts his body posture according to the prompt of the auxiliary dotted line. When the similarity between the current body posture and the target body posture reaches 80%, the controller will control the user interface to display prompt information, such as displaying that the posture recognition is successful, and control the user interface to obtain the user image at this time to synthesize the group photo. The user interface is as follows: Fig. 8E shown.

[0103] It should be noted that when the similarity reaches a preset threshold, the controller can automatically acquire the user image to generate a group photo; in some embodiments, when the similarity reaches a preset threshold, the TV can also be configured to instantly take a photo to acquire the user image to generate a group photo by detecting voice commands or body commands. In some embodiments, the controller can also control the user interface to display operation buttons such as photo taking, scene, props, magic show, etc., so that the user can manually control the acquisition of the group photo through the remote control.

[0104] Fig. 9A A schematic diagram of an automatic group photo countdown user interface according to an embodiment of the present application is shown.

[0105] In some embodiments, after user Zhang San performs camera detection on an area, when the TV controller determines that the acquired similarity reaches a preset threshold, the controller will control the user interface to display a countdown value, and the countdown can prompt the user that the camera will take a photo and synthesize a group photo at the end of the moment.

[0106] For example, the countdown is 3 seconds in total, and the user interface initially displays 2 seconds, changes to 1 second, and finally changes to 0 seconds; and after reaching 0 seconds, the controller controls the camera of the smart TV to obtain a user image containing the target person Zhang San; then based on the posed image and the user image, an image algorithm is used to generate a group photo containing the user Zhang San and the poet Tagore, the group photo subject, and the group photo is displayed on the user interface.

[0107] In some embodiments, the controller can generate a group photo based on the posed photo and the user image by the following method. The controller can copy the group photo object in the posed photo separately or draw it on an independent layer, and draw the user image target person used to replace the first object of the posed photo on another independent layer. By configuring the transparent pair of the two independent layers, the group photo can be generated using an overlay display method.

[0108] For example, after acquiring the user image from the camera, the controller draws the target person included in the user image at the position of the first layer corresponding to the first object. At this time, the similarity between the body posture of the drawn target person and the target body posture has reached a preset threshold; then the controller draws the group photo object at the position of the second layer corresponding to the group photo object, and the group photo object is still displayed as the body posture of the group photo object in the posed picture; then the controller controls the second layer to be displayed in the user interface in a texture blending manner over the first layer to generate a group photo picture.

[0109] In some embodiments, after the TV controller determines that the acquired similarity reaches a preset threshold, the controller will control the user interface to display a high-brightness countdown value. The user interface can also prompt the display to start the countdown for 3 seconds and automatically take a photo to prompt the user to maintain the current posture, such as Fig. 9B shown.

[0110] Fig. 10A A schematic diagram of a user interface for configuring a posed photo according to another embodiment of the present application is shown.

[0111] In some embodiments, still taking Zhang San operating the smart TV to configure the posed photo as an example, after Zhang San starts the configuration user interface of the automatic photo application, the controller can re-acquire the user's body posture through the TV. Fig. 10A The first object in the group photo is replaced to achieve different body posture expressions for taking photos with the group photo object.

[0112] For example, the initial body posture of user Zhang San is left hand raised and right hand hanging down, then Zhang San changes the body posture to right hand raised and left hand hanging down, and performs confirmation operation through the remote control, and the controller will obtain the user image taken by the camera to obtain the body posture of user Zhang San at this time, that is, the target body posture of the second object in the new posed picture, such as Fig. 10B When the controller displays the acquired second object in the user interface, user Zhang San can use the remote control to move the position of the second object and determine the appropriate relative position with the photo object; after the position of the second object is determined, the controller will control the user interface to no longer display the first object, thereby obtaining a new posed photo with different effects.

[0113] Compare Fig. 10B and Fig. 10A , it can be found Fig. 10B In the new posed photo, the second subject is located to the right of the subject in the photo; Fig. 10A The first subject in the original posed photo is located on the left side of the subject in the group photo.

[0114] Fig.11A A schematic diagram showing another embodiment of the present application showing a display device recognizing a user's limbs.

[0115] In some embodiments, the smart TV controller may obtain the instant limb location points of the target person based on the user image, where the instant limb location points correspond to the current limb posture of the target person, that is, the current limb posture of the user in front of the TV.

[0116] For example, after the TV turns on the automatic photo-taking function, that is, the related limb detection function, the controller grabs the preview image from the camera preview FrameBuffer, and then sends the preview image to the limb detection application. The key information of the limb positioning point can be returned through image processing. According to different accuracy and computing speed requirements, the controller can obtain 18, 9, or other required numbers of user's instant limb positioning points.

[0117] In some embodiments, the controller obtains the similarity between the instant limb positioning point and the target limb positioning point of the first object in the posed image through a fit matching method, and then determines the relationship between the similarity and a preset threshold to determine whether the photo-taking conditions are met.

[0118] For example, the controller matches the limb information detected based on the user image with the posture information of the first object schematic diagram in the posed image; the fit is determined by judging the error value between the limb key points identified by the image detection and the predicted limb key points. If the error value is less than a certain range, it is considered to be a match; when the similarity between the posed posture of the person in the preview and the action of the person in the schematic diagram exceeds 80%, automatic photo taking is triggered.

[0119] In some embodiments, the controller identifies the left arm elbow of the target user in the image captured by the camera as the first positioning point, the right arm elbow as the second positioning point, and other joints as third positioning points, and the third positioning point is located at the left hand, and / or left shoulder, and / or neck, and / or right shoulder, and / or right hand, and / or left waist, and / or right waist.

[0120] For example, the user's left hand is identified as point 1, the left elbow is identified as point 2, the left shoulder is identified as point 3, the neck is identified as point 4, the right shoulder is identified as point 5, the right elbow is identified as point 6, the right hand is identified as point 7, the left waist is identified as point 8, and the right waist is identified as point 9. Fig. 11B shown.

[0121] The first positioning point is implemented as point 2, the second positioning point is implemented as point 6, and the third positioning point can be implemented as one of the remaining points, or a combination of multiple points. The controller identifies the above multiple points in the captured image, tracks the multiple points, and obtains the instant limb positioning points of the current user based on the multiple points, for example, based on 9 points.

[0122] In some embodiments, the controller extracts a single frame image from the captured video every preset number of frames (e.g., every 90 frames) for the captured image received from the camera. The human body detection algorithm in the image recognition technology (e.g., Convolutional Pose Machine, which detects the various joints of the human body and then determines the range formed by these joints as the human body frame of the human body) is applied to perform human body detection on the single frame image, determine the movement direction of the target user through the position changes of multiple points, and determine whether the upper torso of the target user is completely in the capture area and whether the target user is leaving the capture area.

[0123] In some embodiments, the upper body trunk feature points of the user in the captured video are sequentially connected according to a predetermined connection rule (for example, connecting the left shoulder with the right shoulder, then connecting the right shoulder with the right arm elbow, then connecting the right arm elbow with the right hand...), thereby obtaining the upper body edge map of the user. Similarly, the upper body edge maps of each family member are obtained.

[0124] For the user image of a family member, the similarity between each connecting line of the user's upper body edge map and the first object target limb positioning point is determined by the angle of the connecting line. For example: for family member A, the angle of the line connected by the left hand, left wall elbow, and left shoulder in the user's upper body edge map is 27 degrees. The angle of the line connected by the left hand, left wall elbow, and left shoulder in the upper body edge map of the target user is 30 degrees. Then the similarity between the connecting line of the upper body edge map of the target user and the connecting line of the upper body edge map of family member A is 1-(|27-30| / 30)=0.9.

[0125] In some embodiments, the TV controller can also detect the body contour of the target person in the user image, and make a judgment by XORing the pixel ratio between the body contour position and the preset position in the posed image. If the ratio is less than a certain value such as 20%, a countdown photo can also be triggered.

[0126] Based on the technical solution of realizing user gesture-triggered photography by a display device as described above and the introduction of the related drawings, the present application also provides a photography method based on user gesture triggering, the method comprising: when the user is in the detection range, obtaining a target person included in the user image captured by the camera; when the similarity between the current body posture of the target person and the target body posture of the first object in the posed picture reaches a preset threshold, displaying a group photo generated based on the posed picture and the user image; wherein the group photo is the posed picture in which the first object is replaced with the target person, the posed picture also includes a group photo object, the target person is displayed in the group photo as the current body posture, and the first object is used to show the target body posture imitated by the user. The method has been described in detail in the technical solution of realizing user gesture-triggered photography by a display device, and will not be repeated here.

[0127] In some embodiments, when the similarity between the current body posture of the target person and the target body posture reaches a preset threshold, a group photo generated based on the posed image and the user image is displayed, specifically including: when the similarity reaches the preset threshold, displaying the countdown value for the camera to take a photo; when the countdown value returns to zero, controlling the camera to obtain a user image containing the target person; and displaying a group photo generated based on the posed image and the user image. The method has been described in detail in the technical solution of realizing user gesture-triggered photo taking by a display device, and will not be repeated here.

[0128] In some embodiments, displaying a group photo generated based on the posed photo and the user image specifically includes: drawing the target person at a position corresponding to the first object on the first layer; drawing the group photo object at a position corresponding to the group photo object on the second layer; and controlling the second layer to cover and display on the first layer in a texture blending manner to generate the group photo. The method has been described in detail in the technical solution of realizing user gesture-triggered photography on a display device, and will not be repeated here.

[0129] In some embodiments, determining whether the similarity between the current body posture of the target person and the target body posture reaches a preset threshold specifically includes: obtaining the instantaneous body positioning point of the target person in the user image, the instantaneous body positioning point corresponding to the current body posture of the target person; obtaining the similarity between the instantaneous body positioning point and the target body positioning point of the first object in the posed image by a fit matching method, and comparing the similarity with the preset threshold to determine whether it is reached. The method has been described in detail in the technical solution of realizing user gesture triggered photography on a display device, and will not be repeated here.

[0130] In some embodiments, the first object included in the posed image is displayed as: a person photo showing the target body posture, or a person outline. The method has been described in detail in the technical solution of realizing user gesture triggering photography on a display device, and will not be repeated here.

[0131] In some embodiments, before displaying the group photo generated based on the posed photo and the user image, the method further includes: displaying the posed photo including the first object and the group photo object; or not displaying the posed photo including the first object and the group photo object. The method has been described in detail in the technical solution of realizing user gesture-triggered photography on a display device, and will not be repeated here.

[0132] In some embodiments, the method further includes: obtaining a second object in the user image captured by the camera for the user to imitate the target body posture; controlling the second object to move in the posed image, determining the position of the second object to generate a new posed image; and no longer displaying the first object. The method has been described in detail in the technical solution of realizing user gesture-triggered photography on a display device, and will not be repeated here.

[0133] The beneficial effects of the embodiments of the present application lie in that, by constructing a posed picture including a first object, a target body posture for imitation can be provided to the user; further, by acquiring the target person, the user's current body posture can be acquired and the automatic photo-taking logic can be triggered; further, by acquiring the similarity between the current body posture and the target body posture, it can be determined whether to trigger automatic photo-taking; further, by generating a group photo based on the posed picture and the target person, automatic group photo acquisition can be achieved, thereby reducing the appearance of unnecessary remote controls, abnormal user mouth shapes, and unnecessary body postures in the group photo.

[0134] In addition, it will be appreciated by those skilled in the art that various aspects of the present application may be illustrated and described by a number of patentable categories or situations, including any new and useful process, machine, product or combination of substances, or any new and useful improvements thereto. Accordingly, various aspects of the present application may be performed entirely by hardware, entirely by software (including firmware, resident software, microcode, etc.), or by a combination of hardware and software. The above hardware or software may all be referred to as "data blocks", "controllers", "engines", "units", "components" or "systems". In addition, various aspects of the present application may be represented as a computer product located in one or more computer-readable media, which includes computer-readable program code.

[0135] A computer storage medium may include a propagated data signal embodying a computer program code, such as in baseband or as part of a carrier wave. The propagated signal may be in a variety of forms, including electromagnetic, optical, etc., or a suitable combination. A computer storage medium may be any computer-readable medium other than a computer-readable storage medium, which can be connected to an instruction execution system, device or apparatus to communicate, propagate or transmit the program for use. The program code on the computer storage medium may be transmitted via any suitable medium, including radio, cable, fiber optic cable, RF, or similar media, or any combination of the above media.

[0136] The computer program coding required for the operation of each part of the application can be written in any one or more programming languages, including object-oriented programming languages ​​such as Java, Scala, Smalltalk, Eiffel, JADE, Emerald, C++, C#, VB.NET, Python, etc., conventional procedural programming languages ​​such as C language, Visual Basic, Fortran 2003, Perl, COBOL 2002, PHP, ABAP, dynamic programming languages ​​such as Python, Ruby and Groovy, or other programming languages, etc. The program coding can be run completely on the user's computer, or run on the user's computer as an independent software package, or run partly on the user's computer and partly on the remote computer, or run completely on the remote computer or server. In the latter case, the remote computer can be connected to the user's computer through any network form, such as a local area network (LAN) or a wide area network (WAN), or connected to an external computer (e.g., via the Internet), or in a cloud computing environment, or used as a service such as software as a service (SaaS).

[0137] In addition, unless explicitly stated in the claims, the order of the processing elements and sequences described in this application, the use of alphanumeric characters, or the use of other names are not intended to limit the order of the processes and methods of this application. Although the above disclosure discusses some invention embodiments that are currently considered useful through various examples, it should be understood that such details are only for illustrative purposes, and the attached claims are not limited to the disclosed embodiments. On the contrary, the claims are intended to cover all modifications and equivalent combinations that are consistent with the essence and scope of the embodiments of this application. For example, although the system components described above can be implemented by hardware devices, they can also be implemented only by software solutions, such as installing the described system on an existing server or mobile device.

[0138] Similarly, it should be noted that in order to simplify the description of the disclosure of this application and thus help understand one or more embodiments of the invention, in the above description of the embodiments of this application, multiple features are sometimes combined into one embodiment, figure or description thereof. However, this disclosure method does not mean that the features required by the object of this application are more than the features mentioned in the claims. In fact, the features of the embodiments are less than all the features of the single embodiment disclosed above.

[0139] Each patent, patent application, patent application disclosure, and other materials, such as articles, books, instructions, publications, documents, etc., cited in this application are hereby incorporated by reference in their entirety. Except for application history documents that are inconsistent with or conflicting with the content of this application, documents that limit the broadest scope of the claims of this application (currently or later attached to this application) are also excluded. It should be noted that if the descriptions, definitions, and / or use of terms in the attached materials of this application are inconsistent or conflicting with the content described in this application, the descriptions, definitions, and / or use of terms in this application shall prevail.

Claims

1. A display device, characterized in that: include: A camera, used to obtain images within its detection range; A display capable of displaying a group photo and a posed photo including a first object, a second object, and the group photo object, wherein the first object and the second object are used to show a target body posture imitated by a user; The controller is configured as: When the user is within the detection range of the camera, the target person included in the image is obtained; wherein the obtaining of the target person included in the image includes: obtaining the joint points of the target person, and determining the movement direction of the target person according to the position change of the joint points; the movement direction of the target person is used to determine whether the upper torso of the target person is completely within the acquisition area, and whether the target person leaves the image acquisition area; When the similarity between the current body posture of the target person and the target body posture reaches a preset threshold, the user interface is controlled to display a group photo generated based on the posed picture and the target person, the group photo includes the target person and the group photo object, and the target person is displayed in the group photo as the current body posture of the target person; wherein, when the user interface displays the posed picture and a user's confirmation operation is detected, the user image captured by the camera is obtained to obtain the user's changed body posture; and when an operation input by the user to move the position of a second object is detected, the second object is moved according to the user's operation to obtain a new posed picture; the user's changed body posture is used to determine the target body posture of the second object; and the second object is used to show the target body posture imitated by the user in the new posed picture.

2. The display device according to claim 1, characterized in that: When the similarity between the current limb posture of the target person and the target limb posture reaches a preset threshold, the controller controls the user interface to display a group photo generated based on the posed photo and the target person, specifically comprising: When the similarity reaches a preset threshold, controlling the user interface to display a countdown value for the camera to take a photo; When the countdown value returns to zero, controlling the camera to acquire an image containing the target person; The user interface is controlled to display a group photo generated based on the posed photo and the target person.

3. The display device according to claim 1, characterized in that: The controller controls the user interface to display a group photo generated based on the posed photo and the target person, specifically comprising: Draw the target person at a position of the first layer corresponding to the first object; Draw the group photo object at a position of the second layer corresponding to the group photo object; The second layer is controlled to be displayed on the first layer in the user interface in a texture blending manner to generate a group photo.

4. The display device according to claim 1, characterized in that: The controller determines that the similarity between the current limb posture of the target person and the target limb posture reaches a preset threshold, specifically comprising: Acquire, based on the image, a real-time limb location point of a target person, the real-time limb location point corresponding to a current limb posture of the target person; The similarity between the instant limb location point and the first object target limb location point is obtained by a fit matching method, and the similarity is compared with a preset threshold to determine whether it is reached.

5. The display device according to claim 1, characterized in that: The first object included in the posed picture is displayed in the user interface as: A photo of a person showing the target's body posture, or a person's silhouette.

6. The display device according to claim 5, characterized in that: Before the controller controls the user interface to display a group photo generated based on the posed photo and the target person, the controller is further configured to: Controlling the user interface to display a posed picture including the first subject and the subject of the group photo; or The user interface is controlled not to display the posed picture including the first object and the group photo object.

7. The display device according to claim 1, characterized in that: The display may display a posed picture including the first object and the group photo objects, and the controller is further configured to: Acquire a second object used for the user to imitate a target limb posture in the image of the user captured by the camera; Controlling the second object to move in the posed picture, and determining the position of the second object to generate a new posed picture; The first object is no longer displayed.

8. The display device according to claim 1, characterized in that: Before the controller controls the user interface to display the group photo generated based on the posed photo and the target person, the controller is further configured to: The user interface is controlled to display an auxiliary dotted line for prompting the user to pose a corresponding target body posture before the group photo is obtained; wherein the auxiliary dotted line is not displayed in the group photo.

9. A photographing method based on user gesture triggering, characterized in that: The method comprises: When the user is within the detection range, the target person included in the image of the user captured by the camera is obtained; wherein the obtaining of the target person included in the image includes: obtaining the joint points of the target person, and determining the movement direction of the target person according to the position change of the joint points; the movement direction of the target person is used to determine whether the upper torso of the target person is completely within the acquisition area, and whether the target person leaves the image acquisition area; When the similarity between the current body posture of the target person and the target body posture of the first object in the posed picture reaches a preset threshold, a group photo generated based on the posed picture and the target person is displayed, the group photo including the target person and the group photo objects, and the target person is displayed in the group photo as the current body posture of the target person; wherein, when the posed picture is displayed on the user interface and a user's confirmation operation is detected, the user image captured by the camera is obtained to obtain the user's changed body posture; and when an operation input by the user for moving the position of a second object is detected, the second object is moved according to the user's operation to obtain a new posed picture; the user's changed body posture is used to determine the target body posture of the second object; and the second object is used to show the target body posture imitated by the user in the new posed picture.

10. The photographing method based on user gesture triggering as claimed in claim 9, characterized in that: When the similarity between the current body posture of the target person and the target body posture reaches a preset threshold, a group photo generated based on the posed photo and the target person is displayed, specifically including: When the similarity reaches a preset threshold, a countdown value for the camera to take a photo is displayed; When the countdown value returns to zero, controlling the camera to acquire an image containing the target person; A group photo generated based on the posed photo and the target person is displayed.

11. The method for photographing based on user gesture triggering as claimed in claim 9, characterized in that: Displaying a group photo generated based on the posed photo and the target person specifically includes: Draw the target person at a position of the first layer corresponding to the first object; Draw the group photo object at a position of the second layer corresponding to the group photo object; The second layer is controlled to cover and display on the first layer in a texture blending manner to generate a group photo.

12. The method for photographing based on user gesture triggering as claimed in claim 9, characterized in that: Determine whether the similarity between the current body posture of the target person and the target body posture reaches a preset threshold, specifically including: Acquire the instant limb location point of the target person in the image, wherein the instant limb location point corresponds to the current limb posture of the target person; The similarity between the instant limb positioning point and the target limb positioning point of the first object in the posed image is obtained by a fit matching method, and the similarity is compared with a preset threshold to determine whether it is reached.

13. The method for photographing based on user gesture triggering as claimed in claim 9, characterized in that: The first object included in the posed picture is displayed as: A photo of a person showing the target's body posture, or a person's silhouette.

14. The method for photographing based on user gesture triggering as claimed in claim 13, characterized in that: Before displaying the group photo generated based on the posed photo and the target person, the method further includes: Displaying a posed picture including the first subject and the subject of the group photo; or The posed picture including the first object and the group photo object is not displayed.

15. The method for photographing based on user gesture triggering as claimed in claim 9, characterized in that: The method further comprises: Acquire a second object in the image captured by the camera for the user to imitate the target body posture; controlling the second object to move in the posed image, and determining the position of the second object to generate a new posed image; The first object is no longer displayed.