Display image determination method and device

Abstract

The invention provides a display image determination method and device.The display image determination method comprises the steps that in response to switching to a first mode of electronic equipment, an image acquisition unit of the electronic equipment obtains a first image or a second image, and the first image or the second image is different from an image of an environment where the electronic equipment is located; in response to switching to the second mode of the electronic equipment, an image acquisition unit of the electronic equipment acquires an image of an environment where the electronic equipment is located; in response to switching to the third mode of the electronic equipment, an image acquisition unit of the electronic equipment is in a closed state; and the image acquisition unit outputs and displays the acquired image, or the image acquisition unit outputs the acquired image to an application of the electronic equipment, so that the application displays the image.

Description

Technical Field

[0001] The present application relates to but is not limited to the field of image processing technology, and in particular to a method and device for determining a display image. Background Art

[0002] At present, the personal computer (PC) has only two gear switches for the camera, including the open gear and the closed gear. When the gear switch is in the open position, the camera state of the PC is turned on, so as to collect real data; when the gear switch is in the closed position, the camera state of the PC is turned off. When the user does not want to display the real data of the environment or the real data of himself when using the camera, the existing local camera on the PC cannot meet this demand. Summary of the invention

[0003] The present application provides a method for determining a display image, which is applied to an electronic device, comprising: in response to switching to a first mode of the electronic device, an image acquisition unit of the electronic device acquires a first image or a second image, the first image or the second image being different from an image of an environment in which the electronic device is located; in response to switching to a second mode of the electronic device, the image acquisition unit of the electronic device acquires an image of an environment in which the electronic device is located; in response to switching to a third mode of the electronic device, the image acquisition unit of the electronic device is in a closed state; the image acquisition unit outputs and displays the acquired image or the image acquisition unit outputs the acquired image to an application of the electronic device, so that the application displays the image.

[0004] The present application provides an electronic device, including a main body and an image acquisition unit, wherein the image acquisition unit is located in the main body, and a gear switch that can be moved to different positions is provided on the main body. In response to a user moving the gear switch to a first position, the electronic device is in a first mode, and the image acquisition unit of the electronic device acquires a first image or a second image, wherein the first image or the second image is different from an image of an environment where the electronic device is located; in response to a user moving the gear switch to a second position, the electronic device is in a second mode, and the image acquisition unit of the electronic device acquires an image of an environment where the electronic device is located; in response to a user moving the gear switch to a third position, the electronic device is in a third mode, and the image acquisition unit of the electronic device is in an off state.

[0005] It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and are not intended to limit the technical solutions of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0006] The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present application and are used together with the specification to illustrate the technical solution of the present application.

[0007] Figure 1 A schematic diagram of an implementation flow of a method for determining a display image provided in an embodiment of the present application;

[0008] Figure 2 A schematic diagram of an implementation flow of a method for determining a display image provided in an embodiment of the present application;

[0009] Figure 3a A schematic diagram of a gear switch provided in an embodiment of the present application;

[0010] Figure 3b A schematic diagram of a gear switch provided in an embodiment of the present application;

[0011] Figure 4 A schematic diagram of the implementation process of the virtual human gear position provided in the embodiment of the present application;

[0012] Figure 5a A schematic diagram of a virtual person's gear position provided in an embodiment of the present application;

[0013] Figure 5b A schematic diagram of a virtual person's gear position provided in an embodiment of the present application;

[0014] Figure 5c A schematic diagram of a virtual person's gear position provided in an embodiment of the present application;

[0015] Figure 6 A schematic diagram of the structure of a display image determination device provided in an embodiment of the present application;

[0016] Figure 7 A hardware entity schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0017] In order to make the purpose, technical solutions and advantages of the present application clearer, the technical solutions of the present application are further elaborated in detail below in conjunction with the drawings and embodiments. The described embodiments should not be regarded as limiting the present application. All other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0018] In the following description, reference is made to "some embodiments", which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict. The terms "first / second / third" involved are merely used to distinguish similar objects and do not represent a specific order for the objects. It is understood that "first / second / third" may be interchanged in a specific order or sequence where permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0019] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing this application and are not intended to limit this application.

[0020] At present, the personal computer (PC) has only two gear switches for the camera, including the open gear and the closed gear. When the gear switch is in the open position, the camera state of the PC is turned on, so as to collect real data; when the gear switch is in the closed position, the camera state of the PC is turned off. When the user does not want to display the real data of the environment or the real data of himself when using the camera, the existing local camera on the PC cannot meet this demand.

[0021] The present application embodiment provides a method for determining display data, which can be executed by a processor of an electronic device. The electronic device may refer to a server, a laptop, a tablet computer, a desktop computer, a smart TV, a set-top box, a mobile device (such as a mobile phone, a portable video player, a personal digital assistant, a dedicated messaging device, a portable gaming device), or other device with data processing capabilities.

[0022] Figure 1 A schematic diagram of an implementation flow of a method for determining a display image provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, the method includes the following steps S101, S102 and S103, combining Figure 1 The steps shown are explained.

[0023] Step S101: In response to switching to the first mode of the electronic device, an image acquisition unit of the electronic device acquires a first image or a second image.

[0024] The first image or the second image is different from the image of the environment where the electronic device is located.

[0025] In some embodiments, the electronic device may be an electronic device that may refer to a server, a laptop computer, a tablet computer, a desktop computer, a smart TV, a set-top box, a mobile device (such as a mobile phone, a portable video player, a personal digital assistant, a dedicated messaging device, a portable gaming device), or the like that has data processing capabilities and image acquisition capabilities.

[0026] In some embodiments, a gear switch corresponding to the first mode may be provided on the electronic device, and the gear of the electronic device may be switched to the gear corresponding to the first mode by touching or switching the gear switch.

[0027] In some embodiments, the electronic device may be switched to the first mode based on a shortcut key; or the electronic device may be switched to the first mode through voice, mouse, etc.

[0028] In some embodiments, the image acquisition unit of the electronic device may be a camera disposed inside the electronic device, for example, a camera disposed in the hardware of a notebook.

[0029] In some embodiments, the first mode may be a virtual human mode of the electronic device. When the electronic device is switched to the virtual human mode, a virtual image is acquired by an image acquisition unit of the electronic device to replace the image in the real environment.

[0030] In some embodiments, the first image may be a preset image or an image saved by a user at a historical moment; the second image may be a preset image or an image saved by a user at a historical moment; wherein, if the first image is a preset image, the second image is an image saved by a user at a historical moment; if the first image is an image saved by a user at a historical moment, the second image is a preset image. The preset image may be a general image such as an image (icon) identifying the mode, and the electronic device may provide multiple preset images for the user to select.

[0031] In some embodiments, when switching to the first mode of the electronic device, the data collected by the image acquisition unit is not an image in the real environment, but a preset image or an image saved by the user at a historical moment, to replace the image in the real environment.

[0032] Step S102: In response to switching to the second mode of the electronic device, an image acquisition unit of the electronic device acquires an image of an environment where the electronic device is located.

[0033] In some embodiments, a gear switch corresponding to the second mode may be provided on the electronic device, and the gear of the electronic device may be switched to the gear corresponding to the second mode by touching or switching the gear switch.

[0034] In some embodiments, the electronic device may be switched to the second mode based on a shortcut key; or the electronic device may be switched to the second mode through voice, mouse, etc.

[0035] In some embodiments, the second mode of the electronic device may be an operating mode of the electronic device, that is, a normally on state of the image acquisition unit. It can be understood that in response to switching to the operating mode of the electronic device so that the image acquisition unit of the electronic device is in a normally on state, a real image of the environment in which the electronic device is located is acquired based on the image acquisition unit in the normally on state.

[0036] Exemplarily, the electronic device is a laptop computer, the image acquisition unit is a camera disposed on the laptop computer, and the second mode is an on mode of the camera corresponding to the laptop computer, so as to collect real data of the environment in which the laptop computer is located based on the camera in the on mode.

[0037] Step S103: In response to switching to the third mode of the electronic device, the image acquisition unit of the electronic device is in a closed state.

[0038] The image acquisition unit outputs and displays the acquired image or the image acquisition unit outputs the acquired image to an application of the electronic device, so that the application displays the image.

[0039] In some embodiments, a gear switch corresponding to the third mode may be provided on the electronic device, and the gear of the electronic device may be switched to the gear corresponding to the third mode by touching or switching the gear switch.

[0040] In some embodiments, the electronic device can also be switched to the third mode based on a shortcut key; or the electronic device can be switched to the third mode through voice, mouse, etc.

[0041] In some embodiments, the third mode is a shutdown mode of the electronic device, that is, the image acquisition unit on the electronic device is in a shutdown state, and the image acquisition unit in the shutdown state cannot acquire data.

[0042] Exemplarily, the camera of the laptop is switched to off mode.

[0043] In some embodiments, the first image or the second image captured by the image acquisition unit of the electronic device in the first mode is used as display data, or the real environment image captured by the image acquisition unit of the electronic device in the second mode is used as display data.

[0044] In some embodiments, the display data corresponding to the first image or the second image may be displayed in real time through an application built into the electronic device; or the display data corresponding to the real environment image may be displayed in real time.

[0045] Exemplarily, based on the camera application on the notebook computer, the display data corresponding to the first image or the second image is displayed in real time, or the display data corresponding to the real environment image is displayed in real time.

[0046] In some embodiments, the display data corresponding to the first image or the second image can also be called and displayed in real time through third-party application software (such as video software, conferencing software, video processing software, etc.) running on the electronic device; or the display data corresponding to the real environment image can be called for real-time display.

[0047] In an embodiment of the present application, the electronic device is switched to a first mode to obtain a first image or a second image different from an image of an environment in which the electronic device is located; the electronic device is switched to a second mode to obtain a real image of an environment in which the electronic device is located; and the electronic device is switched to a third mode to turn off an image acquisition unit of the electronic device; wherein, by switching the electronic device from the second mode or the third mode to the first mode of the electronic device, when the image acquired by the image acquisition unit is output and displayed, the real image of the environment in which the electronic device is located is replaced by the first image or the second image different from the environment in which the electronic device is located, thereby improving user privacy while improving user experience.

[0048] Figure 2 The present invention provides a method for determining a display image according to an embodiment of the present invention, which can be executed by a processor of an electronic device. Figure 1 , Figure 1 Step S101 in the above example can be updated to step S201 or step S202, which will be combined with Figure 2 The steps shown are explained.

[0049] Step S201: If the electronic device does not meet the first condition, the image acquisition unit of the electronic device acquires a first image.

[0050] In some embodiments, the first image may be an image pre-loaded into an On-Screen Display (OSD) of the electronic device.

[0051] In some embodiments, the second image may be an image selected by the user or an image selected by the user at a historical moment.

[0052] In some embodiments, the first condition may be that the electronic device has completed loading the second image.

[0053] In some embodiments, it is understandable that if the electronic device has not completed loading the second image, the first image pre-loaded into the OSD of the electronic device is acquired.

[0054] Step S202: If the electronic device meets the first condition, the image acquisition unit acquires a second image.

[0055] The second image is different from the first image.

[0056] In some embodiments, if the electronic device has completed loading the second image, a user selection is obtained or the user selects the second image at a historical moment.

[0057] In some embodiments, the first image is an image with a fixed pattern or fixed texture. For example, if the image in the first image is a virtual face composed of simple lines, the image in the second image may be an anime character, a cartoon character, or an image different from the first image.

[0058] In an embodiment of the present application, when the electronic device switches to the first mode, it is determined whether to obtain the first image or the second image based on whether the second image has been loaded. If the second image has been loaded, the second image is obtained, and if the loading is not completed, the first image is obtained; thereby, the preloaded first image is displayed first when the second image has not been loaded, so as to avoid the problem of freeze in the electronic device display due to waiting for the second image to be loaded.

[0059] In some embodiments, the first condition includes the electronic device loading the target model, and the above step S201 can be implemented by the following implementation:

[0060] If the target model is not loaded, the image acquisition unit of the electronic device acquires the first image.

[0061] In some embodiments, a plurality of images are stored in the target model. If the target model is not loaded completely, that is, the plurality of images are not loaded completely, a preloaded first image is acquired through an image acquisition unit of the electronic device, and the first image is used as display data.

[0062] In some embodiments, display data corresponding to the first image is called and displayed in real time by third-party application software (such as video software, conferencing software, video processing software, etc.) running on the electronic device or software built into the electronic device (such as a camera).

[0063] The above step S202 can be implemented by the following implementation:

[0064] If the target model has been loaded, the image acquisition unit of the electronic device acquires a second image, wherein the target model is used to determine the second image and sends it to the image acquisition unit.

[0065] The second image is an image stored in the target model, or an image generated based on user features.

[0066] In some embodiments, the target model includes a plurality of images.

[0067] In some embodiments, when the electronic device switches to the first mode, it determines whether the target model has been loaded. If the target model has been loaded and the user is not detected, an image acquisition unit of the electronic device obtains a second image selected by the user from multiple images of the target model at the current moment or a second image selected by the user at a historical moment, and uses the second image selected from multiple images of the target model at the current moment or a second image selected by the user at a historical moment as display data.

[0068] In some embodiments, when the electronic device switches to the first mode, if the target model is loaded and a user is detected, an image acquisition unit of the electronic device obtains a second image generated by the target model based on a target image selected by the user from multiple images of the target model at the current moment or a target image selected by the user at a historical moment and user actions, and the second image is a dynamic image that changes with the user's actions; and the dynamic second image is used as display data.

[0069] In some embodiments, display data corresponding to the dynamic second image is called for display by third-party application software (such as video software, conferencing software, video processing software, etc.) running on the electronic device or built-in software (such as a camera) on the electronic device.

[0070] In an embodiment of the present application, when switching to the first mode of the electronic device, it is determined whether the image acquisition unit of the electronic device acquires the first image or the second image based on whether the target model has been loaded. If the target model has not been loaded, the first image is acquired based on the image acquisition unit of the electronic device. If the target model has been loaded and the user is detected, the image acquisition unit of the electronic device acquires the second image generated by the target model based on the user's actions and the target image selected by the user for multiple images, so as to replace the real image of the environment in which the electronic device is located with the virtual first image or the second image, thereby improving user privacy while improving user experience.

[0071] In some embodiments, the target model includes a first model, the target model has been loaded, and the image acquisition unit of the electronic device acquires a second image, including:

[0072] If the first model has been loaded, the first model determines the second image from the stored multiple images and sends it to the image acquisition unit.

[0073] In some embodiments, when the electronic device switches to the first mode, if the first model has been loaded, a target image is obtained from a plurality of stored images as a second image through the first model, and the second image is sent to the image acquisition unit.

[0074] Among them, the first model obtains the target image selected by the user at the historical moment from multiple images based on the second image at the historical moment, so as to send the target image as the second image to the image acquisition unit; and uses the second image as display data.

[0075] In some embodiments, when the electronic device switches to the first mode, if the first model has been loaded and a user is detected, the first model obtains a second image from a plurality of stored images based on user characteristics and sends the second image to the image display data.

[0076] Among them, the first model obtains a target image matching the user from multiple stored images based on the user's gender, age, hobbies and other characteristics, obtains a dynamic second image based on the user's action target characteristics, and sends the dynamic second image to the image acquisition unit of the electronic device.

[0077] In some embodiments, the display data corresponding to the second image may be displayed through a built-in application of the electronic device; or the display data corresponding to the second image may be called for display by a third-party application running on the electronic device.

[0078] In an embodiment of the present application, when the electronic device switches to the first mode, if the first model is loaded, a second image is obtained from a plurality of stored images based on the first model and sent to an image acquisition unit of the electronic device, and the second image is displayed as display data, thereby replacing the real environment image of the electronic device with a virtual second image, thereby improving user data security while improving user experience.

[0079] In some embodiments, the target model includes a first model and a second model, the first model has stored a plurality of images, and the second model is used to identify user features; if the target model is loaded, the image acquisition unit of the electronic device acquires the second image, including:

[0080] If both the first model and the second model have been loaded, if a user is detected, the target model generates a second image based on the user features identified by the second model and the target image obtained by the first model from the stored multiple images.

[0081] In some embodiments, user characteristics may include user age, user gender, user actions, etc.

[0082] In some embodiments, when the electronic device switches to the first mode, if the first model and the second model are both loaded and the second model detects a user, the target model generates a second image based on the user features acquired by the second model and the target image acquired by the first model from multiple stored images based on the user features.

[0083] Exemplarily, the user's age, gender, and action are identified based on the second model, the first model obtains a target image matching the user's age and gender from multiple stored images based on the user's age and gender, and the target model generates a dynamic second image based on the user's action and the target image.

[0084] In some embodiments, the user characteristics may also include identity characteristics of the user.

[0085] In some embodiments, the second model recognizes the identity and actions of the user, and the first model obtains the target image used by the user at the historical moment based on the user's identity characteristics; the target model generates a dynamic second image based on the target image used by the user at the historical moment and the user's actions.

[0086] If the user is not detected, the object model determines a second image from the stored plurality of images.

[0087] In some embodiments, when the electronic device switches to the first mode, if both the first model and the second model are loaded and the second model does not detect a user, the first model obtains historical data in the electronic device from multiple stored images, and obtains the most frequently used image from the multiple stored images based on the historical data as the second image.

[0088] In some embodiments, after both the first model and the second model are loaded and the second model still does not detect a user after a preset time, the second model is uninstalled.

[0089] In an embodiment of the present application, the electronic device switches to the first mode, and when the first model and the second model are both loaded, a second image is determined based on whether a user is detected; wherein, if a user is detected, a dynamic second image is generated based on user characteristics and a target image acquired by the first model; if no user is detected, the target image acquired by the first model is determined as the second image, so that the display data corresponding to the dynamic second image replaces the static second image of the environment in which the electronic device is located, thereby improving user privacy; if no user is detected within a preset time, the loaded second model is unloaded to improve utilization of system resources.

[0090] In some embodiments, the method further includes: after displaying the second image, if no user is detected for a preset time, displaying the first image.

[0091] In some embodiments, the image acquisition unit of the electronic device obtains the second image as display data; the display data corresponding to the second image is called for display by third-party application software running on the electronic device or software built into the electronic device. If no user is detected after a preset time, the image acquisition unit of the electronic device obtains the preloaded first image as data, and the display data corresponding to the first image is called for display by third-party application software running on the electronic device or software built into the electronic device.

[0092] Exemplarily, when the display data corresponding to the second image is displayed through the video conferencing software, if the user is still not detected after 5 seconds, the first image preloaded in the screen menu adjustment mode is obtained through the camera of the laptop computer, and the preloaded first image is used as the display data. The video conferencing displays the first image by calling the display data.

[0093] In an embodiment of the present application, when a built-in application of an electronic device or a third-party application running on the electronic device displays display data corresponding to a second image, if the user is still not detected after a preset time, the image acquisition unit of the electronic device obtains a preloaded first image, and displays the display data corresponding to the first image through the built-in application of the electronic device or the third-party application running on the electronic device, thereby replacing the real image of the environment in which the electronic device is located based on the preloaded first image, thereby improving the privacy of the user.

[0094] In some embodiments, the method further includes: in response to switching to the second mode of the electronic device, starting to load the target model, or in response to switching from the third mode of the electronic device to the first mode, loading the target model.

[0095] The target model is used to determine the second image and send it to the image acquisition unit.

[0096] In some embodiments, in response to switching to the second mode of the electronic device, loading of the target model begins; it can be understood that in response to switching to the second mode of the electronic device, a real image of the environment in which the electronic device is located is acquired through the image acquisition unit of the electronic device, and display data of the real image is displayed through a built-in application of the electronic device or a third-party application running on the electronic device, and the target model is loaded at the same time. After a preset time after the target model is loaded, if the electronic device is not switched to the first mode, the loaded target model will be released.

[0097] In some embodiments, in response to switching the electronic device from the third mode to the first mode, the target model is loaded; it can be understood that the target model is loaded after the electronic device is switched from the third mode to the gear corresponding to the first mode by touching or switching the gear switch. Since the loading of the target model requires waiting time, the preloaded first image is first acquired based on the image acquisition unit of the electronic device and the preloaded first image is displayed through an application built into the electronic device or a third-party application running on the electronic device. When the target model is loaded, the second image is acquired based on the target model and sent to the image acquisition unit, and the second image is displayed through an application built into the electronic device or a third-party application running on the electronic device.

[0098] In an embodiment of the present application, in response to switching to the second mode of the electronic device, the target model is loaded so as to display the display data of the second image obtained based on the user characteristics and the target image when switching to the first mode of the electronic device; if the target model is not switched to the first mode of the electronic device after a preset time after loading, the loaded target model is unloaded to improve the utilization rate of system resources; in response to switching from the third mode of the electronic device to the first mode, the display data of the preloaded first image is first displayed to solve the display jamming problem that occurs during the loading of the target model; after the target model is loaded, the target model generates a second image based on the user characteristics and the target image corresponding to the user characteristics and sends it to the image acquisition unit to display the display data of the second image, thereby improving the user's privacy while improving the user experience.

[0099] In some embodiments, the above method further comprises:

[0100] In response to switching to the first mode of the electronic device, a first image is displayed on the display screen of the electronic device.

[0101] In some embodiments, after switching to the first mode of the electronic device by touching or switching a gear switch, the icon corresponding to the first mode is displayed on the display screen of the electronic device, and the display data corresponding to the first image is displayed through an application built into the electronic device or a third-party application running on the electronic device, wherein the application built into the electronic device or the third-party application running on the electronic device is displayed on the display screen of the electronic device.

[0102] In the embodiment of the present application, the first image is used to replace the real data of the environment in which the electronic device is located for display, thereby improving the user's privacy and user experience at the same time.

[0103] In some embodiments, the above method further comprises:

[0104] If a first number of users are detected, target users are determined, the target model acquires features of the target users, and the second image is determined based on the user features of the target users.

[0105] In some embodiments, the first number may include one user or multiple users.

[0106] Wherein, if the first quantity represents only one user, the user is determined as the target user. If the first quantity represents multiple users, the user closest to the electronic device is determined as the target user.

[0107] In some embodiments, the target model obtains the characteristics of the target user and determines the target image from the stored multiple images based on the user characteristics, and the target model generates the second image based on the user characteristics and the target image.

[0108] Alternatively, the target model obtains features of a second number of users, and determines a second image corresponding to each user based on the features of the second number of users, where the second number is less than or equal to the first number.

[0109] In some embodiments, when the first quantity represents one user, the second quantity also represents one user, the target model obtains the user characteristics and determines the target image from multiple stored images based on the user characteristics, and the target model generates a second image based on the user characteristics and the target image.

[0110] In some embodiments, when the first number represents a plurality of users, identity information of each user is obtained, and users who have registration information or login information on the electronic device among the first number of users are determined as the second number of users.

[0111] The target model obtains the features of each user in the second number, and determines a target image for each user from the stored multiple images based on each user feature; the target model generates a second number of second images based on each user feature in the second number of users and the corresponding target image.

[0112] In an embodiment of the present application, when the first number is one, the user is determined as the target user; when the first number is multiple, the user closest to the electronic device is determined as the target user; the target model obtains the characteristics of the target user and determines the target image from multiple stored images based on the user characteristics, and the target model generates a second image based on the user characteristics and the target image; when the second number is multiple, the target model generates a second image corresponding to each user, thereby replacing the user's real image with a virtual second image, thereby improving user privacy while improving user experience.

[0113] An exemplary application of a method for determining a display image provided by an embodiment of the present application in an actual scenario is described below.

[0114] Currently, personal computers (PCs) have only two gear switches, including an open gear and a closed gear, which correspond to an open model and a closed model respectively. When the gear switch is in the open position, the open model is loaded to make the camera state of the PC end open, so as to collect data; when the gear switch is in the closed position, the closed model is loaded to make the camera state of the PC end close.

[0115] With respect to the gear switch configuration on the PC side in the prior art, the present application adds a virtual human gear on the basis of the existing open gear and closed gear, that is, adds a corresponding virtual human model, loads the corresponding virtual human model when switching to the virtual human gear, controls the camera to obtain user actions based on the virtual human model, and generates a dynamic virtual human to replace the user image in combination with the user's selection of multiple virtual humans in the virtual human model, thereby improving user privacy while improving user experience.

[0116] Figure 3b A schematic diagram of a gear switch provided in an embodiment of the present application, wherein when switched to the off gear of the PC end, a close icon 301 is displayed on the display screen of the PC end, Figure 3a This is a schematic diagram of a gear switch provided in an embodiment of the present application, wherein when the gear is switched to the on gear of the PC camera, an on icon 302 is displayed on the display screen of the PC.

[0117] In some embodiments, the present application also provides a virtual human gear, wherein the gear can be switched from the open gear on the PC side to the virtual human gear or from the closed gear to the virtual human gear.

[0118] Figure 4 The schematic diagram of the implementation process of the virtual human gear provided in the embodiment of the present application includes steps S401 to S403. Figure 4 The steps shown are explained.

[0119] Step S401: In response to switching to the virtual human gear, generate first display data.

[0120] In some embodiments, the virtual human gear can be switched to the virtual human gear by a hardware virtual human gear set on the PC, or by a shortcut key. Figure 5a , Figure 5a This is a schematic diagram of the virtual human gear position provided in an embodiment of the present application. When switching to the virtual human gear position, the first virtual human icon 501 is displayed on the display screen of the PC.

[0121] In some embodiments, the virtual human model corresponding to the virtual human gear position includes a pattern model and a human body detection model, wherein the pattern model includes multiple virtual humans, and the human body detection model is used to obtain user actions.

[0122] In some embodiments, if the gear is switched from the open position to the virtual human position, the pattern model is loaded when the gear is switched to the open position, and the human body detection model is loaded when the gear is switched to the virtual human position; if the gear is switched to the virtual human position before the pattern model is loaded, the preset image is used as the first display data, i.e., the first image, and is transmitted to the transmission channel of the camera; wherein the preset image is an image stored in the on-screen menu adjustment mode (On-Screen Display, OSD). Figure 5b , Figure 5b A schematic diagram of a virtual human gear position provided in an embodiment of the present application, wherein 502 is a preset image.

[0123] In some embodiments, the first display data can be displayed in real time through the built-in application camera of the PC, or the first display data in the camera channel can be called through third-party software (such as video software, conference software, video processing software, etc.) to display the first display data.

[0124] In some embodiments, if the switch is made from the open position to the virtual human position and the virtual human position is switched to within a preset time after the pattern model is loaded in the open mode, the target image selected by the user for the multiple images in the image model is transmitted to the camera channel as the first display data, and the human body detection model is loaded. Figure 5c , FIG. c is a schematic diagram of a virtual human gear position provided in an embodiment of the present application, and 503 is a target image selected by a user.

[0125] In some embodiments, if the pattern model is loaded when the gear is turned on but is not switched to the virtual human gear within a preset time, the pattern mode is released to reduce the occupation of system resources.

[0126] In some embodiments, if the gear is switched directly from the off gear to the virtual human gear, the preset image is transmitted to the camera channel as the first display data while the pattern model and the human body detection model are loaded. After the image model is loaded, the target model selected by the user is transmitted to the camera channel as display data.

[0127] Step S402: In response to switching to the virtual human gear, generating second display data, namely a second image, when a user is detected.

[0128] In some embodiments, if a user is detected and the human body detection model and the pattern model are loaded, second display data is generated based on the target image selected by the user and the user action and transmitted to the camera channel.

[0129] In some embodiments, if it is detected that the user pattern model has been loaded but the human body detection model has not been loaded, the target image selected by the user is transmitted to the camera channel as the second display data until the human body detection model is loaded and the user is detected, then the second display data is generated based on the target image and the user's action and transmitted to the camera channel.

[0130] In some embodiments, if the human body detection model and the image model are loaded and no user is detected within the first preset time, the human body detection model is released.

[0131] Step S403: if it is detected that the user leaves, generate third display data.

[0132] In some embodiments, if the user is detected to leave when the virtual person is in gear, the third display data is generated based on the user action and the target image when the user leaves and transmitted to the camera channel. Or the preset image or the target image is transmitted to the camera channel as the third display data.

[0133] In some embodiments, if the user is not detected within a second preset time after the user leaves, the image model and the human body detection model are released, and the preset image is transmitted to the camera channel as the third display data.

[0134] The image or display data may be a static image or a dynamic image.

[0135] In the embodiments of the present application, by adding a hardware virtual human gear, when the user needs to use a virtual human instead of the user image, the user's privacy and data security are improved; by replacing the user image with a preset image when the virtual human model is loaded, the problem of lag or real image leakage when the user is waiting for loading is solved, thereby improving user privacy and user experience; by uninstalling the virtual human model when it is detected that the user has left and the user is not detected within a preset time, the efficiency of system resource utilization is improved.

[0136] Based on the foregoing embodiments, an embodiment of the present application provides a device for determining a displayed image, which includes the units included and the modules included in the units, and can be implemented by a processor in an electronic device; of course, it can also be implemented by a specific logic circuit; in the implementation process, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP) or a field programmable gate array (FPGA), etc.

[0137] Figure 6A schematic diagram of the structure of a display image determination device provided in an embodiment of the present application is shown in FIG. Figure 6 As shown, the display image determination device 600 includes: a first response module 601, a second response module 602, a third response module 603, and a display module 604, wherein: the first response module 601 is used for responding to switching to the first mode of the electronic device, and the image acquisition unit of the electronic device acquires the first image or the second image, and the first image or the second image is different from the image of the environment where the electronic device is located; the second response module 602 is used for responding to switching to the second mode of the electronic device, and the image acquisition unit of the electronic device acquires the image of the environment where the electronic device is located; the third response module 603 is used for responding to switching to the third mode of the electronic device, and the image acquisition unit of the electronic device is in a closed state; the display module 604 is used for the image acquisition unit to output and display the acquired image or the image acquisition unit to output the acquired image to the application of the electronic device, so that the application displays the image.

[0138] In some embodiments, the display image determination device 600 also includes an acquisition module (not shown in the figure), which is used for, if the electronic device does not meet the first condition, the image acquisition unit of the electronic device to acquire the first image; if the electronic device meets the first condition, the image acquisition unit to acquire the second image, wherein the second image is different from the first image.

[0139] In some embodiments, the first condition includes the electronic device loading a target model; the acquisition module is also used for, if the target model is not loaded, the image acquisition unit of the electronic device to acquire a first image; if the target model is loaded, the image acquisition unit of the electronic device to acquire a second image, wherein the target model is used to determine the second image and send it to the image acquisition unit, wherein the second image is an image stored in the target model, or an image generated based on user features.

[0140] In some embodiments, the target model includes a first model; the acquisition module is also used for, if the target model has been loaded, the image acquisition unit of the electronic device to acquire the second image, including: if the first model has been loaded, the first model determines the second image from multiple stored images and sends it to the image acquisition unit.

[0141] In some embodiments, the target model includes a first model and a second model, the first model has stored multiple images, and the second model is used to identify user features; the acquisition module is also used to, if both the first model and the second model have been loaded, if a user is detected, the target model generates a second image based on the user features identified by the second model and the target image acquired by the first model from the stored multiple images; if the user is not detected, the target model determines the second image from the stored multiple images.

[0142] In some embodiments, the display module 604 is further configured to display the first image if no user is detected for a preset time after displaying the second image.

[0143] In some embodiments, the second response module 602 is further used to start loading the target model in response to switching to the second mode of the electronic device; the first response module 601 is further used to load the target model in response to switching from the third mode of the electronic device to the first mode; wherein the target model is used to determine the second image and send it to the image acquisition unit.

[0144] In some embodiments, the display module 604 is further configured to display a first image on a display screen of the electronic device in response to switching to the first mode of the electronic device.

[0145] In some embodiments, the display image determination device 600 also includes a determination module (not shown in the figure), which is used to determine the target user if a first number of users are detected, and the target model obtains the characteristics of the target user, and determines the second image based on the user characteristics of the target user; or the target model obtains the characteristics of a second number of users, and determines the second image corresponding to each user based on the characteristics of the second number of users, and the second number is less than or equal to the first number.

[0146] The description of the above device embodiment is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. In some embodiments, the functions or modules included in the device provided in the embodiment of the present application can be used to execute the method described in the above method embodiment. For technical details not disclosed in the device embodiment of the present application, please refer to the description of the method embodiment of the present application for understanding.

[0147] It should be noted that in the embodiment of the present application, if the above method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the relevant technology can be embodied in the form of a software product, which is stored in a storage medium, including a number of instructions to enable an electronic device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a disk or an optical disk. In this way, the embodiment of the present application is not limited to any specific hardware, software or firmware, or any combination of hardware, software, and firmware.

[0148] An embodiment of the present application provides an electronic device, including a main body and an image acquisition unit, wherein the image acquisition unit is located in the main body, and the main body has a gear switch that can be moved to different positions. In response to a user moving the gear switch to a first position, the electronic device is in a first mode, and the image acquisition unit of the electronic device acquires a first image or a second image, and the first image or the second image is different from an image of an environment where the electronic device is located; in response to a user moving the gear switch to a second position, the electronic device is in a second mode, and the image acquisition unit of the electronic device acquires an image of the environment where the electronic device is located; in response to a user moving the gear switch to a third position, the electronic device is in a third mode, and the image acquisition unit of the electronic device is in an off state.

[0149] The embodiment of the present application provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, some or all of the steps in the above method are implemented. The computer-readable storage medium can be transient or non-transient.

[0150] An embodiment of the present application provides a computer program, including a computer-readable code. When the computer-readable code is run in an electronic device, a processor in the electronic device executes some or all of the steps for implementing the above method.

[0151] The embodiment of the present application provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and when the computer program is read and executed by a computer, some or all of the steps in the above method are implemented. The computer program product can be implemented specifically by hardware, software or a combination thereof. In some embodiments, the computer program product is specifically embodied as a computer storage medium, and in other embodiments, the computer program product is specifically embodied as a software product, such as a software development kit (SDK) and the like.

[0152] It should be noted here that the description of the various embodiments above tends to emphasize the differences between the various embodiments, and the same or similar aspects can be referenced to each other. The description of the above device, storage medium, computer program and computer program product embodiments is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the embodiments of the device, storage medium, computer program and computer program product of this application, please refer to the description of the method embodiment of this application for understanding.

[0153] Figure 7 A hardware entity diagram of an electronic device provided in an embodiment of the present application, such as Figure 7 As shown, the hardware entity of the electronic device 700 includes: a body 701 and an image acquisition unit 702. The image acquisition unit 702 is located on the body 701. The body 701 has a gear switch 703 that can move to different positions.

[0154] In response to the user moving the shift switch 703 to the first position, the electronic device 700 is in the first mode, and the image acquisition unit 702 of the electronic device 700 acquires a first image or a second image, and the first image or the second image is different from the image of the environment where the electronic device 700 is located;

[0155] In response to the user moving the shift switch 703 to the second position, the electronic device 700 is in the second mode, and the image acquisition unit 702 of the electronic device 700 acquires an image of the environment where the electronic device 700 is located;

[0156] In response to the user moving the shift switch 703 to the third position, the electronic device 700 is in the third mode, and the image acquisition unit 702 of the electronic device 700 is in the off state.

[0157] The first position, the second position, and the third position can form a straight line direction, for example, parallel to one side of the body, or can form a circular direction or an irregular direction. The order in which the first position, the second position, and the third position are set is not limited. It can be moved from the first position to the second position and then to the third position, or the first position can be moved to the third position first and then to the second position.

[0158] In another embodiment, the gear switch can be moved to two positions, namely, the image acquisition unit is turned on and the image acquisition unit is turned off. When the gear is moved to the position where the image acquisition unit is turned on, the electronic device can turn on the virtual human mode through the trigger operation of the software setting interface, so that the electronic device is in the first mode. When the user turns off the virtual human mode, the electronic device is in the second mode. The interface can also be set to include an enable control of the first mode and the second mode. When the gear is moved to the position where the image acquisition unit is turned on, the user triggers the enablement of the first mode or the enablement of the second mode to put the electronic device in the first mode or the second mode.

[0159] An embodiment of the present application provides a computer storage medium, which stores one or more programs. The one or more programs can be executed by one or more processors to implement the steps of the method of any of the above embodiments.

[0160] It should be noted here that the description of the above storage medium and device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium and device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0161] The processor may be at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a Central Processing Unit (CPU), a controller, a microcontroller, and a microprocessor. It is understandable that the electronic device that implements the functions of the processor may also be other, and the embodiments of the present application are not specifically limited.

[0162] The above-mentioned computer storage medium / memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory (Flash Memory), a magnetic surface memory, an optical disk, or a compact disc read-only memory (CD-ROM) and the like; it can also be various terminals including one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.

[0163] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the serial number of each step / process mentioned above does not mean the order of execution, and the execution order of each step / process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The serial numbers of the embodiments of the present application mentioned above are for description only and do not represent the advantages and disadvantages of the embodiments.

[0164] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0165] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0166] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0167] In addition, all functional units in the embodiments of the present application can be integrated into one processing unit, or each unit can be a separate unit, or two or more units can be integrated into one unit; the above integrated unit can be implemented in the form of hardware or in the form of hardware plus software functional units. A person of ordinary skill in the art can understand that all or part of the steps of the above method embodiments can be completed by hardware related to program instructions, and the above program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above method embodiments are executed; and the above storage medium includes: mobile storage devices, read-only memory (ROM), disks or optical disks, etc. Various media that can store program codes.

[0168] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can essentially or in other words, the part that contributes to the relevant technology can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for an electronic device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks, or optical disks.

[0169] The above is only an implementation method of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application.

Claims

1. A method for determining a display image, applied to an electronic device, the method comprising: In response to switching to the first mode of the electronic device, the image acquisition unit of the electronic device acquires a first image or a second image, where the first image or the second image is different from an image of an environment where the electronic device is located; In response to switching to the second mode of the electronic device, the image acquisition unit of the electronic device acquires an image of the environment where the electronic device is located; In response to switching to the third mode of the electronic device, the image acquisition unit of the electronic device is in a closed state; The image acquisition unit outputs and displays the acquired image or the image acquisition unit outputs the acquired image to an application of the electronic device, so that the application displays the image.

2. The method according to claim 1, in response to switching to the first mode of the electronic device, the image acquisition unit of the electronic device acquiring the first image or the second image, comprising: If the electronic device does not meet the first condition, the image acquisition unit of the electronic device acquires the first image; If the electronic device meets the first condition, the image acquisition unit acquires a second image, wherein the second image is different from the first image.

3. The method according to claim 2, wherein the first condition comprises the electronic device loading a target model, If the target model is not loaded, the image acquisition unit of the electronic device acquires a first image; If the target model has been loaded, the image acquisition unit of the electronic device acquires a second image, wherein the target model is used to determine the second image and sends it to the image acquisition unit, in, The second image is an image stored in the target model, or an image generated based on user features.

4. The method according to claim 3, wherein the target model comprises a first model, If the target model has been loaded, the image acquisition unit of the electronic device acquires a second image, including: If the first model has been loaded, the first model determines the second image from the stored multiple images and sends it to the image acquisition unit.

5. The method according to claim 3, wherein the target model comprises a first model and a second model, wherein the first model has stored a plurality of images, and the second model is used to identify user features. If the target model is loaded, the image acquisition unit of the electronic device acquires the second image, including: If both the first model and the second model have been loaded, if a user is detected, the target model generates a second image based on the user features identified by the second model and the target image obtained by the first model from the plurality of stored images; If the user is not detected, the object model determines a second image from the stored plurality of images.

6. The method according to any one of claims 1 to 5, further comprising: After the second image is displayed, if no user is detected for a preset time, the first image is displayed.

7. The method according to any one of claims 1 to 5, further comprising: In response to switching to the second mode of the electronic device, starting to load the target model, or in response to switching from the third mode of the electronic device to the first mode, loading the target model; The target model is used to determine the second image and send it to the image acquisition unit.

8. The method according to any one of claims 1 to 5, further comprising: In response to switching to the first mode of the electronic device, a first image is displayed on the display screen of the electronic device.

9. The method according to any one of claims 1 to 5, further comprising: If a first number of users are detected, a target user is determined, the target model acquires features of the target user, and the second image is determined based on the user features of the target user; Alternatively, the target model obtains features of a second number of users, and determines a second image corresponding to each user based on the features of the second number of users, where the second number is less than or equal to the first number.

10. An electronic device, comprising a body and an image acquisition unit, wherein the image acquisition unit is located in the body, and the body has a shift switch that can move to different positions. In response to the user moving the shift switch to the first position, the electronic device is in the first mode, and the image acquisition unit of the electronic device acquires a first image or a second image, where the first image or the second image is different from the image of the environment where the electronic device is located; In response to the user moving the shift switch to the second position, the electronic device is in the second mode, and the image acquisition unit of the electronic device acquires an image of the environment where the electronic device is located; In response to the user moving the shift switch to the third position, the electronic device is in the third mode, and the image acquisition unit of the electronic device is in a closed state.

Images