Vehicle and image capturing method, device, equipment, storage medium, and computer program product

Abstract

An embodiment of the present application discloses a vehicle and an image capturing method, its device, equipment, storage medium, and computer program product, the method including: acquiring a first image captured by an on-board camera's capturing device in response to an interactive terminal located in a vehicle cabin receiving a first command, the first command being for triggering image capturing by the on-board camera; detecting key features of a predetermined object in the first image to determine at least one predetermined object in the first image; performing effect processing on the at least one predetermined object in the first image based on set first effect display information to obtain a second image; and displaying the second image on the capturing interface of the on-board camera.

Description

[Technical Field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to a Chinese patent application filed with the China Patent Office on September 30, 2021, bearing application number 202111162365.0 and entitled "Vehicle and image capturing method, device, equipment, and storage medium therefor," the entire contents of which are incorporated herein by reference.

[0002] The present application relates to the field of information technology, but is not limited thereto, and in particular to a vehicle and image capturing method, device, apparatus, storage medium and computer program product thereof. [Background technology]

[0003] With the development of information technology, the application of smart cars has become more and more widespread. However, smart cars in related technologies mainly realize intelligent driving functions, and do not fully consider the intelligent entertainment attributes of cars, so they cannot fully meet the experience needs of users. Summary of the Invention [Means for solving the problem]

[0004] Embodiments of the present application provide a vehicle and an image capturing method, an apparatus, a device, a storage medium, and a computer program product thereof.

[0005] The technical solution of the embodiment of the present application is realized as follows:

[0006] An embodiment of the present application provides a method for capturing an image, the method comprising: acquiring a first image captured by a photographing device of an in-vehicle camera in response to an interactive terminal located within the vehicle cabin receiving a first command, the first command being for triggering image capture by the in-vehicle camera; Detecting key features of predetermined objects in the first image to determine at least one predetermined object in the first image; performing effect processing on at least one of the predetermined objects in the first image based on the set first effect display information, thereby obtaining a second image; and displaying the second image on a photography interface of the vehicle-mounted camera.

[0007] An embodiment of the present application provides an image capture device, the device comprising: a first acquisition unit configured to acquire a first image captured by a capture device of an on-board camera in response to an interactive terminal located within the vehicle cabin receiving a first command, the first command being for triggering image capture by the on-board camera; and a first detection portion configured to detect key features of a predetermined object in the first image to determine at least one predetermined object in the first image; a first processing unit configured to perform effect processing on at least one predetermined object in the first image based on set first effect display information, and obtain a second image; and a display portion configured to display the second image on a photographing interface of the vehicle-mounted camera.

[0008] An embodiment of the present application provides a computer device comprising a memory and a processor, wherein the memory stores a computer program executable on the processor, and when the program is executed by the processor, it implements the steps of the above method.

[0009] An embodiment of the present application provides a vehicle, the vehicle comprising: an in-vehicle camera configured to capture image information inside the vehicle; an in-vehicle interactive terminal connected to the in-vehicle camera and configured to receive a first instruction to trigger image capture by the in-vehicle camera, send the first instruction to a processor, and display a capture interface of the in-vehicle camera; The system includes a processor configured to: acquire a first image captured by an on-board camera's imaging device in response to an interactive terminal located within a vehicle cabin receiving a first command, the first command triggering image capture by the on-board camera; detect key features of predetermined objects in the first image to determine at least one predetermined object in the first image; perform effect processing on the at least one predetermined object in the first image based on set first effect display information to obtain a second image; and transmit the second image to the interactive terminal and display the second image on the on-board camera's imaging interface.

[0010] An embodiment of the present application provides a computer storage medium storing a computer program that, when executed by a processor, implements the steps of the above method.

[0011] An embodiment of the present application provides a computer program product including a non-transitory computer-readable storage medium storing a computer program, which, when read and executed by a computer, implements the steps of the above method.

[0012] In one embodiment of the present application, in response to receiving a first command, an interactive terminal located in a vehicle cabin acquires a first image captured by a vehicle-mounted camera's camera device, detects key features of predetermined objects in the first image to determine at least one predetermined object in the first image, performs effect processing on the at least one predetermined object in the first image based on the set first effect display information, obtains a second image, and displays the second image on the vehicle-mounted camera's camera interface. In this way, a user can use the set first effect display information to perform effect processing on the at least one predetermined object in the first image captured by the vehicle-mounted camera's camera device to obtain a second image, thereby improving the imaging quality and enjoyment of the image captured by the vehicle-mounted camera, improving the entertainment value between the vehicle and the person, and better meeting the user's experience needs. The present invention provides, for example, the following. (Item 1) 1. An image capturing method, comprising: acquiring a first image captured by a photographing device of an in-vehicle camera in response to an interactive terminal located within the vehicle cabin receiving a first command, the first command being for triggering image capture by the in-vehicle camera; Detecting key features of predetermined objects in the first image to determine at least one predetermined object in the first image; performing effect processing on at least one of the predetermined objects in the first image based on the set first effect display information, thereby obtaining a second image; and displaying the second image on a photographing interface of the vehicle-mounted camera. Image capture method. (Item 2) The method comprises: If the imager is on, acquiring a third image collected by the imager; determining position information of at least one predetermined object based on the third image; and adjusting the imaging range and / or imaging angle of the imaging device based on position information of at least one of the predetermined objects. Item 1. The imaging method according to item 1. (Item 3) the vehicle-mounted camera is installed in front of a driver's seat or in front of a front row seat in the vehicle interior, and the position information includes riding position information; Adjusting the imaging range and / or imaging angle of the imaging device based on the position information of the at least one predetermined target includes: When it is determined based on the riding position information that each of the predetermined objects in the vehicle interior is riding in a front row seat in the vehicle interior, adjusting the imaging range of the imaging device to a first predetermined imaging range corresponding to the front row seat and / or adjusting the imaging angle of the imaging device to a first predetermined angle corresponding to the front row seat; and when it is determined based on the riding position information that at least two of the predetermined objects in the vehicle interior are riding in at least two different rows of seats in the vehicle interior, adjusting the imaging range of the imaging device to a second predetermined imaging range corresponding to the entire seating area in the vehicle interior and / or adjusting the imaging angle of the imaging device to a second predetermined angle corresponding to the entire seating area in the vehicle interior. Item 2. The imaging method according to item 2. (Item 4) the first effect display information includes an effect material and display position configuration information of the effect material; performing effect processing on at least one of the predetermined objects in the first image based on the set first effect display information to obtain a second image; Executing a display effect process corresponding to the effect material on at least one of the predetermined objects in the first image based on the display position configuration information of the effect material that has been set; determining the first image after display effect processing as a second image. The imaging method according to any one of items 1 to 3. (Item 5) The predetermined object includes at least one of a person in the vehicle, a human body part, and an animal, and the effect material includes at least one of a beauty face material, a beauty makeup material, a filter material, and a sticker material. Item 4. The imaging method according to item 4. (Item 6) the predetermined object includes a face, and the display position configuration information includes a first mapping relationship between a display position parameter of an effect material and a position of a face key point; Executing a display effect process corresponding to the effect material on at least one of the predetermined targets in the first image based on the display position configuration information of the set effect material, determining a display position of the set effect material based on a position of at least one face key point in the first image and the first mapping relationship, and superimposing the effect material on the face based on the display position of the effect material; determining an image processing method corresponding to the set effect material; determining a display position of the set effect material based on a position of at least one face key point in the first image and the first mapping relationship; and processing an image area corresponding to the display position of the effect material on the face in accordance with the image processing method. Item 6. The imaging method according to Item 4 or 5. (Item 7) the predetermined object includes a person in the vehicle, and the effect material includes a sticker of a virtual driving tool; Executing a display effect process corresponding to the effect material on at least one of the predetermined targets in the first image based on the display position configuration information of the set effect material, and displaying an effect scene in which at least one person in the vehicle gets on the virtual traveling tool on the first image based on the display position configuration information of the sticker of the virtual traveling tool that has been set. Item 7. The imaging method according to any one of items 4 to 6. (Item 8) The display position configuration information of the sticker of the virtual traveling tool includes a second mapping relationship between the display position of the sticker of the virtual traveling tool in at least one virtual riding area and the position of a person in the image, and the method includes: detecting a riding position of at least one person in the vehicle cabin based on the first image; Displaying an effect scene in which at least one person in the vehicle cabin rides on the virtual traveling tool on the first image based on the display position configuration information of the sticker of the virtual traveling tool set, determining a first display position of a target virtual riding area corresponding to the riding position based on the riding position and the second mapping relationship; and displaying a sticker of the virtual riding tool on the first image based on the first display position to display an effect scene in which at least one of the personnel is riding in the virtual riding area. Item 7. The imaging method according to item 7. (Item 9) Displaying a sticker of the virtual traveling tool on the first image based on the first display position includes: and superimposing a sticker of the virtual driving tool on the first image so that the target virtual riding area is displayed at the first display position. Item 9. The imaging method according to item 8. (Item 10) The sticker of the virtual traveling tool includes at least one virtual element whose display parameters are adjustable, and the display parameters include a display position and / or a display size; The display position configuration information of the sticker of the virtual traveling tool includes a third mapping relationship between the display position of at least one of the virtual elements of the sticker of the virtual traveling tool and the position of a person in the image; The method comprises: detecting a riding position of at least one person in the vehicle cabin based on the first image, and determining a second display position of at least one of the virtual elements based on the riding position and the third mapping relationship; and / or determining a size of at least one person in the vehicle cabin based on the first image, and determining a target display size of at least one of the virtual elements based on the size; Displaying an effect scene in which at least one person in the vehicle cabin rides on the virtual traveling tool on the first image based on the display position configuration information of the sticker of the virtual traveling tool set, and displaying at least one virtual element on the first image based on a second display position and / or a target display size of the at least one virtual element to display an effect scene in which the at least one person rides on a virtual traveling tool. The imaging method according to any one of items 7 to 9. (Item 11) Displaying the at least one virtual element in the first image based on a second display position and / or a target display size of the at least one virtual element includes: determining a virtual element drawing area in the first image based on a second display position and / or a target display size of at least one of the virtual elements, and drawing the at least one virtual element in the virtual element drawing area; rendering at least one of the virtual elements in the first image based on a second display position and / or a target display size of the at least one virtual element; stitching at least one of the virtual elements to generate the sticker based on a second display position and / or a target display size of each of the virtual elements, and adding the sticker to the first image. Item 11. The imaging method according to item 10. (Item 12) The image capturing method includes: determining the number of virtual elements in the sticker of the virtual driving tool based on the number of people in the vehicle cabin in the first image; Displaying the at least one virtual element in the first image based on a second display position and / or a target display size of the at least one virtual element includes: and displaying each of the virtual elements in the first image based on the number of virtual elements in a sticker of the virtual traveling tool and a second display position and / or a target display size of each of the virtual elements to display an effect scene in which at least one of the personnel rides on the virtual traveling tool. Item 12. The imaging method according to item 10 or 11. (Item 13) Adding the effect material to at least one of the predetermined targets in the first image based on the display position configuration information of the set effect material, detecting an effect triggering action matching the effect material based on the first image; In response to detecting the effect trigger action, adding the effect material to at least one of the predetermined targets in the first image based on the set display position configuration information of the effect material. 13. The imaging method according to any one of items 4 to 12. (Item 14) The image capturing method includes: acquiring a driving restriction status of the dashcam in response to the interactive terminal receiving a second command, the second command being for triggering activation of the dashcam; and and controlling the activation state of the vehicle-mounted camera based on the travel restriction state. 14. The imaging method according to any one of items 1 to 13. (Item 15) Controlling the activation state of the in-vehicle camera based on the travel restriction state The driving restriction state is on, and the driving speed of the vehicle where the interactive terminal is located does not exceed a predetermined threshold; The driving restriction state is on, and the parking signal of the vehicle where the interactive terminal is located indicates that the vehicle is stopped; The driving restriction state is off. and activating the in-vehicle camera when at least one of the following conditions is satisfied: Item 15. The imaging method according to item 14. (Item 16) The interactive terminal includes at least one of an in-vehicle interactive terminal and a user terminal in a vehicle. 16. The imaging method according to any one of items 1 to 15. (Item 17) An image capturing device, a first acquisition unit configured to acquire a first image captured by a capture device of an on-board camera in response to an interactive terminal located within the vehicle cabin receiving a first command, the first command being for triggering image capture by the on-board camera; and a first detection portion configured to detect key features of a predetermined object in the first image to determine at least one predetermined object in the first image; a first processing unit configured to perform effect processing on at least one predetermined object in the first image based on set first effect display information, and obtain a second image; a display portion configured to display the second image on a photographing interface of the vehicle-mounted camera. Image capture device. (Item 18) The apparatus further comprises: a second capture portion configured to capture a third image collected by the imager when the imager is on; a first determination portion configured to determine position information of at least one predetermined object based on the third image; and an adjustment unit configured to adjust the imaging range and / or imaging angle of the imaging device based on position information of at least one of the predetermined objects. Item 18. The imaging device according to item 17. (Item 19) the vehicle-mounted camera is installed in front of a driver's seat or in front of a front row seat in the vehicle interior, and the position information includes riding position information; The adjustment portion further comprises: When it is determined based on the riding position information that each of the predetermined objects in the vehicle interior is riding in a front row seat in the vehicle interior, adjusting the imaging range of the imaging device to a first predetermined imaging range corresponding to the front row seat and / or adjusting the imaging angle of the imaging device to a first predetermined angle corresponding to the front row seat; and when it is determined based on the riding position information that at least two of the predetermined objects in the vehicle interior are riding in at least two different rows of seats in the vehicle interior, adjusting the imaging range of the imaging device to a second predetermined imaging range corresponding to the entire seating area in the vehicle interior and / or adjusting the imaging angle of the imaging device to a second predetermined angle corresponding to the entire seating area in the vehicle interior. Item 19. The imaging device according to item 18. (Item 20) The first effect display information includes an effect material and display position configuration information of the effect material, and the first processing portion further includes: The display effect processing corresponding to the effect material is executed for at least one predetermined target in the first image based on the display position configuration information of the effect material that has been set, and the first image to which the effect material has been added is determined as a second image. 20. The imaging device according to any one of items 17 to 19. (Item 21) The predetermined object includes at least one of a person in the vehicle, a human body part, and an animal, and the effect material includes at least one of a beauty face material, a beauty makeup material, a filter material, and a sticker material. Item 21. The imaging device according to item 20. (Item 22) The predetermined object includes a face, and the display position configuration information includes a first mapping relationship between a display position parameter of an effect material and a position of a face key point, and the first processing unit further includes: determining a display position of the set effect material based on a position of at least one face key point in the first image and the first mapping relationship, and superimposing the effect material on the face based on the set display position of the effect material; determining an image processing method corresponding to the set effect material; determining a display position of the set effect material based on a position of at least one face key point in the first image and the first mapping relationship; and processing an image area corresponding to the display position of the effect material on the face in accordance with the image processing method. 22. The imaging device according to item 20 or 21. (Item 23) The predetermined object includes a person in a vehicle interior, the effect material includes a sticker of a virtual driving tool, and the first processing portion further Based on the display position configuration information of the sticker of the virtual traveling tool that has been set, an effect scene in which at least one person in the vehicle cabin rides on the virtual traveling tool is displayed on the first image. An imaging device according to any one of items 20 to 22. (Item 24) The display position configuration information of the sticker of the virtual traveling tool includes a second mapping relationship between the display position of the sticker of the virtual traveling tool in at least one virtual riding area and the position of the person in the image, and the device further: a second detection portion configured to detect a riding position of at least one person in the vehicle cabin based on the first image; The first processing portion further comprises: and determining a first display position of a target virtual riding area corresponding to the riding position based on the riding position and the second mapping relationship; and displaying a sticker of the virtual riding tool on the first image based on the first display position to display an effect scene in which at least one of the personnel is riding in the virtual riding area. Item 24. The imaging device according to item 23. (Item 25) The first processing portion is further configured to superimpose a sticker of the virtual driving tool on the first image such that the target virtual riding area is displayed at the first display position. Item 25. The imaging device according to item 24. (Item 26) The sticker of the virtual traveling tool includes at least one virtual element whose display parameters are adjustable, and the display parameters include a display position and / or a display size, and the display position configuration information of the sticker of the virtual traveling tool includes a third mapping relationship between the display position of the at least one virtual element of the sticker of the virtual traveling tool and the position of a person in the image, and the device further includes: a second determination unit configured to: detect a riding position of at least one person in the vehicle interior based on the first image, and determine a second display position of at least one of the virtual elements based on the riding position and the third mapping relationship; and / or determine a size of at least one person in the vehicle interior based on the first image, and determine a target display size of the at least one virtual element based on the size; the first processing portion is further configured to display at least one virtual element on the first image based on a second display position and a target display size of the at least one virtual element to display an effect scene in which the at least one person rides on a virtual traveling tool; The imaging device according to any one of items 23 to 25. (Item 27) The first processing portion further comprises: determining a virtual element drawing area in the first image based on a second display position and / or a target display size of at least one of the virtual elements, and drawing the at least one virtual element in the virtual element drawing area; rendering at least one of the virtual elements in the first image based on a second display position and / or a target display size of the at least one virtual element; stitching at least one of the virtual elements to generate the sticker based on a second display position and / or a target display size of each of the virtual elements; and adding the sticker to the first image. Item 27. The imaging device according to item 26. (Item 28) The apparatus further comprises: a third determination portion configured to determine the number of virtual elements in a sticker of the virtual driving tool based on the number of people in the vehicle interior in the first image; The first processing portion further comprises: configured to display each of the virtual elements in the first image based on the number of virtual elements in a sticker of the virtual traveling tool and a second display position and / or a target display size of each of the virtual elements, in order to display an effect scene in which at least one of the personnel rides on the virtual traveling tool; Item 28. The imaging device according to item 26 or 27. (Item 29) The first processing portion further comprises: detecting an effect triggering action matching the effect material based on the first image; In response to detecting the effect trigger operation, adding the effect material to at least one of the predetermined targets in the first image based on the set display position configuration information of the effect material. An imaging device according to any one of items 20 to 28. (Item 30) The apparatus further comprises: a third acquisition portion configured to acquire a driving restriction status of the dashcam in response to the interactive terminal receiving a second command, the second command being to trigger activation of the dashcam; and a control unit configured to control the activation state of the vehicle-mounted camera based on the travel restriction state. An imaging device according to any one of items 17 to 29. (Item 31) The control unit further includes: The driving restriction state is on, and the driving speed of the vehicle where the interactive terminal is located does not exceed a predetermined threshold; The driving restriction state is on, and the parking signal of the vehicle where the interactive terminal is located indicates that the vehicle is stopped; and the driving restriction state is off. Item 31. An imaging device according to item 30. (Item 32) The interactive terminal includes at least one of an in-vehicle interactive terminal and a user terminal in a vehicle. An imaging device according to any one of items 17 to 31. (Item 33) A computer device comprising a memory and a processor, wherein the memory stores a computer program executable on the processor, and when the program is executed by the processor, the computer device realizes the method according to any one of items 1 to 16. (Item 34) A vehicle, an in-vehicle camera configured to capture image information inside the vehicle; an in-vehicle interactive terminal connected to the in-vehicle camera and configured to receive a first instruction to trigger image capture by the in-vehicle camera, send the first instruction to a processor, and display a capture interface of the in-vehicle camera; a processor configured to: acquire a first image captured by a capture device of an in-vehicle camera in response to an interactive terminal located in a vehicle cabin receiving a first command, the first command being for triggering image capture by the in-vehicle camera; detect key features of predetermined objects in the first image to determine at least one predetermined object in the first image; perform effect processing on the at least one predetermined object in the first image based on set first effect display information to obtain a second image; and transmit the second image to the interactive terminal and display the second image on a capture interface of the in-vehicle camera. vehicle. (Item 35) A computer storage medium storing a computer program that, when executed by a processor, causes the computer program to perform the method according to any one of items 1 to 16. (Item 36) A computer program product comprising a non-transitory computer-readable storage medium storing a computer program, the computer program causing a computer to execute the method according to any one of items 1 to 16. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a flowchart illustrating an implementation of an image capturing method according to an embodiment of the present application.

[0014] [Figure 2] 1 is a flowchart illustrating an implementation of an image capturing method according to an embodiment of the present application.

[0015] [Figure 3] 1 is a flowchart illustrating an implementation of an image capturing method according to an embodiment of the present application.

[0016] [Figure 4] 1 is a flowchart illustrating an implementation of an image capturing method according to an embodiment of the present application.

[0017] [Figure 5] According to the embodiment of the present application [ka] FIG. 1 is a structural diagram showing the outline of the configuration of the

[0018] [Figure 6] 1 is a schematic diagram of a hardware entity of a computer device according to an embodiment of the present application; DETAILED DESCRIPTION OF THE INVENTION

[0019] In order to make the objectives, technical solutions and advantages of the present application clearer, the technical solutions of the present application will be described in more detail below in combination with the accompanying drawings and examples. However, the described examples should not be regarded as limitations on the present application, and all other examples obtained by those skilled in the art without performing creative work are deemed to fall within the protection scope of the present application.

[0020] In the following description, "some embodiments" describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same or different subsets of all possible embodiments and still be combinable with each other without conflict.

[0021] If the application documents contain similar descriptions of "first / second," the following explanation shall be added, and in the following explanation, the related terms shall be [ka] merely distinguishes between similar objects and does not represent a particular order for the objects. [ka] The specific order or priority may be rearranged where permitted such that the embodiments of the present application described herein may be performed in an order other than that shown or described herein.

[0022] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art. The terms used herein are for the purpose of describing the present application and are not intended to be limiting.

[0023] An embodiment of the present application provides an image capturing method, the method being performed by a computer device, where the computer device may be any device with appropriate data processing capabilities, such as a smart display device, an in-vehicle controller, an in-vehicle interactive device, a user terminal in a vehicle cabin, a server, a webcam, a notebook personal computer, a tablet personal computer, a desktop computer, a mobile device (such as a mobile phone, a portable video player, a personal digital assistant, a dedicated messaging device, a portable game device, etc.), etc. As shown in Figure 1, the method includes steps S101 to S104.

[0024] In step S101, in response to receiving a first command, an interactive terminal located inside the vehicle cabin acquires a first image captured by an on-board camera's imaging device, the first command being for triggering image capture by the on-board camera.

[0025] Here, the in-vehicle interactive terminal may be any suitable electronic device with an interactive function located in the vehicle interior, and may be located at any suitable position in the vehicle interior, including, but not limited to, a center console, a door, or a seat of the vehicle, and the present application is not limited thereto.

[0026] In some embodiments, the in-vehicle interactive terminal may be an in-vehicle device that can support functions such as in-vehicle information processing and entertainment, and may include a host and a display, and the host and display of the in-vehicle device may be combined or separated.

[0027] Alternatively, the interactive terminal may be a user terminal such as a user's mobile terminal. The user terminal may have a display component for displaying photos. An application for controlling the dashcam may be installed on the user terminal, and the user terminal may issue a shooting command to the dashcam via the cloud or receive photos taken and uploaded by the dashcam via the cloud.

[0028] The in-vehicle camera may be any suitable camera installed in a vehicle, including a video camera product installed in a vehicle, or a camera operated by an interactive terminal in the vehicle cabin, and is not limited thereto. In some embodiments, if the in-vehicle camera is an independent video camera product, the interactive terminal in the vehicle cabin may be the video camera product.

[0029] The images captured by the dashcam may be photos or videos. In some embodiments, when the dashcam is powered on, a shooting interface for the dashcam can be displayed on the interactive terminal in the vehicle. The shooting interface for the dashcam is a user interface for taking photos or videos, and a user can perform photo or video capture operations on the shooting interface.

[0030] The first command may be any suitable command that can trigger the in-vehicle camera to capture an image through the in-vehicle camera's photography interface, including, but not limited to, one or more of an operation command triggered by clicking on the photography button or an empty area of ​​the photography interface, a photography trigger gesture command input on the interactive terminal, a photography trigger voice command input, a steering wheel photography key command input, a photography key command input on the interactive terminal, and a photography command using air gesture control or facial expression control. In response to receiving the first command, the interactive terminal located inside the vehicle cabin can trigger the in-vehicle camera to capture an image, thereby obtaining a first image captured by the in-vehicle camera's photography device. Here, the air gesture control or facial expression control photography command can be obtained by detecting and recognizing a gesture image or facial expression image of a passenger in the vehicle using an in-vehicle smart device communicatively connected to the interactive terminal.

[0031] In some embodiments, the photographing device of the vehicle-mounted camera may be installed together with the interactive terminal in the vehicle cabin or may be separate from the interactive terminal, and the vehicle-mounted camera may use the photographing device to photograph images. In implementation, the interactive terminal in the vehicle cabin may connect to any suitable camera installed inside or outside the vehicle cabin via wired or wireless communication, and use the camera to collect images of the subject to photograph. For example, the vehicle-mounted camera may be connected to a camera installed inside the vehicle cabin (e.g., a camera installed in the center console, door, etc.), a camera installed outside the vehicle cabin (e.g., a dash cam, a backup camera, etc.), or an external camera (e.g., a camera-equipped mobile phone, a camera-equipped tablet PC, a portable camera, etc.), but the embodiments of the present application are not limited thereto.

[0032] In step S102, key features of predetermined objects in the first image are detected to determine at least one predetermined object in the first image.

[0033] Here, the predetermined object may include any one or more suitable objects in the vehicle cabin to be subjected to effect processing, such as a person, an animal, or a face, a human hand, a human body, a car seat, a cat's face, a dog's face, etc. In practice, the predetermined object may be preset by a user according to the actual situation, or may be a system default object, but is not limited thereto.

[0034] The key features of a predetermined object may include any appropriate features for recognizing the predetermined object. In practice, appropriate key features for recognizing the predetermined object may be determined based on the actually used predetermined object, and the embodiments of the present application are not limited thereto. For example, if the predetermined object is a face, the key features of the predetermined object may be key feature features of the face; if the predetermined object is a car seat, the key feature of the predetermined object may be contour feature features of the car seat; if the predetermined object is a cat's face, the key feature of the predetermined object may be key feature features of the cat's face.

[0035] In some embodiments, any suitable target detection model may be employed to detect key features of a predetermined object in the first image to obtain at least one predetermined object in the first image.

[0036] In step S103, effect processing is performed on at least one of the predetermined objects in the first image based on the set first effect display information, thereby obtaining a second image.

[0037] Here, the first effect display information may be any appropriate effect display information set for applying an effect to at least one predetermined object in the first image, and may include, but is not limited to, one or more of the following: a displayed effect material, a display method for the effect material, display parameters for the effect material, an event that triggers the display of the effect material, and a method for converting the predetermined object or the entire first image. Here, the display method for the effect material may be, for example, superimposing the effect material on the original image, converting attributes such as image size or color for a portion or all of the original image, or deleting elements from the original image. The display parameters for the effect material may include, but are not limited to, at least one of a display position parameter, a display size parameter, and a display time parameter. Events that trigger the display of the effect material include, but are not limited to, at least one of a predetermined object performing a specific action, exhibiting a specific state, and a change in the number of predetermined objects. In implementation, the first effect display information may be a system default, or may be set by a user according to their needs before or during image capture. Those skilled in the art can set appropriate first effect display information according to actual situations.

[0038] Based on the first effect display information, effect processing can be performed on at least one predetermined target in the first image. For example, beauty processing can be performed on at least one face in the first image based on the set beauty material, or a sticker material can be displayed on at least one face in the first image based on the set sticker material and its display parameters, or the sticker material can be displayed on the first image based on the position of at least one face in the first image. In implementation, the first image after effect processing can be used as the second image as is, or the second image can be obtained after screen improvement of the first image after effect processing, but this is not limited here.

[0039] Here, a processing method for the first image or a specified object within the first image may be determined based on at least one of the display method, image conversion method, display parameters, etc. in the first effect display information, and the first image or a specified object within the first image may be processed according to the processing method to obtain a second image.

[0040] In some embodiments, when the first image is a single image frame, an effect process can be performed on at least one predetermined object in the single image frame based on the set first effect display information to obtain a second image including the single image frame.

[0041] In some embodiments, when the first image is a first video including multiple consecutive image frames, an effect process can be performed on at least one predetermined object in each image frame of the first video based on the set first effect display information to obtain a second video, i.e., a second image.

[0042] In step S104, the second image is displayed on the photographing interface of the vehicle-mounted camera.

[0043] Here, the second image can be displayed on the shooting interface of the vehicle-mounted camera in an appropriate manner according to the actual situation, but the embodiment of the present application is not limited thereto.

[0044] In some embodiments, the interactive terminal includes at least one of an in-vehicle interactive terminal and an in-vehicle user terminal. Here, the in-vehicle interactive terminal may be any suitable in-vehicle interactive terminal, such as an in-vehicle device or an in-vehicle display device. The in-vehicle user terminal may be any suitable in-vehicle user terminal, including, but not limited to, a mobile phone, a tablet PC, etc. In practice, the in-vehicle user terminal may be held by a user in the vehicle, placed in the vehicle, or fixed in the vehicle in a wearable manner, and is not limited thereto.

[0045] In one embodiment of the present application, in response to receiving a first command, an interactive terminal located in a vehicle interior acquires a first image captured by a vehicle-mounted camera's photographing device, detects key features of predetermined objects in the first image to determine at least one predetermined object in the first image, performs effect processing on the at least one predetermined object in the first image based on the first set of effect display information, obtains a second image, and displays the second image on the vehicle-mounted camera's photographing interface. In this way, a user can use the first set of effect display information to perform effect processing on the at least one predetermined object in the first image captured by the vehicle-mounted camera's photographing device to obtain a second image, thereby improving the imaging quality and enjoyment of the image captured by the vehicle-mounted camera, and extending the photographing and image effect processing to the vehicle interior scene, enriching the interaction between people and cars, improving the entertainment value between cars and people, and better meeting the user's experience needs.

[0046] In some embodiments, the following steps may be further included before the above step S103.

[0047] In step S111, in response to a first effect setting operation executed on the photographing interface, set first effect display information is acquired.

[0048] Here, the user can perform any appropriate first effect setting operation on the vehicle-mounted camera's shooting interface according to actual needs and set appropriate first effect display information for capturing an image so that the resulting second image will exhibit the corresponding effect. The first effect setting operation can include, but is not limited to, one or more of the following operations: adding, deleting, and setting display parameters for an effect. Effects that can be added include, but are not limited to, one or more of sticker effects, beauty effects, cosmetic effects, background effects, foreground effects, and lens effects. Different display information can be set for different effects, and the acquired first effect display information can include the effect materials and display parameters for at least one effect set by the first effect setting operation. For example, if the effect set by the first effect setting operation is a beauty effect, the acquired first effect display information can include the set beauty type, the action area, effect intensity, transparency, etc. of the beauty type. Furthermore, for example, if the effect set by the first effect setting operation is a sticker effect, the acquired first effect display information may include the added sticker material and the display position, display size, transparency, etc. set for the sticker material.

[0049] In the above embodiment, the first effect display information is set in response to the first effect setting operation performed on the shooting interface, so that the user can set the effect display information used for shooting according to actual needs, thereby further improving the entertainment value between the car and the person and better meeting the user's experience needs.

[0050] In some embodiments, the above method may further include steps S121 to S122 as follows.

[0051] In step S121, in response to a second effect setting operation executed on a fourth image to be edited through the image editing interface of the vehicle-mounted camera, the set second effect display information is acquired.

[0052] Here, the image editing interface of the dashcam may be any suitable interface for editing the fourth image in the dashcam. The fourth image may include, but is not limited to, an image captured in the past by the dashcam, an image currently captured by the dashcam, an imported image, etc. In some embodiments, the image editing interface of the dashcam may be displayed on an interactive terminal.

[0053] The second effect setting operation may be any appropriate operation performed by the user to edit the effect on the fourth image according to actual needs. The second effect setting operation may include, but is not limited to, one or more of the following: adding, deleting, and setting display parameters for an effect. Effects that can be added include, but are not limited to, sticker effects, beauty effects, cosmetic effects, background effects, foreground effects, and lens effects. Different display parameters can be set for different effects, and the acquired second effect display information may include the effect material of at least one effect set by the second effect setting operation and the display parameters of each effect material. For example, if the effect set by the second effect setting operation is a beauty effect, the acquired second effect display information may include the set beauty type, the area of ​​effect for that beauty type, effect intensity, transparency, etc. Furthermore, for example, if the effect set by the second effect setting operation is a sticker effect, the acquired first effect display information may include the added sticker material and the display position, display size, transparency, etc. set for the sticker material.

[0054] In step S122, effect processing is performed on the fourth image based on the second effect display information.

[0055] Here, effect processing can be performed on the fourth image based on the second effect display information. For example, beauty processing can be performed on at least one face in the fourth image based on the set beauty material, or a sticker material can be displayed on the fourth image based on the set sticker material and its display parameters.

[0056] In an embodiment of the present application, in response to a second effect setting operation performed on a fourth image to be edited in the image editing interface of the in-vehicle camera, the set second effect display information is obtained, and effect processing is performed on the fourth image based on the second effect display information. In this way, the user can set effects for the image to be edited in the image editing interface of the in-vehicle camera according to actual needs, thereby achieving symmetrical interaction between people and vehicles and better meeting the user's experience needs.

[0057] An embodiment of the present application provides an image capturing method, which is executed by a computer device. As shown in Figure 2, the method includes the following steps S201 to S207.

[0058] In step S201, if the photographing device is on, obtain a third image collected by the photographing device.

[0059] Here, the third image may be any suitable image collected when the imager is on.

[0060] In step S202, position information of at least one predetermined object is determined based on the third image.

[0061] Here, by detecting key features of the predetermined object in the third image, position information of at least one predetermined object in the third image can be obtained. The position information of the predetermined object can be any suitable information that can represent the position of the predetermined object in the first image, including, but not limited to, the coordinates of the center point of the predetermined object in the first image, the pixel area occupied by the predetermined object in the first image, etc.

[0062] In step S203, the imaging range and / or imaging angle of the imaging device is adjusted based on the position information of at least one of the predetermined objects.

[0063] Here, the imaging range and / or imaging angle of the imaging device of the onboard camera can be adjusted to an appropriate value based on position information of at least one predetermined object so that the imaging device of the onboard camera can automatically adapt to the positional distribution of predetermined objects within the vehicle cabin. In implementation, the imaging range and / or imaging angle of the imaging device can be adjusted with an appropriate adjustment policy based on position information of at least one predetermined object depending on the actual situation, and this is not limited thereto. For example, if only the driver is detected in the third image, the imaging range of the imaging device can be reduced and / or the imaging angle of the imaging device can be adjusted based on the driver's position information so that the imaging device captures only the area where the driver is located. Furthermore, for example, if multiple passengers are detected in the third image, the imaging range of the imaging device can be increased and / or the imaging angle of the imaging device can be adjusted based on the position information of the multiple passengers so that the imaging device can better capture the multiple passengers.

[0064] In step S204, in response to receiving a first command, the interactive terminal located in the vehicle cabin acquires a first image captured by the onboard camera's imaging device, the first command being for triggering the onboard camera to capture an image.

[0065] In step S205, key features of predetermined objects in the first image are detected to determine at least one predetermined object in the first image.

[0066] In step S206, effect processing is performed on at least one of the predetermined objects in the first image based on the set first effect display information, thereby obtaining a second image.

[0067] In step S207, the second image is displayed on the photographing interface of the vehicle-mounted camera.

[0068] Here, the above steps S204 to S207 correspond to the above steps S101 to S104, respectively, and in carrying out the steps, reference can be made to the specific embodiments of the above steps S101 to S104.

[0069] In an embodiment of the present application, when the camera is turned on, a third image collected by the camera is acquired, position information of at least one predetermined object is determined based on the third image, and the camera range and / or the camera angle are adjusted based on the position information of the at least one predetermined object. In this way, the camera of the vehicle-mounted camera automatically adapts to the position distribution situation of the predetermined objects in the vehicle cabin, and the camera range and / or the camera angle can be adjusted, realizing more flexible control of the camera range and / or the camera angle and helping to capture higher quality images.

[0070] In some embodiments, the vehicle-mounted camera is installed in front of the driver's seat in the vehicle interior or in front of the front row of seats in the vehicle interior, the location information includes riding location information, and the above step S203 may include the following steps:

[0071] In step S211, if it is determined based on the riding position information that each of the predetermined objects in the vehicle interior is riding in a front row seat in the vehicle interior, adjusting the imaging range of the imaging device to a first predetermined imaging range corresponding to the front row seat, and / or adjusting the imaging angle of the imaging device to a first predetermined angle corresponding to the front row seat; Here, the riding position information may be the seat area where a specific object is located within the vehicle cabin, and may include one or more of the front row seats, the second row seats, the last row seats, the driver's seat, the passenger seat, etc., but is not limited to these.

[0072] In implementation, a correspondence between at least one seat area in the vehicle cabin and the imaging range and / or imaging angle of the imaging device can be set in advance according to the actual situation, and a first predetermined imaging range corresponding to the front row seats and / or a first predetermined angle corresponding to the front row seats can be determined based on the correspondence, and further, the area in the vehicle cabin where the front row seats are located can be automatically recognized using image recognition technology, and an appropriate first predetermined imaging range and / or first predetermined angle can be automatically determined based on the area.

[0073] In step S212, if it is determined based on the riding position information that at least two of the specified objects in the vehicle cabin are riding in at least two different rows of seats in the vehicle cabin, the imaging range of the imaging device is adjusted to a second specified imaging range corresponding to the entire seating area in the vehicle cabin, and / or the imaging angle of the imaging device is adjusted to a second specified angle corresponding to the entire seating area in the vehicle cabin.

[0074] Here, the second predetermined imaging range and / or the second predetermined angle corresponding to the entire seating area in the vehicle cabin may be preset or may be automatically determined by image recognition technology, and are not limited here.

[0075] In the above embodiment, the imaging range and / or imaging angle of the imaging device can be automatically adjusted based on the seat information of at least one predetermined object in the vehicle cabin, thereby further improving the entertainment value between the vehicle and the person.

[0076] In some embodiments, the effect display information may include display position configuration information for the effect material. The display position configuration information is information for configuring the display position of the effect material in an image. In this case, an embodiment of the present application provides an image capturing method, which is executed by a computer device. As shown in FIG. 3, the method may include the following steps S301 to S305.

[0077] In step S301, in response to receiving a first command, an interactive terminal located inside the vehicle cabin acquires a first image captured by an on-board camera's imaging device, the first command being for triggering the on-board camera to capture an image.

[0078] In step S302, key features of predetermined objects in the first image are detected to determine at least one predetermined object in the first image.

[0079] Here, the above steps S301 to S302 correspond to the above steps S101 to S102, respectively, and in carrying out the steps, reference can be made to the specific embodiments of the above steps S101 to S102.

[0080] In step S303, display effect processing corresponding to the effect material is performed on at least one of the predetermined targets in the first image based on the display position configuration information of the effect material that has been set.

[0081] Here, the display position configuration information of the effect material may be configuration information of the display position of the effect material in the first image. In implementation, appropriate display position configuration information for the effect material can be set according to actual conditions, and is not limited here. For example, the display position configuration information may include coordinates of the display position of the effect material in the first image, or may include a mapping relationship between the coordinates of the display position of the effect material and the position of a key point of a predetermined target.

[0082] Based on the display position configuration information of the effect material, a corresponding display effect processing can be performed on the first image. For example, the effect material can be added to at least one predetermined target in the first image. The added effect material can be displayed on the predetermined target, or at a position other than the predetermined target in the first image. Alternatively, based on the display position configuration information of the effect material, image processing corresponding to the effect material can be performed on a predetermined target in the first image. For example, based on the set beauty material, beauty processing can be performed on at least one face in the first image, based on the set sticker material and display parameters of the sticker material, or based on the set sticker material and display parameters of the sticker material, the sticker material can be displayed around at least one car seat in the first image.

[0083] In some embodiments, an effect material can be displayed in a first image based on the positional region of at least one predetermined object and display position configuration information for the effect material. Specifically, the display position configuration information for the effect material includes a mapping relationship between the coordinates of the display position and the positional region of the predetermined object. Based on this mapping relationship, at least one display position corresponding to the positional region of at least one predetermined object in the first image can be determined, and the effect material can be displayed at that display position. For example, to achieve the effect of a person wearing sunglasses, sunglasses image material can be superimposed at the position of the human eye. To achieve a display effect corresponding to the effect material, processing such as image brightness conversion, chromaticity conversion, and style conversion can be performed on the area in the first image corresponding to the display position. For example, in facial beauty effect processing, the color value of the face area can be adjusted to achieve a display effect corresponding to "whitening" effect material.

[0084] In step S304, the first image after the display effect processing corresponding to the effect material is performed is determined as the second image.

[0085] In step S305, the second image is displayed on the photographing interface of the vehicle-mounted camera.

[0086] Here, the above step S305 corresponds to the aforementioned step S104, and in its implementation, reference can be made to the specific embodiment of the aforementioned step S104.

[0087] In an embodiment of the present application, the first effect display information includes effect materials and display position configuration information for the effect materials, and based on the set display position configuration information for the effect materials, a display effect process corresponding to the effect material is performed on at least one predetermined object in the first image, and the image after the display effect process is determined as the second image. In this way, it is possible to easily and quickly perform effect processing on at least one predetermined object in the first image, preview the result of the effect processing, and improve the flexibility and processing efficiency of the image processing method for the vehicle interior.

[0088] In some embodiments, the predetermined object includes at least one of a person (human body), a human body part, or an animal in the vehicle cabin, and the effect material includes at least one of a beauty face material, a beauty makeup material, a filter material, or a sticker material.

[0089] Here, the effect material is a material required to produce an effect, and may include one or more of the following, but is not limited to: sticker material (cartoon sticker, flower sticker, star sticker, virtual car interior scene sticker, virtual cabin scene sticker, virtual roller coaster scene sticker, etc.), beauty material (material required for effects such as skin peeling, face lift, big eyes, etc.), beauty makeup material (lipstick, mascara, eye shadow, blusher, etc.), filter material (material required for effects such as retro filter, soft filter, de-fog filter, etc.).

[0090] In some embodiments, the predetermined object includes a face, and the display position configuration information includes a first mapping relationship between the display position parameters of the effect material and the positions of the face key points, and the above step S303 may include step S311 and / or step S312.

[0091] In step S311, the display position of the set effect material is determined based on the position of at least one face key point in the first image and the first mapping relationship, and the effect material is superimposed on the face based on the display position of the effect material.

[0092] In step S312, an image processing method corresponding to the set effect material is determined, a display position of the set effect material is determined based on the position of at least one face key point in the first image and the first mapping relationship, and an image area corresponding to the display position of the effect material on the face is processed according to the image processing method.

[0093] Here, facial key points in the first image can be detected, and the position of at least one facial key point in the first image can be determined. A display position of an effect material corresponding to the position of at least one facial key point can be determined based on a first mapping relationship between the display position parameters of the effect material and the positions of the facial key points. Based on the determined display position of the effect material, the effect material can be displayed in the first image by superimposing or overwriting, thereby superimposing the effect material on at least one face in the first image. The material superimposed on the face can be, for example, one or more of beauty material, makeup material, filter material, sticker material, etc. Alternatively, corresponding image processing can be performed on a facial region in the image according to an image processing method corresponding to a pre-arranged effect material. For example, to achieve "whitening" processing of a face in an image, pixel value conversion can be performed on an image region on the face corresponding to the display position of the effect material based on a pixel value conversion method corresponding to the "whitening" effect material.

[0094] In some embodiments, the first mapping relationship between the display position parameters of the effect material and the positions of the facial key points may include a correspondence relationship between the set display position parameters of the effect material and the positions of the facial key points. In some examples, the first mapping relationship between the display position parameters of the effect material and the positions of the facial key points may be a mutual conversion method between the display position parameters of the effect material and the positions of the facial key points, such as a formula for calculating the display position parameters of the effect material based on the positions of the facial key points, or a conversion algorithm for converting the positions of the facial key points into the display position parameters of the effect material.

[0095] In some embodiments, the predetermined object includes a person in the vehicle cabin, and the effect material includes a sticker of a virtual driving tool, and the above step S303 may include the following steps:

[0096] In step S321, based on the display position configuration information of the sticker of the virtual traveling tool that has been set, an effect scene in which at least one person in the vehicle cabin rides on the virtual traveling tool is displayed on the first image.

[0097] Here, the person in the vehicle cabin may include a driver or a passenger in the vehicle cabin. In implementation, the at least one person in the vehicle cabin may be determined by detecting face key points in the first image, or by detecting a human body posture in the first image, and the at least one person in the vehicle cabin may be determined, but this is not limited thereto.

[0098] The virtual driving tool sticker may be any suitable sticker that provides a virtual driving tool riding effect, such as a virtual vehicle interior sticker, a virtual cabin sticker, or a virtual roller coaster sticker. The display position of the virtual driving tool sticker in the first image can be determined based on the display position configuration information of the virtual driving tool sticker. Based on the display position configuration information, an effect scene of at least one vehicle interior person riding the virtual driving tool can be displayed in the first image. This can further enhance the enjoyment of capturing images with an on-board camera.

[0099] In some embodiments, the above step S303 may include the following steps S331 to S332.

[0100] In step S331, an effect trigger action that matches the effect material is detected based on the first image.

[0101] Here, each effect material may have a corresponding effect trigger action, which may include, but is not limited to, one or more of facial actions, gestures, limb actions, etc. In implementation, the effect trigger action matching the effect material may be a default one, or the effect trigger action matching the effect material may be determined by checking a predetermined correspondence between the effect material and the effect trigger action, or the effect trigger action set by the user before or during image capture may be obtained based on the effect material set by the user, and is not limited here.

[0102] In step S332, in response to detecting the effect trigger action, the effect material is added to at least one of the predetermined targets in the first image based on the display position configuration information of the effect material that has been set.

[0103] When an effect trigger action is detected in the first image, an effect material can be added to at least one predetermined object in the first image based on the display position configuration information of the set effect material. In this way, the enjoyment of image capture by the in-vehicle camera can be further improved, and the entertainment value between the vehicle and the person can be further improved, thereby better satisfying the user's experience needs.

[0104] In some embodiments, the display position configuration information of the virtual driving tool sticker includes a second mapping relationship between the display position of at least one virtual riding area of ​​the virtual driving tool sticker and the position of a person in the image, and the above method may further include step S341 as follows:

[0105] In step S341, the riding position of at least one person in the vehicle compartment is detected based on the first image.

[0106] Here, the passenger's riding position may be the position where the passenger is present or the position of the seat where the passenger is riding, and is not limited thereto.

[0107] The above step S321 may include the following steps S342 and S343.

[0108] In step S342, a first display position of the target virtual riding area corresponding to the riding position is determined based on the riding position and the second mapping relationship.

[0109] Here, based on a second mapping relationship between the display position of at least one virtual riding area of ​​the sticker of the virtual driving tool and the position of the person in the image, a first display position of the target virtual riding area corresponding to the riding position of at least one person in the vehicle cabin can be determined.

[0110] In some embodiments, the second mapping relationship between the display position of the at least one virtual ride area of ​​the sticker of the virtual driving tool and the position of the person in the image may be a correspondence relationship between the display position of the at least one virtual ride area of ​​the sticker of the set virtual driving tool and the position of the person in the image. In some examples, the second mapping relationship between the display position of the at least one virtual ride area of ​​the sticker of the virtual driving tool and the position of the person in the image may be a manner of mutual conversion between the display position of the virtual ride area and the position of the person in the image, such as a formula for calculating the display position of the virtual ride area according to the position of the person in the image, or a conversion algorithm for converting the position of the person in the image to the display position of the virtual ride area.

[0111] In step S343, a sticker of the virtual traveling tool is displayed on the first image based on the first display position to display an effect scene in which at least one of the personnel is riding in the virtual riding area.

[0112] In the above embodiment, the riding position of at least one person in the vehicle cabin is detected based on the first image, and a first display position of the target virtual riding area is determined based on the riding position and the display position of at least one virtual riding area of ​​the virtual travel tool sticker, and a second mapping relationship between the position of the person in the image, and the position of the person. The virtual travel tool sticker is displayed on the first image based on the first display position to display an effect scene in which at least one person is riding in the virtual riding area. In this way, the virtual travel tool sticker can be automatically displayed at an appropriate position based on the riding position of the person in the vehicle cabin, which can further improve the enjoyment of image capture by the on-board camera and further improve the entertainment value between the vehicle and the person, thereby better meeting the user's experience needs.

[0113] In some embodiments, the above step S343 may include step S351 of superimposing a sticker of the virtual driving tool on the first image so that the target virtual riding area is displayed at the first display position. Here, the sticker superimposition method can easily and quickly display the sticker of the virtual riding tool and display an effect scene in which at least one person is riding in the virtual riding area.

[0114] In some embodiments, the virtual travel tool sticker includes at least one virtual element having adjustable display parameters, the display parameters including a display position and / or a display size, and the display position configuration information of the virtual travel tool sticker includes a third mapping relationship between the display position of the at least one virtual element of the virtual travel tool sticker and the position of a person in the image, and the above method may further include at least one of the following steps S361 and S362.

[0115] In step S361, a riding position of at least one person in the vehicle cabin is detected based on the first image, and a second display position of at least one of the virtual elements is determined based on the riding position and the third mapping relationship.

[0116] Here, the riding position of at least one person in the vehicle cabin can be detected based on the first image by any suitable image detection method.

[0117] The virtual element may be any suitable element whose display parameters in the sticker of the virtual driving tool are adjustable, such as one or more of a virtual seat element, a virtual steering wheel element, a virtual window element, etc. The display parameters of the virtual element may be automatically adjusted according to the riding position or size of the passengers in the vehicle, or may be manually adjusted by the user, but this is not limited thereto. In implementation, by adjusting the display parameters of the virtual element in the sticker of the virtual driving tool, the sticker of the virtual driving tool can completely overwrite important parts in the vehicle interior, such as seats and steering wheels, in different scenes. For example, in the case of a roller coaster sticker, parts in the real scene inside the vehicle interior, such as steering wheels, can be overwritten by adjusting the display position and display size of the front edge pattern of the virtual roller coaster.

[0118] Based on a third mapping relationship between the display position of at least one virtual element of the sticker of the virtual driving tool and the position of a person in the image, a second display position of the virtual element corresponding to the riding position of at least one person in the vehicle cabin can be determined.

[0119] In some embodiments, the third mapping relationship between the display position of the at least one virtual element in the sticker of the virtual traveling tool and the position of the person in the image may include a correspondence relationship between the display position of the at least one virtual element in the set sticker of the virtual traveling tool and the position of the person in the image. In some examples, the third mapping relationship between the display position of the at least one virtual element in the sticker of the virtual traveling tool and the position of the person in the image may be a manner of mutual conversion between the display position of the virtual element and the position of the person in the image, such as a formula for calculating the display position of the virtual element based on the position of the person in the image, or a conversion algorithm for converting the position of the person in the image to the display position of the virtual element.

[0120] In step S362, a size of at least one person in the vehicle cabin is determined based on the first image, and a target display size of at least one of the virtual elements is determined based on the size.

[0121] Here, the size of the person may include, but is not limited to, one or more of the area that the person occupies in the first image, the width of the head, the width of the torso, the length of the torso, etc.

[0122] The display size of the virtual element may be an appropriate display indicator determined depending on the shape and type of the virtual element, such as the length, width, area, perimeter, diameter, etc. In some embodiments, the virtual element may be two-dimensional or three-dimensional, and if the virtual element is a three-dimensional element, the display size may also include the height of the virtual element.

[0123] In implementation, the target display size of the at least one virtual element can be determined based on the size of the at least one person in the vehicle cabin in an appropriate manner according to actual needs, and is not limited thereto. For example, a correspondence relationship between the size of the person in the vehicle cabin and the display size of the virtual element can be preset, and the target display size of the at least one virtual element corresponding to the size of the at least one person can be determined based on the correspondence relationship.

[0124] The above step S321 may include the following step S363.

[0125] In step S363, at least one virtual element is displayed in the first image based on a second display position and / or a target display size of the at least one virtual element to display an effect scene in which at least one person rides a virtual traveling tool.

[0126] In the above embodiment, the second display position and / or display size of at least one virtual element, the display parameters of which are adjustable in the sticker of the virtual driving tool, can be determined based on the riding position and size of the passengers in the vehicle cabin, and the corresponding virtual element can be displayed in the first image based on the second display position and / or target display size of the at least one virtual element, thereby displaying an appropriate sticker of the virtual driving tool based on the riding position and size of the passengers in the vehicle cabin, further improving the entertainment value between the vehicle and the person, and better meeting the user's experience needs.

[0127] In some embodiments, the above step S363 may include one of steps S371 to S373.

[0128] In step S371, a virtual element drawing area in the first image is determined based on a second display position and / or a target display size of at least one of the virtual elements, and at least one of the virtual elements is drawn in the virtual element drawing area.

[0129] Here, the shape, display effect, etc. of the virtual element drawing area in the first image can be determined in an appropriate manner according to the actual situation, and the embodiment of the present application is not limited thereto.

[0130] In step S372, the at least one virtual element is rendered in the first image based on a second display position and / or a target display size of the at least one virtual element.

[0131] Here, any suitable image rendering algorithm can be employed to render the virtual element in the first image, and embodiments of the present application are not limited thereto.

[0132] In step S373, based on the second display position and / or the target display size of each of the virtual elements, stitch at least one of the virtual elements to generate the sticker, and add the sticker to the first image.

[0133] In some embodiments, the method may further include a step S381 of determining the number of virtual elements in a sticker of the virtual driving tool based on the number of people in the vehicle interior in the first image.

[0134] Here, the number of virtual elements on the sticker of the virtual driving tool may be the same as or related to the number of people in the vehicle interior in the first image, but is not limited thereto. In some embodiments, an appropriate quantity correspondence can be determined according to the actual situation, and the quantity correspondence can be used to determine the number of virtual elements on the sticker of the virtual driving tool based on the number of people in the vehicle interior in the first image.

[0135] The above step S363 may include step S382 of displaying each of the virtual elements in the first image based on the number of virtual elements in the sticker of the virtual traveling tool and the second display position and / or target display size of each of the virtual elements, to display an effect scene in which at least one of the personnel rides on the virtual traveling tool.

[0136] In the above embodiment, the number of virtual elements in the sticker of the virtual driving tool is determined based on the number of people in the vehicle cabin in the first image, and each virtual element is displayed in the first image based on the number of virtual elements and the second display position and target display size of each virtual element to display an effect scene of at least one person riding in the virtual driving tool. In this way, in a scene with multiple people in the vehicle cabin, the number and display parameters of the virtual elements in the virtual driving tool are correspondingly set based on the number of people and the riding positions of each person. For example, the number and positions of virtual seats in a roller coaster sticker can be set to match the number and riding positions of the people in the vehicle cabin, and the sticker elements of different seats can be adjusted and then stitched into a complete sticker, so that the sticker can be more accurately tailored to the number of people and riding positions in the vehicle cabin and better meet the user's experience needs.

[0137] An embodiment of the present application provides an image capturing method, which is executed by a computer device. As shown in Figure 4, the method includes the following steps S401 to S406.

[0138] In step S401, the interactive terminal obtains a driving restriction status of the in-vehicle camera in response to receiving a second command, the second command being for triggering activation of the in-vehicle camera.

[0139] Here, the second command may be any suitable command that can trigger the activation of the in-vehicle camera, and may include, but is not limited to, one or more of an operation command that triggers a camera activation click operation on the display of the interactive terminal in the vehicle cabin, an input camera activation voice command, an input camera activation key command, etc.

[0140] The driving restriction state of the dashcam is a state indicating whether the use of the dashcam while driving is restricted. The driving restriction state can be on or off. When the driving restriction state is on, the use of the dashcam while driving can be restricted, and when the driving restriction state is off, the use of the dashcam while driving does not need to be restricted. In practice, the driving restriction state may be a state preset by a user, a system default state, or a state automatically determined based on the current driving state of the vehicle where the interactive terminal is located, and is not limited thereto.

[0141] In step S402, the activation state of the vehicle-mounted camera is controlled based on the travel restriction state.

[0142] When the interactive terminal receives the second command, it controls the activation state of the in-vehicle camera based on the acquired driving restriction state. For example, when the driving restriction state is on, it prohibits the activation of the in-vehicle camera, and when the driving restriction state is off, it can activate the in-vehicle camera. Furthermore, when the driving restriction state is on and the driving speed of the vehicle where the interactive terminal is located is higher than a set speed threshold, it can prohibit the activation of the in-vehicle camera.

[0143] In step S403, in response to receiving a first command, the interactive terminal located in the vehicle cabin acquires a first image captured by an on-board camera's imaging device, the first command being for triggering the on-board camera to capture an image.

[0144] In step S404, key features of predetermined objects in the first image are detected to determine at least one predetermined object in the first image.

[0145] In step S405, effect processing is performed on at least one of the predetermined objects in the first image based on the set first effect display information, thereby obtaining a second image.

[0146] In step S406, the second image is displayed on the photographing interface of the vehicle-mounted camera.

[0147] In an embodiment of the present application, in response to receiving a second command to trigger the activation of the dashcam, the interactive terminal obtains the driving restriction status of the dashcam, and controls the activation status of the dashcam based on the driving restriction status, thereby flexibly controlling the use of the dashcam according to actual needs and thereby better satisfying the user's usage experience.

[0148] In some embodiments, the above step S402 may include the following step S411, step S412, or step S413.

[0149] In step S411, if the driving restriction state is on and the driving speed of the vehicle where the interactive terminal is located does not exceed a predetermined threshold, activate the in-vehicle camera, thereby ensuring that the driving speed of the vehicle does not exceed a predetermined threshold when using the in-vehicle camera to capture entertainment, thereby effectively improving safety during the use of the in-vehicle camera.

[0150] In step S412, if the driving restriction state is on and the parking signal of the vehicle where the interactive terminal is located indicates that the vehicle is stopped, activate the in-vehicle camera, thereby ensuring that the vehicle is stopped when using the in-vehicle camera to capture entertainment, and thereby effectively improving safety during the use of the in-vehicle camera.

[0151] In step S413, if the driving restriction state is OFF, the dashcam is activated. In this way, the user can set the driving restriction state of the dashcam to OFF according to actual needs, so that the use of the dashcam is not restricted by the driving state of the vehicle, and the use needs of the user can be better met.

[0152] The following describes an exemplary application of the present invention in a practical application scenario.

[0153] In the related technology, automobiles are a typical product for outings, and are used as walking substitutes. [ka] Furthermore, vehicles are evolving into smart mobile spaces and are being given more entertainment features. In some technical solutions in the related art, automotive products are based on in-car cameras to provide car owners with camera functions for taking selfies when driving or on family trips. However, these selfies generally have low imaging quality due to special interior conditions such as dark lighting, and car owners are unable to take fun and interactive photos.

[0154] In view of this, embodiments of the present application provide an image capturing method that employs visual recognition technologies such as face detection and gesture recognition within the vehicle cabin to effectively apply and display effect materials such as beauty treatments, filters, and stickers to the face, thereby effectively resolving the problem of poor selfie quality in vehicle-mounted cameras and improving the interactivity and entertainment value between the vehicle cabin and the vehicle owner. For example, if a vehicle owner is driving alone and wants to take a selfie while holding the steering wheel, the vehicle owner can use the image capturing method of the present application to start up the vehicle-mounted camera, turn on the beauty treatment function with one touch, and take a photo after the beauty treatment. Furthermore, if a family of four is driving together and wants to take a fun family photo, the vehicle owner can use the image capturing method of the present application to start up the vehicle-mounted camera, select a sticker, and have all family members simultaneously make gestures that match the sticker to trigger the sticker effect, thereby taking a fun family photo.

[0155] An embodiment of the present application provides an image capturing method, which may include the following steps S501 to S504.

[0156] In step S501, the user presses the in-vehicle device button or [ka] The in-car camera can be activated by clicking on the

[0157] In some embodiments, in consideration of vehicle safety, a vehicle movement switch (corresponding to the driving restriction state in the above embodiment) can be designed in the dash camera. When the vehicle movement switch is on, the user can start the dash camera when the vehicle is stationary, and the user cannot start the dash camera when the vehicle is moving. When the vehicle movement switch is off, the user can start the dash camera whether the vehicle is moving or stationary.

[0158] In some embodiments, the vehicle movement switch may be on by default.

[0159] In step S502, after the vehicle-mounted camera is started, the activation of the photographing device of the vehicle-mounted camera is controlled, and the screen photographed by the photographing device is displayed in real time on the photographing interface of the vehicle-mounted camera of the vehicle-mounted device.

[0160] Here, the imaging angle of the onboard camera covers the entire interior environment of the automobile. The onboard camera detects and tracks faces and passengers in the automobile interior using a built-in facial keypoint detection and tracking vision algorithm. Because the interior scene includes passengers in the front passenger seat and passengers in the rear seat, the design angle of the field of view (FOV) of the imaging device may be more than 120 degrees, and the facial pixels recognized by the facial keypoint detection and tracking vision algorithm may be less than 64*64.

[0161] In step S503, the user uses one or more beauty materials, sticker materials and / or filter materials in the in-vehicle camera, and the in-vehicle camera pastes the selected beauty materials and / or filter materials onto the faces of the passengers in the car based on the face keypoint detection and tracking visual algorithm, and displays the pasted effect on the in-vehicle camera's shooting interface.

[0162] In step S504, the user uses the photographing function of the in-vehicle camera to take a photo or video containing beauty material, sticker material, and / or filter material.

[0163] In some embodiments, the user can use the selected beauty material, sticker material, and / or filter material to perform a corresponding facial action or gesture action, and when the corresponding facial action is detected by the facial keypoint detection and tracking visual algorithm, or when the corresponding gesture action is detected by the gesture detection and tracking algorithm, the display of the corresponding beauty material, sticker material, and / or filter material can be triggered on the shooting interface of the in-car camera.

[0164] In some embodiments, since the positions of the passengers in the vehicle are distributed from close to far positions and are subjectively fixed, the on-board camera can recommend stickers such as luxury cars, airplanes, roller coasters, etc. to the user, and after the user uses the stickers such as luxury cars, airplanes, or roller coasters, the on-board camera can virtualize the cabin scene in the captured photo / video into a fun-filled scene such as the corresponding luxury car, airplane, or roller coaster.

[0165] In some embodiments, the user can view and delete the photos or videos that have been taken locally on the in-vehicle device, and at the same time, the user can upload the photos or videos that have been taken to the cloud.

[0166] In some embodiments, the user may also apply effects to the completed photo or video based on the beauty materials, sticker materials, and / or filter materials in the dashcam.

[0167] Based on the above-mentioned embodiments, an embodiment of the present application provides an image capturing device, which includes each unit included therein and each part included in each unit, and can be realized by a processor in a computer device, and of course, can also be realized by a specific logic circuit, and in implementation, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP), or a field-programmable gate array (FPGA), etc.

[0168] FIG. 5 is a structural diagram illustrating a schematic configuration of an image capturing device according to an embodiment of the present application. As shown in FIG. 5, the image capturing device 700 includes a first acquisition part 710, a first detection part 720, a first processing part 730, and a display part 740.

[0169] The first acquisition portion 710 is configured to acquire a first image captured by an on-board camera's imaging device in response to an interactive terminal located within the vehicle cabin receiving a first command, the first command being for triggering the on-board camera to capture an image.

[0170] The first detection portion 720 is configured to detect key features of predetermined objects in the first image to determine at least one predetermined object in the first image.

[0171] The first processing section 730 is configured to perform effect processing on at least one of the predetermined objects in the first image based on the set first effect display information, and obtain a second image.

[0172] A display portion 740 is configured to display the second image on a capture interface of the in-car camera.

[0173] In some embodiments, the device further includes: a second acquisition portion configured to acquire a third image collected by the imaging device when the imaging device is turned on; a first determination portion configured to determine position information of at least one predetermined object based on the third image; and an adjustment portion configured to adjust an imaging range and / or an imaging angle of the imaging device based on the position information of the at least one predetermined object.

[0174] In some embodiments, the vehicle-mounted camera is installed in front of the driver's seat or in front of the front row of seats in the vehicle interior, the position information includes riding position information, and the adjustment unit is further configured to, when it is determined based on the riding position information that each of the specified objects in the vehicle interior is riding in the front row of seats in the vehicle interior, adjust the imaging range of the image capture device to a first predetermined imaging range corresponding to the front row of seats and / or adjust the imaging angle of the image capture device to a first predetermined angle corresponding to the front row of seats, and when it is determined based on the riding position information that at least two of the specified objects in the vehicle interior are riding in at least two different rows of seats in the vehicle interior, adjust the imaging range of the image capture device to a second predetermined imaging range corresponding to the entire seating area in the vehicle interior and / or adjust the imaging angle of the image capture device to the second predetermined angle corresponding to the entire seating area in the vehicle interior.

[0175] In some embodiments, the first effect display information includes effect material and display position configuration information of the effect material, and the first processing portion is further configured to execute a display effect process corresponding to the effect material for at least one of the predetermined targets in the first image based on the set display position configuration information of the effect material, and determine the first image to which the effect material has been added as a second image.

[0176] In some embodiments, the predetermined object includes at least one of a person, a human body part, and an animal in the vehicle cabin, and the effect material includes at least one of a beauty effect material, a beauty makeup effect material, a filter effect material, and a sticker effect material.

[0177] In some embodiments, the predetermined object includes a face, and the display position configuration information includes a first mapping relationship between display position parameters of effect material and positions of facial key points, and the first processing unit is further configured to perform at least one of the following: determining a display position of the set effect material based on the position of at least one facial key point in the first image and the first mapping relationship, and superimposing the effect material on the face based on the set display position of the effect material; determining an image processing method corresponding to the set effect material, determining the display position of the set effect material based on the position of at least one facial key point in the first image and the first mapping relationship, and processing an image area corresponding to the display position of the effect material on the face in accordance with the image processing method.

[0178] In some embodiments, the predetermined object includes a person in the vehicle cabin, the effect material includes a sticker of a virtual driving tool, and the first processing part is further configured to display an effect scene in which at least one person in the vehicle cabin rides in a virtual driving tool in the first image based on the set display position configuration information of the sticker of the virtual driving tool.

[0179] In some embodiments, the display position configuration information of the virtual driving tool sticker includes a second mapping relationship between the display position of the virtual driving tool sticker in at least one virtual riding area and the position of a person in the image, and the device further includes a second detection portion configured to detect the riding position of at least one person in the vehicle cabin based on the first image, and the first processing portion is further configured to determine a first display position of a target virtual riding area corresponding to the riding position based on the riding position and the second mapping relationship, and display the virtual driving tool sticker in the first image based on the first display position to display an effect scene in which at least one of the persons is riding in the virtual riding area.

[0180] In some embodiments, the first processing portion is further configured to superimpose a sticker of the virtual riding tool onto the first image such that the target virtual riding area is displayed at the first display location.

[0181] In some embodiments, the virtual driving tool sticker includes at least one virtual element having adjustable display parameters, the display parameters including a display position and / or a display size, and the display position configuration information of the virtual driving tool sticker includes a third mapping relationship between the display position of the at least one virtual element of the virtual driving tool sticker and a position of a person in the image, and the device further includes a second determination portion configured to: detect a riding position of at least one person in the vehicle cabin based on the first image and determine a second display position of at least one of the virtual elements based on the riding position and the third mapping relationship, and / or determine a size of at least one person in the vehicle cabin based on the first image and determine a target display size of at least one of the virtual elements based on the size, and the first processing portion is further configured to display at least one of the virtual elements in the first image based on the second display position and the target display size of the at least one virtual element to display an effect scene in which the at least one person rides in the virtual driving tool.

[0182] In some embodiments, the first processing portion is further configured to perform at least one of the following: determine a virtual element drawing area in the first image based on a second display position and / or a target display size of at least one of the virtual elements and draw at least one of the virtual elements in the virtual element drawing area; render at least one of the virtual elements in the first image based on the second display position and / or the target display size of at least one of the virtual elements; stitch at least one of the virtual elements to generate the sticker based on the second display position and / or the target display size of each of the virtual elements and add the sticker to the first image.

[0183] In some embodiments, the device further includes a third determination portion configured to determine the number of virtual elements on a sticker of the virtual driving tool based on the number of people in the vehicle cabin in the first image, and the first processing portion is further configured to display each of the virtual elements in the first image based on the number of virtual elements on the sticker of the virtual driving tool and a second display position and / or a target display size of each of the virtual elements to display an effect scene in which at least one of the personnel rides in the virtual driving tool.

[0184] In some embodiments, the first processing portion is further configured to: detect, based on the first image, an effect trigger action that matches the effect material; and, in response to detecting the effect trigger action, add the effect material to at least one of the predetermined targets in the first image based on set display position configuration information of the effect material.

[0185] In some embodiments, the device further comprises a third acquisition portion configured to acquire a driving restriction status of the dashcam in response to the interactive terminal receiving a second command, the second command being for triggering activation of the dashcam; and a control portion configured to control an activation status of the dashcam based on the driving restriction status.

[0186] In some embodiments, the control unit is further configured to activate the in-vehicle camera when at least one of the following conditions is met: the driving restriction state is on and the driving speed of the vehicle in which the interactive terminal is located does not exceed a predetermined threshold; the driving restriction state is on and the parking signal of the vehicle in which the interactive terminal is located indicates that the vehicle is stopped; and the driving restriction state is off.

[0187] In some embodiments, the interactive terminal includes at least one of an in-vehicle interactive terminal and an in-vehicle user terminal.

[0188] The above description of the apparatus embodiment is similar to the description of the method embodiment above, and has the same beneficial effects as the method embodiment. Technical details not disclosed in the apparatus embodiment of the present application can be understood by referring to the description of the method embodiment of the present application.

[0189] In this and other embodiments of the present application, a "part" may be a partial circuit, a partial processor, a partial program or software, etc., and may of course be a unit, a module, or a non-modular one.

[0190] An embodiment of the present application provides a vehicle, the vehicle comprising: an in-vehicle camera configured to capture image information inside the vehicle; an in-vehicle interactive terminal connected to the in-vehicle camera and configured to receive a first instruction to trigger image capture by the in-vehicle camera, send the first instruction to a processor, and display a capture interface of the in-vehicle camera; The present invention comprises a processor configured to: acquire a first image captured by a photographing device of an on-board camera in response to an interactive terminal located within a vehicle cabin receiving a first command, the first command being for triggering image capture by the on-board camera; acquire a first image captured by a photographing device of the on-board camera in response to a photographing trigger operation performed on a photographing interface of the on-board camera, detect key features of predetermined objects in the first image, and determine at least one predetermined object in the first image; perform effect processing on the at least one predetermined object in the first image based on set first effect display information, to obtain a second image; and transmit the second image to the interactive terminal and display the second image on the photographing interface of the on-board camera.

[0191] The above description of the vehicle embodiment is similar to the description of the method embodiment above, and provides similar beneficial effects as the method embodiment. Technical details not disclosed in the vehicle embodiment of the present application can be understood by referring to the description of the method embodiment of the present application.

[0192] In addition, in the embodiments of the present application, the above-described image capturing method may be realized in the form of a software functional module and stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solutions of the embodiments of the present application, in their essential or relevant technical contributions, may be embodied in the form of a software product, and the software product stored in a storage medium includes several instructions, enabling an electronic device (which may be an in-vehicle device, a personal computer, a server, a network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes various media capable of storing program code, such as a U disk, a removable hard disk, a read-only memory (ROM), a magnetic disk, or an optical disk. Thus, the embodiments of the present application are not limited to any specific combination of hardware and software.

[0193] An embodiment of the present application provides a computer device including a memory and a processor, wherein the memory stores a computer program executable on the processor, and when the program is executed by the processor, it implements the steps of the above method.

[0194] An embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the above method.

[0195] An embodiment of the present application provides a computer program product including a non-transitory computer-readable storage medium storing a computer program, which, when read and executed by a computer, implements the steps of the above method.

[0196] It should be noted that the above-described embodiments of the storage medium, the device, the vehicle, and the computer program product are similar to the above-described embodiments of the method, and have the same beneficial effects as the method. Technical details not disclosed in the embodiments of the storage medium, the device, and the computer program product of the present application can be understood by referring to the description of the method of the present application.

[0197] 6 is a schematic diagram of a hardware entity of a computer device according to an embodiment of the present application. As shown in FIG. 6, the hardware entity of the computer device 800 includes a processor 801, a communication interface 802, and a memory 803. The processor 801 generally controls the overall operation of the computing device 800 .

[0198] The communication interface 802 may enable the computing device to communicate with other terminals or servers over a network.

[0199] The memory 803 is configured to store instructions and applications executable by the processor 801, and can also cache data (e.g., image data, audio data, audio communication data, and video communication data) that the processor 801 and each module in the computer equipment 800 processes or has processed, and can be realized by flash memory (FLASH (registered trademark)) or random access memory (RAM).

[0200] References throughout the specification to "one embodiment" or "an embodiment" should be understood to mean that a particular feature, structure, or characteristic associated with an embodiment is included in at least one embodiment of the present application. Therefore, the appearances of "in one embodiment" or "in one embodiment" in various places throughout the specification do not necessarily refer to the same embodiment. Furthermore, these particular features, structures, or characteristics may be incorporated in any suitable manner into one or more embodiments. In each embodiment of the present application, the magnitude of the sequence numbers of the above processes does not imply a priori or inferior execution order. The execution order of each process should be determined by its function and inherent logic, and is not limited in any way to the configuration of the implementation process of the embodiment of the present application. The sequence numbers of the above embodiments of the present application are for illustrative purposes only and do not indicate the superiority or inferiority of the embodiments.

[0201] It should be noted that, as used herein, the terms "comprises," "comprises," or any other variations thereof, are intended to include a non-exclusive inclusion, such that a process, method, article, or apparatus comprising a set of elements may include not only those elements, but also other elements explicitly listed, or elements inherent in such process, method, article, or apparatus. Unless further limited, the elements qualified by the statement "comprises" do not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the elements.

[0202] It should be understood that the disclosed devices and methods in some embodiments provided in this application may be realized in other ways. The device embodiments described above are merely exemplary. For example, the division of the units is merely a logical division of functions. In actual implementation, other division methods may be used, for example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not implemented. Furthermore, the coupling, direct coupling, or communication connection between the displayed or discussed components may be an indirect coupling or communication connection via some interfaces, devices, or units, and may be electrical, mechanical, or other forms.

[0203] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, may be located in one place, or may be distributed across multiple network units. Depending on actual needs, some or all of the units therein can be selected to achieve the purpose of the technical solution of this embodiment.

[0204] Furthermore, the functional units in each embodiment of the present application may all be integrated into a single processing unit, or each unit may be a single unit on its own, or two or more units may be integrated into a single unit, and the above-mentioned integrated units may be realized in the form of hardware, or may be realized in the form of hardware plus a software functional unit.

[0205] Those skilled in the art will understand that all or part of the steps for realizing the above method embodiments can be completed by hardware associated with program instructions, and the above program is stored in a computer-readable storage medium, which, when executed, performs the steps comprising the above method embodiments, and the above storage medium includes various media capable of storing program code, such as a removable storage device, a read-only memory (ROM), a magnetic disk, or an optical disk.

[0206] Alternatively, the above-mentioned integrated units of the present application may be realized in the form of software functional modules and stored in a single computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solutions of the present application, in their essential or relevant technical contributions, may be embodied in the form of a software product, and the computer software product is stored in a single storage medium, and some instructions cause an electronic device (such as a personal computer, a server, or a network device) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes various media for storing various program codes, such as removable storage devices, ROMs, magnetic disks, and optical disks.

[0207] As described above, these are merely embodiments of the present application, and the scope of protection of the present application is not limited thereto. Those skilled in the art can easily think of modifications or substitutions within the technical scope disclosed in the present application, and all of these are intended to be included in the scope of protection of the present application. [Industrial Applicability]

[0208]

[0009] An embodiment of the present application provides a vehicle and an image capturing method, a device, an apparatus, a storage medium, and a computer program product, the method including: acquiring a first image captured by a camera of an on-board camera in response to an interactive terminal located in a vehicle cabin receiving a first command, the first command being for triggering image capture by the on-board camera; detecting key features of predetermined objects in the first image to determine at least one predetermined object in the first image; applying effect processing to the at least one predetermined object in the first image based on set first effect display information to obtain a second image; and displaying the second image on the camera interface of the on-board camera.

[0010] According to the embodiment of the present application, a user can use the set first effect display information to apply effect processing to the at least one predetermined object in the first image captured by the camera of the on-board camera to obtain a second image, thereby improving the imaging quality and enjoyment of the image captured by the on-board camera, improving the entertainment value between the vehicle and the person, and better meeting the user's experience needs.

Claims

1. An image capturing method, the image capturing method comprising: acquiring a first image captured by a photographing device of an on-board camera in response to an interactive terminal located within a vehicle cabin receiving a first command, the first command being for triggering image capture by the on-board camera; Detecting key features of predetermined objects in the first image to determine at least one predetermined object in the first image; performing effect processing on at least one of the predetermined objects in the first image based on the set first effect display information, thereby obtaining a second image; displaying the second image on the imaging interface of the vehicle-mounted camera; Including, the first effect display information includes effect materials and display position configuration information of the effect materials, the predetermined target includes people in the vehicle cabin, and the effect materials include stickers of virtual driving tools; performing effect processing on at least one predetermined target in the first image based on the set first effect display information to obtain a second image, Executing a display effect process corresponding to the effect material on at least one of the predetermined targets in the first image based on the display position configuration information of the effect material that has been set; determining the first image after display effect processing as a second image; Including, Executing a display effect process corresponding to the effect material on at least one of the predetermined targets in the first image based on the display position configuration information of the set effect material, An image capturing method including displaying an effect scene in which at least one person in the vehicle cabin rides in the virtual traveling tool in the first image based on the display position configuration information of the sticker of the virtual traveling tool that has been set.

2. The image capturing method includes: If the imager is on, acquiring a third image collected by the imager; determining position information of at least one predetermined object based on the third image; adjusting an imaging range and / or an imaging angle of the imaging device based on position information of at least one of the predetermined objects; The image capturing method of claim 1 , further comprising:

3. the vehicle-mounted camera is installed in front of a driver's seat or in front of a front row seat in the vehicle interior, and the position information includes riding position information; adjusting the imaging range and / or the imaging angle of the imaging device based on the position information of the at least one predetermined target, When it is determined based on the riding position information that each of the predetermined objects in the vehicle interior is riding in a front row seat in the vehicle interior, adjusting the imaging range of the imaging device to a first predetermined imaging range corresponding to the front row seat and / or adjusting the imaging angle of the imaging device to a first predetermined angle corresponding to the front row seat; When it is determined based on the riding position information that at least two of the predetermined objects in the vehicle interior are riding in at least two different rows of seats in the vehicle interior, adjusting the imaging range of the imaging device to a second predetermined imaging range corresponding to the entire seating area in the vehicle interior, and / or adjusting the imaging angle of the imaging device to a second predetermined angle corresponding to the entire seating area in the vehicle interior. The image capturing method of claim 2 , comprising:

4. The image capturing method according to claim 1 , wherein the predetermined object further includes at least one of a human body part and an animal, and the effect material further includes at least one of a beauty face material, a beauty makeup material, and a filter material.

5. the predetermined object includes a face, and the display position configuration information includes a first mapping relationship between a display position parameter of an effect material and a position of a face key point; Executing a display effect process corresponding to the effect material on at least one of the predetermined targets in the first image based on the display position configuration information of the set effect material, determining a display position of the set effect material based on a position of at least one face key point in the first image and the first mapping relationship, and superimposing the effect material on the face based on the display position of the effect material; determining an image processing method corresponding to the set effect material, determining a display position of the set effect material based on a position of at least one face key point in the first image and the first mapping relationship, and processing an image area corresponding to the display position of the effect material on the face according to the image processing method; The image capturing method according to claim 1 or claim 4, further comprising at least one of the following:

6. The display position configuration information of the sticker of the virtual traveling tool includes a second mapping relationship between the display position of at least one virtual riding area of ​​the sticker of the virtual traveling tool and the position of a person in the image; The image capturing method further includes detecting a riding position of at least one person in the vehicle cabin based on the first image; Displaying an effect scene in which at least one person in the vehicle cabin rides on the virtual traveling tool on the first image based on the display position configuration information of the sticker of the virtual traveling tool set is determining a first display position of a target virtual riding area corresponding to the riding position based on the riding position and the second mapping relationship; displaying a sticker of the virtual riding tool on the first image based on the first display position to display an effect scene in which at least one of the personnel is riding in the virtual riding area; and The image capturing method of claim 1 , further comprising:

7. Displaying a sticker of the virtual traveling tool on the first image based on the first display position includes:

7. The image capturing method according to claim 6, further comprising superimposing a sticker of the virtual driving tool on the first image so that the target virtual riding area is displayed at the first display position.

8. The sticker of the virtual traveling tool includes at least one virtual element whose display parameters are adjustable, and the display parameters include a display position and / or a display size; The display position configuration information of the sticker of the virtual traveling tool includes a third mapping relationship between the display position of at least one of the virtual elements of the sticker of the virtual traveling tool and the position of a person in the image; The image capturing method includes: Detecting a riding position of at least one person in the vehicle cabin based on the first image, and determining a second display position of at least one of the virtual elements based on the riding position and the third mapping relationship; and / or determining a size of at least one person in the vehicle cabin based on the first image, and determining a target display size of the at least one of the virtual elements based on the size. further comprising Displaying an effect scene in which at least one person in the vehicle cabin rides on the virtual traveling tool on the first image based on the display position configuration information of the sticker of the virtual traveling tool set is 8. The image capturing method according to claim 1, further comprising: displaying at least one virtual element in the first image based on a second display position and / or a target display size of the at least one virtual element to display an effect scene in which the at least one person rides a virtual traveling tool.

9. Displaying the at least one virtual element in the first image based on a second display position and / or a target display size of the at least one virtual element includes: determining a virtual element drawing area in the first image based on a second display position and / or a target display size of at least one of the virtual elements, and drawing the at least one virtual element in the virtual element drawing area; rendering at least one of the virtual elements in the first image based on a second display position and / or a target display size of the at least one virtual element; stitching at least one of the virtual elements to generate the sticker based on the second display position and / or the target display size of each of the virtual elements, and adding the sticker to the first image.

9. The image capturing method of claim 8, comprising one of:

10. The image capturing method includes: determining the number of virtual elements in the sticker of the virtual driving tool based on the number of people in the vehicle interior in the first image; further comprising Displaying the at least one virtual element in the first image based on a second display position and / or a target display size of the at least one virtual element includes:

10. The image capturing method according to claim 8 or claim 9, further comprising displaying each of the virtual elements in the first image based on the number of virtual elements in a sticker of the virtual traveling tool and a second display position and / or a target display size of each of the virtual elements, to display an effect scene in which at least one of the personnel rides on the virtual traveling tool.

11. Executing a display effect process corresponding to the effect material on at least one of the predetermined targets in the first image based on the display position configuration information of the set effect material, detecting an effect triggering action matching the effect material based on the first image; adding the effect material to at least one of the predetermined targets in the first image based on the set display position configuration information of the effect material in response to detecting the effect trigger action; The image capturing method according to any one of claims 1 to 10, further comprising:

12. The image capturing method includes: acquiring a driving restriction status of the dashcam in response to the interactive terminal receiving a second command, the second command being for triggering activation of the dashcam; and Controlling the activation state of the vehicle-mounted camera based on the travel restriction state. further comprising Controlling the activation state of the in-vehicle camera based on the travel restriction state The driving restriction state is on, and the driving speed of the vehicle where the interactive terminal is located does not exceed a predetermined threshold; The driving restriction state is on, and the parking signal of the vehicle where the interactive terminal is located indicates that the vehicle is stopped; The driving restriction state is off.

12. The image capturing method according to claim 1, further comprising activating the vehicle-mounted camera when at least one of the following conditions is satisfied:

13. An image capturing device, the image capturing device comprising: a first acquisition unit configured to acquire a first image captured by a capture device of an on-board camera in response to an interactive terminal located within the vehicle cabin receiving a first command, the first command being for triggering image capture by the on-board camera; and a first detection portion configured to detect key features of a predetermined object in the first image to determine at least one predetermined object in the first image; a first processing unit configured to perform effect processing on at least one predetermined target in the first image based on set first effect display information, and obtain a second image; a display portion configured to display the second image on a photography interface of the in-vehicle camera; Equipped with the first effect display information includes effect materials and display position configuration information of the effect materials, the predetermined target includes people in the vehicle cabin, and the effect materials include stickers of virtual driving tools; The first processing portion comprises: displaying an effect scene in which at least one person in the vehicle cabin rides on the virtual traveling tool on the first image based on the display position configuration information of the sticker of the virtual traveling tool that has been set; determining the first image after display effect processing as a second image; The image capture device is further configured to:

14. A computer device comprising a memory and a processor, wherein the memory stores a computer program executable on the processor, and the computer program, when executed by the processor, causes the processor to perform the image capturing method according to any one of claims 1 to 12.

15. A vehicle, the vehicle comprising: an in-vehicle camera configured to capture image information inside the vehicle; an in-vehicle interactive terminal connected to the in-vehicle camera, the in-vehicle interactive terminal configured to receive a first instruction to trigger image capture by the in-vehicle camera, send the first instruction to a processor, and display a capture interface of the in-vehicle camera; a processor configured to: acquire a first image captured by a capture device of an in-vehicle camera in response to an interactive terminal located within a vehicle cabin receiving a first command, the first command being for triggering image capture by the in-vehicle camera; detect key features of predetermined objects in the first image to determine at least one predetermined object in the first image; perform effect processing on the at least one predetermined object in the first image based on set first effect display information to obtain a second image; and transmit the second image to the interactive terminal and display the second image on a capture interface of the in-vehicle camera; Equipped with the first effect display information includes effect materials and display position configuration information of the effect materials, the predetermined target includes people in the vehicle cabin, and the effect materials include stickers of virtual driving tools; The processor: displaying an effect scene in which at least one person in the vehicle cabin rides on the virtual traveling tool on the first image based on the display position configuration information of the sticker of the virtual traveling tool that has been set; determining the first image after display effect processing as a second image; The vehicle is further configured to:

16. 13. A computer storage medium storing a computer program, the computer program causing the processor to perform the image capturing method according to any one of claims 1 to 12 when executed by a processor.

17. A computer program product including a non-transitory computer-readable storage medium having stored thereon a computer program, the computer program causing a computer to perform the image capturing method according to any one of claims 1 to 12.

Images