Service methods and devices

Abstract

This application provides a service method and apparatus, relating to the field of terminal technology. In this method, during the process of a first device capturing an image for a user, the first device determines a first area where the user should be located and instructs the user to move to that first area; after the user moves to the first area, the first device captures an image for the user. This eliminates the need for the user to determine their location themselves, lowers the requirements on the user, and helps the user capture images that meet their needs, thus improving the user experience.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a service method and apparatus. Background Technology

[0002] Currently, the camera function of terminal devices is widely used. For example, whether a user is taking a selfie or taking pictures of others, an aesthetically pleasing or distinctive background can be determined, and the position of oneself or others can be identified; and the position of the terminal device (or camera) can be adjusted so that the camera's field of view is aligned with the subject and the composition is aesthetically pleasing, so as to capture pictures or videos that meet the requirements.

[0003] However, this approach places high demands on users, resulting in a poor user shooting experience. Summary of the Invention

[0004] This application provides a service method and apparatus, wherein the first device can capture images for a user, providing the user with intelligent shooting services, which can reduce the requirements for the user and improve the user experience.

[0005] In a first aspect, this application provides a service method that can be applied to a first device or components within the first device (e.g., a controller, chip, chip system, circuit, software, and / or hardware module, etc.). The first device can be, for example, a robot, a drone, or other intelligent terminal. The following description uses a first device as an example.

[0006] The method includes: acquiring a first instruction, the first instruction being used to instruct the user to take an image; and outputting a first prompt message, the first prompt message being used to prompt the user to take an image in a first area.

[0007] The first area is the region or location where the user is when taking an image.

[0008] Optionally, outputting the first prompt information includes: the first device outputting the first prompt information through an output device in the device; and / or sending the first prompt information to the second device.

[0009] When the first device outputs the first prompt information through the output device in the device, the first prompt information may include, but is not limited to, one or more of the following: voice prompt, prompt content displayed on the interface, a beam of light pointing to the first area, a projected image in the first area, etc.

[0010] Sending the first prompt message to the second device can be understood as prompting the user to take an image in the first area through the second device.

[0011] Alternatively, the first device may not only output the first prompt information through its own output device, but also send the first prompt information to the second device, enabling the second device to also prompt the user to take an image in the first area. The methods by which the first and second devices prompt the user to take an image in the first area can differ. For example, the first device may prompt the user via voice, while the second device may prompt the user via a prompt displayed on its interface.

[0012] In this way, users do not need to determine the shooting location; the primary device can prompt the user for the shooting location. This approach requires less from the user and provides a more intelligent shooting service, thus improving the user experience.

[0013] In conjunction with the first aspect, in some possible implementations, the method further includes: the first device moving to the user's location and leading the user from the user's location to the first area.

[0014] In other words, the first device moves to the user's location and guides the user to the first area. This allows the user to reach the first area more accurately, thus improving the user experience.

[0015] In conjunction with the first aspect, in some possible implementations, the method further includes: the first device moving to the first area.

[0016] In other words, the first device moves itself to the first area to indicate to the user the location or area they should be in, enabling the user to reach the first area more accurately and improving the user experience.

[0017] In conjunction with the first aspect, in some possible implementations, obtaining the first instruction includes: receiving a first instruction from a second device; or, receiving a first input from a user, wherein the first instruction is determined based on the first input; or, generating the first instruction based on satisfying a triggering condition.

[0018] The second device, such as a user terminal, can send a first instruction to the first device based on a fourth input from the user. This fourth input instructs the first device to capture an image for the user. The first input, which instructs the first device to capture an image for the user, is the user input acquired by the first device.

[0019] In other words, the first device can take an image for the user, triggered by the second device, the user, or by the first device itself. In this way, the first device can take images for the user in various situations, meeting different user needs, and can be triggered to take images in different ways.

[0020] In conjunction with the first aspect, in some possible implementations, before obtaining the first instruction, the method further includes: when located at the first location, outputting a second prompt message, the second prompt message being used to confirm with the user whether to take a picture; the first area is located at the first location.

[0021] The second prompt message is used to recommend or push shooting services to the user. The method of outputting the second prompt message is similar to the method of outputting the first prompt message.

[0022] In this way, the first device can predict user needs, proactively push shooting services to users, and provide users with more intelligent services.

[0023] In conjunction with the first aspect, in some possible implementations, the method further includes: receiving personal information from at least one user of a third device, wherein the second prompt information is determined based on the personal information of at least one user.

[0024] Personal information may include personal identifiers (IDs) and personal preference information.

[0025] By using personal IDs, the first device can identify each user and determine the service recipient; by using personal preference information, the first device can understand the services preferred by each user, and thus recommend services that better meet the user's needs.

[0026] In conjunction with the first aspect, in some possible implementations, before obtaining the first instruction, the method further includes: receiving a second input from a user, the second input being used to instruct following the first user; following the first user to move to a first location; and the first area being located at the first location.

[0027] In other words, the event of taking images of a user can occur while following or accompanying the user on a trip.

[0028] In this way, the first device can provide users with intelligent companionship services, enhance the fun and convenience of users' travel, and help improve the user experience.

[0029] In conjunction with the first aspect, in some possible implementations, the first instruction is also used to indicate a first location, where the first area is located.

[0030] The first location is where the image was taken, which can be understood as a "check-in" spot. The first location can be understood as a large area, while the first area is the specific location or a smaller area of ​​the first location.

[0031] In this way, the first device can determine the user's preferred check-in locations, which helps to capture images or videos that meet the user's requirements.

[0032] In conjunction with the first aspect, among some possible implementations, the method also includes: guiding the user to move to the first location.

[0033] If the location of the first device and the user is not the first location, the first device can guide the user to the first location. The user does not need to navigate through cumbersome input operations, which can provide the user with more intelligent services and improve the user experience.

[0034] In conjunction with the first aspect, among some possible implementations, moving to the first location includes:

[0035] The first forward travel mode is adopted to pass through the first road segment. The first forward travel mode is determined based on the road attributes of the first road segment. The first forward travel mode is switched to the second forward travel mode and the second forward travel mode is adopted to pass through the second road segment. The second forward travel mode is determined based on the road attributes of the second road segment.

[0036] The first and second road segments are the sections of road traversed to reach the first location.

[0037] The first forward movement mode and the second forward movement mode are different movement modes, such as gait mode and wheel rolling mode.

[0038] In this way, the first device can automatically switch its movement mode based on the scenario, enabling it to move smoothly in various scenarios or environments. It has a high degree of intelligence and a wide range of applications.

[0039] In conjunction with the first aspect, in some possible implementations, the method further includes: the first device moving to a first position; the first position being determined based on a region of interest, which is a background area captured by the user, and the first position being related to the region of interest; the region of interest being determined based on a third input from the user; and the region of interest being determined based on a first location captured by the user, and the region of interest being located at the first location.

[0040] The region of interest (ROI) can be understood as the background area of ​​an image taken by the user. The ROI is the area selected at the first location that can serve as the background for the image. The first region can be understood as the location or area where the subject is located, and the ROI as the area where the background is located. Typically, the first region lies between the ROI and the first location.

[0041] In other words, when the user is in the first area and the camera of the first device is pointed at the area of ​​interest, the camera can also capture the user.

[0042] The first device can move to the first position before the user arrives at the first area; or it can move to the first position after the user arrives at the first area. Alternatively, the first device can move to the first position before outputting the first prompt message; or it can move to the first position after outputting the first prompt message.

[0043] In this way, the first device can determine its position when taking images for the user, without requiring the user to adjust the position of the first device. This reduces the requirements for the user and provides a more intelligent shooting service.

[0044] In conjunction with the first aspect, in some possible implementations, the method further includes: controlling the camera's field of view to align with the region of interest; and / or controlling the gimbal in the first device to follow the region of interest. The camera is mounted on the gimbal.

[0045] The region of interest (ROI) is the background being captured. ROI may be mobile, or the initial device may need to adjust its composition, thus the gimbal can be controlled to follow the ROI. Furthermore, controlling the camera's field of view to align with the ROI facilitates subsequent composition adjustments.

[0046] In conjunction with the first aspect, among some possible implementations, the method also includes at least one of the following:

[0047] Adjust the position of the first device; or,

[0048] Adjust the angle of the gimbal; or,

[0049] Adjust the camera's shooting parameters;

[0050] The first area is located within the camera's field of view.

[0051] In this way, the first device can continuously adjust the composition until it meets the shooting standards, enabling it to capture images or videos that meet the user's needs and providing the user with more intelligent and professional shooting services.

[0052] In other words, the first device acts as a photographer, providing users with professional and intelligent shooting services.

[0053] In conjunction with the first aspect, in some possible implementations, after the user is in the first region, the method further includes at least one of the following:

[0054] Output a third prompt message, which prompts the user to move in the first direction; or,

[0055] Adjust the position of the first device; or,

[0056] Adjust the angle of the gimbal in the first device; or,

[0057] Adjust the camera's shooting parameters and set the camera on the gimbal.

[0058] The method of outputting the third prompt message is similar to the method of outputting the first prompt message.

[0059] In other words, after the user is in the first area, the composition can be further adjusted based on the user's position in the shooting frame, which can help capture better quality images or videos for the user.

[0060] Alternatively, in some scenarios, the user input that triggers the adjustment of the composition can be used to execute one or more of the above actions (i.e., outputting a third prompt message, adjusting the position of the first device, adjusting the angle of the gimbal, and adjusting the shooting parameters) to meet different user needs.

[0061] In conjunction with the first aspect, in some possible implementations, the first prompt information is also used to instruct the user's shooting posture; or, the method further includes: outputting a fourth prompt information, the fourth prompt information being used to instruct the user's shooting posture.

[0062] The way the fourth prompt message is output is similar to the way the first prompt message is output.

[0063] In other words, the first device can simultaneously prompt the first area and the shooting posture with a single output message, such as a voice prompt: "Please sit in the middle of the bench at the entrance of the coffee shop, facing me, and I will take a picture for you." The first device can also prompt the first area and the shooting posture separately with different messages. For example, after the user arrives at the first area, a fourth message can be used to prompt the shooting posture.

[0064] In this way, users do not need to determine the shooting posture themselves, which further reduces the requirements for users and provides them with a more intelligent service.

[0065] In conjunction with the first aspect, in some possible implementations, after outputting the first prompt message, the method further includes:

[0066] The first image data is captured after the user is in the first area.

[0067] In this way, the primary device can capture high-quality images or videos for the user. Compared to selfies, it can capture images or videos from more angles, thus improving the user's shooting experience.

[0068] In conjunction with the first aspect, among some possible implementations, the method also includes:

[0069] The second image data is captured after the user switches from the first area to another area, and / or after the user changes the shooting posture.

[0070] In this way, more images or videos can be captured for the user as they move and / or change their shooting posture.

[0071] In conjunction with the first aspect, in some possible implementations, the method further includes: sending part or all of the image data from the first image data to a third device.

[0072] The third device is, for example, a vehicle or vehicle-mounted equipment.

[0073] This allows the user to share the image data captured during the outing with a third device, enabling subsequent interaction with the third device, such as viewing the captured images and / or videos on the third device's display.

[0074] In conjunction with the first aspect, in some possible implementations, the first instruction is also used to indicate the number of users to be photographed.

[0075] It is understandable that the number of users affects the composition; therefore, the first device can also determine the number of users. One or more of the following can be done based on the number of users: determining the region of interest, adjusting the composition, determining the first region, and determining the first position.

[0076] This allows for more reasonable adjustments to the composition, enabling users to capture higher-quality images.

[0077] In conjunction with the first aspect, among some possible implementations, the method also includes:

[0078] Receive personal information from at least one user from a third device;

[0079] Obtain the behavioral posture data of the second user, who belongs to at least one user;

[0080] The fifth prompt message is output to confirm with the second user whether to execute the first service. The first service is determined based on the second user's personal information and behavioral data.

[0081] The method of outputting the fifth prompt message is similar to the method of outputting the first prompt message.

[0082] Among these, the number of behavioral gestures can reflect a user's behavioral intentions, user state, or emotional needs. Combining personal information and behavioral gesture data can provide users with services that better meet their needs.

[0083] In conjunction with the first aspect, among some possible implementations, the method also includes:

[0084] During the journey to the location of the third device, or after returning to the third device, a sixth prompt message is output. The sixth prompt message is used to confirm with the user whether to execute the second service, which is a service provided by the third device.

[0085] For example, the third device could be a vehicle, and the second service could be cabin service. During or after returning to the cabin, cabin services could be recommended to the user, enhancing the travel experience and providing more intelligent services.

[0086] In a second aspect, this application provides an electronic device including a processor and a memory, the memory for storing code instructions and the processor for executing the code instructions to perform the methods described in the first aspect or any possible implementation thereof.

[0087] Thirdly, this application provides an electronic device for performing the methods described in the first aspect or any possible implementation thereof. The electronic device may be the first device described in the first aspect, such as a robot, a drone, or other intelligent terminal.

[0088] Fourthly, this application provides a vehicle that can be releasably connected to a first device, the first device being used to perform the methods described in the first aspect or any possible implementation thereof.

[0089] Fifthly, this application provides a computer-readable storage medium storing a computer program or instructions that, when executed on a computer, cause the computer to perform the methods described in the first aspect or any possible implementation thereof.

[0090] Sixthly, this application provides a computer program product including a computer program, which, when run on a computer, causes the computer to perform the methods described in the first aspect or any possible implementation of the first aspect.

[0091] In a seventh aspect, this application provides a chip or chip system including at least one processor and a communication interface, the communication interface and at least one processor being interconnected via a line, the at least one processor being used to run a computer program or instructions to perform the methods described in the first aspect or any possible implementation of the first aspect.

[0092] The communication interface in the chip can be an input / output interface, pins, or circuits.

[0093] In one possible implementation, the chip or chip system described above in this application further includes at least one memory storing instructions. The memory can be an internal storage unit of the chip, such as a register or cache, or it can be a storage unit of the chip itself (e.g., read-only memory, random access memory, etc.).

[0094] It should be understood that the second to seventh aspects of this application correspond to the technical solutions of the first aspect of this application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation are similar, and will not be repeated here. Attached Figure Description

[0095] Figure 1 A schematic block diagram of an intelligent driving device provided in an embodiment of this application;

[0096] Figure 2 A schematic block diagram of an intelligent driving system provided in an embodiment of this application;

[0097] Figure 3 A schematic block diagram of the imaging device provided in the embodiments of this application;

[0098] Figure 4 This is a schematic diagram illustrating the first application scenario to which the embodiments of this application apply;

[0099] Figure 5 This is a schematic diagram illustrating a second application scenario to which the embodiments of this application are applicable;

[0100] Figure 6 This is a schematic diagram illustrating a third application scenario to which the embodiments of this application apply;

[0101] Figure 7 This is a schematic diagram illustrating the fourth application scenario to which the embodiments of this application apply;

[0102] Figure 8 A flowchart illustrating a service method provided in an embodiment of this application;

[0103] Figure 9 A schematic diagram illustrating the sensing data transmission process provided in an embodiment of this application;

[0104] Figure 10 A schematic diagram illustrating the interaction process between the vision processing system, the gimbal system, and the control system provided in the embodiments of this application;

[0105] Figure 11 A flowchart illustrating another service method provided in an embodiment of this application;

[0106] Figure 12 A flowchart illustrating yet another service method provided in an embodiment of this application;

[0107] Figure 13 A schematic block diagram of a service device provided in an embodiment of this application;

[0108] Figure 14 A schematic block diagram of another service device provided in an embodiment of this application. Detailed Implementation

[0109] To facilitate understanding, the relevant terms and concepts involved in the embodiments of this application will be introduced below:

[0110] 1. Terminal equipment

[0111] The terminal device in this application embodiment can be referred to as an electronic device, user equipment (UE), terminal, etc. For example, the electronic device can be a mobile phone, tablet, personal digital assistant (PDA), handheld device with wireless communication function, computing device, in-vehicle device or wearable device, virtual reality (VR) terminal device, augmented reality (AR) terminal device, wireless terminal in industrial control, wireless terminal in smart home, etc. The form of the electronic device is not specifically limited in this application embodiment.

[0112] 2. Intelligent driving equipment and intelligent driving systems

[0113] Figure 1 This is a schematic block diagram of the intelligent driving device 100 to which this application embodiment applies. Figure 1 As shown, the intelligent driving device 100 may include a perception system 120, a computing platform 130, a display device 140, and a communication device 150.

[0114] The perception system 120 may include several types of sensors for sensing information about the environment surrounding the intelligent driving device 100.

[0115] For example, the sensing system 120 may include a positioning system, which may be a global navigation satellite system (GNSS), such as the Global Positioning System (GPS) or the BeiDou system. Alternatively, the sensing system 120 may also include one or more of the following sensors: an inertial measurement unit (IMU), a vibration sensor, a lidar, millimeter-wave radar, ultrasonic radar, and one or more camera devices.

[0116] Some or all of the functions of the intelligent driving device 100 can be controlled by the computing platform 130. Exemplarily, the computing platform 130 may include processors 131 to 13n.

[0117] It should be understood that, in the embodiments of this application, the processor is a circuit with signal processing capabilities.

[0118] In one implementation, the processor can be a circuit with instruction read and execute capabilities, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a type of microprocessor), or a digital signal processor (DSP).

[0119] In another implementation, the processor can implement certain functions through the logical relationship of hardware circuits, which can be fixed or reconfigurable. For example, the processor is a hardware circuit implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field-programmable gate array (FPGA).

[0120] In reconfigurable hardware circuits, the process of a processor loading a configuration document and configuring the hardware circuit can be understood as the processor loading instructions to implement the functions of some or all of the aforementioned units. Furthermore, a processor can also be a hardware circuit designed for artificial intelligence, which can be understood as a type of ASIC, such as a neural network processing unit (NPU), tensor processing unit (TPU), or deep learning processing unit (DPU).

[0121] In addition, the computing platform 130 may also include a memory for storing instructions, and some or all of the processors 131 to 13n may call the instructions in the memory to perform the corresponding functions.

[0122] The computing platform 130 can also control the operation of intelligent driving systems, which may include, for example, advanced driving assistance systems (ADAS) and autonomous driving systems (ADS). Intelligent driving systems utilize various sensors on the vehicle (including but not limited to: lidar, millimeter-wave radar, cameras, ultrasonic sensors, GPS, and inertial measurement units) to acquire information from the vehicle's surroundings, and analyze and process this information to achieve functions such as obstacle perception, target recognition, vehicle localization, path planning, and driver monitoring / alerts, thereby improving the safety, automation, and comfort of vehicle driving.

[0123] Under different levels of autonomous driving (or intelligent driving levels, a total of six levels from L0 to L5), based on artificial intelligence algorithms and information acquired by multiple sensors, intelligent driving systems can achieve different levels of autonomous driving assistance. The aforementioned autonomous driving levels are based on the classification standards of the Society of Automotive Engineers (SAE).

[0124] The display devices 140 in the cockpit of intelligent driving equipment 100 are mainly divided into two categories: the first category is the vehicle-mounted display screen; the second category is the projection display screen, such as the head-up display (HUD).

[0125] A vehicle-mounted display screen is a physical display screen and an important component of an in-vehicle infotainment system. Multiple displays can be installed in the cabin, such as digital instrument cluster displays and central control screens. In some possible implementations, one or more of these vehicle-mounted displays can be human-machine interfaces (HMIs), for example, the central control screen can be an HMI. A head-up display (HUD), also known as a head-up display system, is mainly used to display driving information such as speed and navigation on a display device in front of the driver (e.g., on the windshield). This reduces the driver's eye-shift time, avoids pupil changes caused by eye-shifting, and improves driving safety and comfort. HUDs include, for example, combiner-HUD (C-HUD) systems, windshield-HUD (W-HUD) systems, and augmented reality HUD (AR-HUD) systems.

[0126] Display device 140 can display the vehicle's infotainment interface. For example, display device 140 can display image 1 based on user input that triggers the display of image 1, such as voice commands, gesture input, or touch input.

[0127] The communication device 150 can be used to communicate with other devices, such as including but not limited to vehicle-to-vehicle, vehicle-to-user terminal, and vehicle-to-cloud communication.

[0128] For example, the communication system 150 includes an onboard telematics box. Through the T-BOX, the intelligent driving device 100 can communicate with devices such as robots and user terminals. For example, it can send the user's personal information to the robot; it can also receive image data from the robot.

[0129] Figure 2 A schematic block diagram of an intelligent driving system 200 provided in an embodiment of this application is shown. Figure 2 As shown, the system 200 includes a sensing module 210, a control module 220, a human-computer interaction module 230, a display module 240, and a communication module 250.

[0130] The sensing module 210 may include Figure 1 One or more sensors in the perception system 120 shown can be used to collect environmental information about the area where the vehicle is located, such as information about parking lines and obstacles.

[0131] Furthermore, the perception module 210 can process the collected environmental information to create a world model consisting of roads, obstacles, etc., for downstream modules (such as the human-computer interaction module 230 and the control module 220). The perception module 210 can send the information it collects and / or determines to the control module 220.

[0132] The human-computer interaction module 230 may include Figure 1 One or more of the display devices 140 shown may include, for example, an HMI; the human-computer interaction module 230 may also include a sound-emitting device (such as a speaker, audio jack, etc.), a sound-receiving device (such as a microphone), and a camera, etc. The display module 240 may include... Figure 1 One or more of the display devices 140 shown are configured to display a vehicle infotainment interface. The human-machine interface module 240 can receive user commands (including voice commands, touchscreen commands, and commands based on user gestures), and then control the display module 240 to change the display interface according to the commands.

[0133] Communication module 250 and Figure 1 The communication device 150 is similar, for example including T-BOX, which can be used to realize communication with other devices. Please refer to the description of the communication device 150 above, which will not be repeated here.

[0134] It should be understood that Figure 1 The intelligent driving device 100 shown and Figure 2 The system architecture of the intelligent driving system 200 shown is merely an example. In real-world applications, intelligent driving devices and systems may include more or fewer modules or devices, and this application does not impose specific limitations on this.

[0135] 3. Filming equipment

[0136] It should be understood that the shooting device in the embodiments of this application may be, but is not limited to, a robot or drone or other device with photo and / or video shooting capabilities. The embodiments of this application do not specifically limit the type of shooting device.

[0137] Figure 3 This is a schematic diagram of the architecture of a shooting device 300 provided in an embodiment of this application. Figure 3 As shown, the shooting device 300 includes:

[0138] The system includes a sensing system 310, a gimbal system 320, a vision processing system 330, a control system 340, a drive system 350, a mechanical system 360, and a communication system 370.

[0139] (1) Sensing system 310

[0140] The sensing system 310 may include several types of sensors for sensing environmental information around the imaging device 300.

[0141] For example, the sensing system 310 includes one or more cameras to acquire image data.

[0142] It should be understood that in the embodiments of this application, the camera may also be referred to as a camera module, camera, or camera, and the camera may be a binocular camera, a tri-lens camera, or other similar types. The embodiments of this application do not specifically limit the name or type of the camera. For ease of understanding, the following description uses a camera as an example.

[0143] The sensing system 310 may also include sensors such as a positioning system, an inertial measurement unit (IMU), and a torque sensor.

[0144] The positioning system can be a global navigation satellite system (GNSS), such as GPS, BeiDou, and other positioning systems.

[0145] Torque sensors are used to measure the magnitude of rotational force and / or torsional force.

[0146] For example, when the imaging device 300 is a robot, the torque sensor can be a foot torque sensor. For instance, if the robot includes a leg structure, the foot torque sensor can be located at the robot's leg structure (or at the joints of the leg structure) and can be used to sense the forces acting on the leg structure. By detecting the forces acting on the leg structure, the robot (such as the control system 340) can determine whether the robot is slipping or falling, so as to adjust the robot's posture in a timely manner; the forces acting on the leg structure can also determine whether the robot has encountered an obstacle, so as to adjust the direction of movement in a timely manner.

[0147] (2) PTZ system 320

[0148] The gimbal system 320 may include a gimbal, a gimbal motor drive (also referred to as an electric drive), a gimbal controller, and other devices.

[0149] The gimbal can be understood as a mechanical gimbal structure, which is a mechanical device or mechanism capable of multi-directional, controllable rotation. Some or all of the cameras in the sensing system 310 can be mounted on the gimbal. By moving and / or rotating the gimbal, the cameras mounted on the gimbal can be rotated to a specified direction, thereby enabling the camera's field of view to be aimed at the target area.

[0150] In addition, by continuously moving and / or rotating the gimbal, the camera's field of view on the gimbal can be kept pointed at the target. This function can also be understood as the function of following (tracking, tracking, or following) the target through the gimbal.

[0151] In addition to aiming and following the target, when the shooting device 300 shakes or moves, rotating the gimbal can keep the camera's field of view always pointing at the same area, maintaining stable pointing. This function can also be understood as the gimbal's image stabilization function.

[0152] It should be understood that the rotation methods of the gimbal include, but are not limited to, pitch rotation, yaw rotation, and roll rotation. The movement methods of the gimbal include, but are not limited to, raising, lowering, moving left, moving right, moving forward, or moving backward. This application does not specifically limit these movements.

[0153] The motor drive of the gimbal is used to control the movement and / or rotation of the gimbal.

[0154] The gimbal controller can send commands to the motor drive, which instruct the motor drive to control the movement and / or rotation of the gimbal.

[0155] (3) Vision processing system 330

[0156] The vision processing system 330 includes software modules and / or hardware units for processing images.

[0157] For example, the vision processing system 300 may include units such as an image signal processor (ISP) and a neural processing unit (NPU).

[0158] An ISP can be used to process raw images captured by a camera, performing noise reduction, white balance adjustments, color correction, and image fusion (such as HDR), thereby improving image quality. Typically, the images displayed by the capturing device 300 or transmitted by the capturing device 300 to other devices are images processed by the ISP.

[0159] The NPU can deploy various neural network algorithms or models, enabling efficient execution of various neural network algorithms and achieving functions such as semantic segmentation and graph analysis.

[0160] For example, an NPU can, but is not limited to, perform the following functions:

[0161] Function 1: Based on images or videos of the surrounding environment captured by the camera, it can identify regions of interest, such as flower fields, sunsets, and distinctive buildings. These regions of interest can be understood as the background areas that were identified when the user took the image.

[0162] Furthermore, based on the region of interest, the NPU can also determine the location where the device should be positioned when taking a picture of the user, such as the first location described below. The vision processing system 330 can transmit this location to the control system 340, enabling the control system 340 to control the camera 300 to move to that location.

[0163] Function 2: Determine whether the image captured by the camera meets the shooting standards.

[0164] The shooting standard can be understood as the shooting standard determined by the NPU based on the current shooting scene, or as the image aesthetic evaluation standard, including but not limited to standards for lighting, composition, etc. Before meeting the shooting standard, the shooting device 300 can continuously adjust one or more of the following: gimbal angle, device position, or shooting parameters, until the shooting standard is met.

[0165] Function 3: Determine the user's shooting position and / or shooting posture based on shooting standards or image aesthetic evaluation standards. The shooting position is the position the user should be in when taking the image, as shown in the first area below.

[0166] (4) Control system 340

[0167] The control system 340 may include one or more controllers, which have functions such as controlling the shooting device 300 to move to the target position, identifying the user, determining the user's intention, path planning, and recognizing user input commands.

[0168] (5) Drive system 350

[0169] The drive system 350 may include one or more drive motors, which may be drive motors of some or all of the components in the mechanical system 360 described below.

[0170] (6) Mechanical system 360

[0171] Taking the camera device 300 as an example of a robot, the mechanical system 360 includes, for example, joint components, wheel hubs, and leg structures.

[0172] Correspondingly, the drive system 350 may include, for example, an articulated electric drive. The articulated electric drive can drive the joint components to move, enabling the robot to move according to a gait pattern.

[0173] Gait pattern refers to the coordinated movement of a robot's legs or joints according to a certain sequence and trajectory when moving. When moving according to the gait pattern, the robot can walk, run, climb stairs, jump, and perform other movements.

[0174] The drive system 350 may also include, for example, a hub electric drive. The hub electric drive controls the rotation of the robot's hubs, enabling the robot to move in a wheel-rolling pattern. The wheel-rolling pattern refers to the robot's movement relying on the rolling motion of its hubs, similar to the way a vehicle travels.

[0175] In one possible implementation, the control system 340 may instruct the drive motor in the drive system 350 to drive the components in the mechanical system 360, enabling the imaging device 300 to move to the target position.

[0176] Furthermore, when the control system 340 determines to move in gait mode based on road conditions, it can instruct the joint electric drive to drive the joint components to move, so that the movement of the joint components drives the shooting device 300 to move in gait mode; when the control system 340 determines to move in wheel rolling mode based on road conditions, it can instruct the hub electric drive to drive the hub to rotate, so that the hub rotation drives the shooting device 300 to move in wheel rolling mode.

[0177] (7) Communication system 370

[0178] The communication system 370 can be used to enable communication between the various systems in the imaging device 300. For example, the communication system 370 includes a CAN bus, and the various systems in the imaging device 300 can communicate with each other through the controller area network (CAN) bus.

[0179] The communication system 370 can also be used to enable communication between the shooting device 300 and other devices, such as communication with vehicles, mobile phones and other devices.

[0180] It should be understood that, through the communication system 370, the imaging device 300 can communicate with other devices via wireless or wired communication. The wireless communication method can be short-range or long-range wireless communication.

[0181] Among these, short-range wireless communication methods include, but are not limited to: wireless fidelity. Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), NearLink, Intrabody Communication (IBC), etc.

[0182] Long-range wireless communication methods include, but are not limited to, 4G long-term evolution (LTE), 5G new radio (NR), or future communication methods.

[0183] Optionally, the shooting device 300 may also include an interactive system 380.

[0184] (8) Interactive System 380

[0185] The interactive system 380 is used to enable interaction between the shooting device 300 and the user. The interactive system 380 may include input devices and output devices.

[0186] Input devices are used to acquire user input, and include, but are not limited to, buttons, knobs, levers, touchscreens, microphones, cameras, and receivers. Output devices are used to output information to the user, and include, but are not limited to, sound-generating devices, displays, indicator lights, and motors.

[0187] The sound receiving device can be, but is not limited to, a microphone or other device capable of acquiring audio data, and can be used to obtain voice commands. The camera can capture images or video and can acquire gesture input. The receiver can detect various signals and can acquire user input via remote control or other methods.

[0188] The sound-generating device can be, for example, but is not limited to, a horn or loudspeaker capable of playing audio, and can output voice prompts to the user. A touchscreen can be a display device capable of receiving user touch input; a display screen is a display device with image display capabilities.

[0189] It should be understood that Figure 3 The architecture of the shooting device 300 shown is only an example. In actual application scenarios, the shooting device 300 may include more or fewer components, such as batteries. This application embodiment does not specifically limit this.

[0190] The architecture of the device involved in the embodiments of this application has been briefly described above. The embodiments of this application will be described below.

[0191] With the development of terminal technology, how to provide users with more intelligent services has received widespread attention.

[0192] Taking the shooting service as an example, currently, whether users are taking selfies or taking pictures of others, they need to determine an aesthetically pleasing or distinctive shooting background, as well as their own or others' positions within that background; they also need to adjust the position of the terminal device (or camera) so that the camera's field of view is aligned with the subject and the composition is aesthetically pleasing, in order to capture a picture that meets the requirements.

[0193] However, this shooting method requires users to determine the shooting background, their own or others' positions, and the camera's position, which places high demands on users; and if users do not have relevant camera knowledge, it may be difficult to capture images that meet the requirements, resulting in a poor shooting experience for users.

[0194] In addition, when users take selfies using mobile phones or other terminal devices, they usually need to hold the terminal device, making it difficult for users to take selfies.

[0195] In view of this, embodiments of this application provide a service method applied to a shooting device, which may be a robot, drone, or other such device, or a component within the shooting device, such as a controller, processor, chip, or chip system. For ease of understanding, the following description uses a shooting device as an example.

[0196] It should be understood that the robot in the embodiments of this application can be in human form, animal form, or other forms, and the embodiments of this application do not specifically limit it in this regard.

[0197] In this method, when the capturing device receives a first instruction to capture an image for the user, it can determine the user's shooting position and indicate that position to the user. This shooting position is the location the user needs to be in to capture the image. In this way, the user does not need to determine their shooting position, which reduces user requirements and helps to capture images that meet the user's needs, thus improving the shooting experience.

[0198] Taking robots as an example, in this service method, the shooting equipment is equivalent to the role of a professional photographer. It can not only guide users, but also autonomously complete a series of actions such as composition adjustment, which can significantly improve the user's shooting experience and enhance the level of intelligence in serving users.

[0199] To facilitate understanding of the embodiments of this application, the application scenarios (or systems) of the embodiments of this application are described below.

[0200] Figure 4 This is a schematic diagram illustrating the first application scenario of this application. For example... Figure 4 As shown, the service method provided in this application embodiment can be applied to shooting equipment.

[0201] Combination Figure 4 When the shooting device receives a first instruction from the user to shoot, it can determine the user's shooting location and prompt the user to move to that shooting location; after the user arrives at the shooting location, it can take one or more photos for the user, and / or take one or more videos for the user.

[0202] Figure 5 This is a schematic diagram illustrating a second application scenario of this application. For example... Figure 5 As shown, the service method provided in this application embodiment can be applied to a system including a shooting device and a first terminal.

[0203] The shooting device and the first terminal can communicate with each other. The communication method can be referred to in the description of the shooting device 300 above, and will not be described in detail here.

[0204] For example, the first terminal can transmit data 1 to the shooting device; correspondingly, the shooting device can receive data 1 from the first terminal.

[0205] Here, data 1 can be data sent to the shooting device based on user input from the first terminal. For example, the first terminal sends a first instruction to the shooting device based on a received first input triggering the shooting of an image for the user, instructing the shooting device to take an image for the user.

[0206] Optionally, the shooting device can also transmit data 2 to the first terminal; correspondingly, the first terminal receives data 2 from the shooting device.

[0207] Here, data 2 could be, for example, the user's shooting location determined by the shooting device, such as the first area described below. Based on this shooting location, the first terminal can output first prompt information, such as voice prompts or interface display information, to inform the user of the shooting location.

[0208] In other words, the shooting device and the first terminal can synchronize the first user interaction data, which is data generated based on user input related to the image captured by the shooting device.

[0209] Figure 6 This is a schematic diagram illustrating a third application scenario of this application. For example... Figure 6 As shown, the service method provided in this application embodiment can be applied to a system including a shooting device and a first vehicle.

[0210] It should be understood that the camera can communicate with the first vehicle. The communication method can be referred to in the description of the camera 300 above, and will not be described in detail here.

[0211] For example, the first vehicle can transmit data 3 to the camera device; correspondingly, the camera device can receive data 3 from the first vehicle.

[0212] Data 3 may include personal information of one or more users. Personal information includes, but is not limited to, personal preference information and personal ID. One or more users may be, for example, the users of the first vehicle.

[0213] It should be understood that the user in this embodiment is only illustrative. In actual application scenarios, the occupants in the first vehicle cabin may also include pets, so the user in this embodiment may also include pets. This embodiment does not specifically limit this.

[0214] Personal preference information includes, but is not limited to, user interests such as singing, dancing, photography, or listening to crosstalk; it may also include preferred beverages or foods, such as coffee or orange juice; and preferred sports such as running or playing football. Based on this personal preference information, the camera can recommend services that match the user's preferences.

[0215] Personal IDs may include, but are not limited to: user account IDs (such as vehicle system accounts, car manufacturer app accounts, vehicle owner IDs, etc.); user terminal IDs; or biometric IDs. Biometric IDs may include one or more of the following: facial recognition IDs, voiceprint IDs, or fingerprint IDs. Through personal IDs, the camera can identify each user.

[0216] Optionally, the camera can transmit data 4 to the first vehicle; correspondingly, the first vehicle receives data 4 from the camera.

[0217] Data 4 could be, for example, an image and / or video captured by a camera. The first vehicle could then display the image and / or video via one or more display devices within the cabin.

[0218] In some scenarios, the shooting equipment can be a standalone device.

[0219] In other scenarios, there is a certain relationship between the filming equipment and the first vehicle.

[0220] For example, the camera device is releasably connected to the first vehicle. Alternatively, the camera device can be understood as an in-vehicle device, or as part of the first vehicle, or as a movable device within the first vehicle.

[0221] In one example, the first vehicle can be understood as the vehicle on which the camera is traveling; and / or, the first vehicle can serve as the location where the camera is stationed.

[0222] If the first vehicle can serve as a base for the filming equipment, it can contain a robot cabin, which serves as the base for the filming equipment. The filming equipment can also reside in the robot cabin within the first vehicle, or in other words, the filming equipment can be in a state where it is not released by the first vehicle; the filming equipment can also detach from the robot cabin within the first vehicle, or in other words, the first vehicle can release the filming equipment.

[0223] Optionally, while the camera is residing in the robotic cabin of the first vehicle, the first vehicle can charge the camera and / or communicate with the camera.

[0224] Optionally, the first vehicle may release the camera device based on user input or upon fulfillment of release conditions. And / or, the camera device may detach from the first vehicle based on user input or upon fulfillment of detachment conditions.

[0225] The user input is the input that triggers the camera to detach from the first vehicle, and can be various types of input such as voice commands, touch input operations, input based on hardware devices such as buttons, or gesture input.

[0226] Release conditions are similar to departure conditions, including but not limited to: the first vehicle door being opened; and / or the destination (or parking location) of this trip being an outdoor area such as a tourist attraction.

[0227] Figure 7 This is a schematic diagram illustrating the fourth application scenario of this application. For example... Figure 7 As shown, the service method provided in this application embodiment can be applied to a system including a shooting device, a first terminal, and a first vehicle.

[0228] It should be understood that Figure 7 The application scenario shown is equivalent to Figure 5 and Figure 6 The application scenarios shown are combined, and the communication process between the devices can be referred to the description above, which will not be repeated here.

[0229] It should also be understood that Figures 4 to 7 The device configurations shown are merely illustrative. In actual applications, these devices can be replaced with other types of equipment. For example, the first terminal can be replaced with a tablet computer, a smart wearable device, etc.; the shooting device can be replaced with a drone with image capture capabilities, etc. Furthermore, Figures 4 to 7 The application scenarios shown may also include more devices. For example, more shooting devices may be included, with multiple shooting devices capturing images for the user. This application does not specifically limit this aspect.

[0230] It should also be understood that Figures 4 to 7 The number of devices shown is merely an example. In some application scenarios, the cloud may also be included, and the shooting device can communicate with the cloud. In this case, some steps performed by the shooting device can be performed by the cloud, such as the cloud determining a first area and sending the first area to the shooting device. This application does not specifically limit this aspect.

[0231] The following describes in detail the service method provided in the embodiments of this application, taking the first device as the execution subject as an example.

[0232] The first device can be understood as an electronic device, such as the shooting device mentioned above, for example, a robot, drone, or other intelligent terminal with image shooting capabilities. Alternatively, the first device can be replaced by a component in an electronic device (such as a circuit, chip, chip system, processor, or controller), or a logic module or software capable of realizing all or part of the functions of the electronic device. This application does not specifically limit this aspect.

[0233] Figure 8 This is a flowchart illustrating a service method 800 provided in an embodiment of this application. Method 800 is applicable to... Figures 4 to 7 Any of the application scenarios shown. Method 800 can be executed by a first device, which may be... Figures 4 to 7 The shooting device shown in any of the application scenarios can be replaced with a component of the shooting device.

[0234] like Figure 8 As shown, method 800 includes the following steps:

[0235] S801, The first device acquires a first instruction, which is used to instruct the user to take an image.

[0236] The captured image can be a photograph, such as taking one or more photos of the user; or it can be a video recording, such as recording one or more video clips for the user. This application does not specifically limit the type of image captured.

[0237] The user can be a person, an animal, or other movable device or object. This application does not specifically limit the user.

[0238] The number of users can be one or more. This application embodiment does not specifically limit the number of users photographed by the first device.

[0239] S802, The first device outputs a first prompt message, which is used to prompt the user to take an image in the first area.

[0240] The first area refers to the location where the user should be during the image capture process. The first area can be understood as a geographical area or a specific location.

[0241] For example, the first area includes a tree, the third step, and a bench in front of a coffee shop.

[0242] Prompting the user to take an image in the first area may include one or more of the following:

[0243] Item 1: Prompt the user to arrive at the designated location and take one or more images for the user. For example, the first prompt message could be a voice prompt: "Please sit on the far left of the bench at the entrance of the coffee shop, and I will take a picture of you."

[0244] Item 2: Prompt the user to move around in a certain area and record one or more videos for the user. For example, the first prompt message is a voice prompt: "You can move around on this beach, and I will record videos for you."

[0245] Item 3: Prompt the user to move within a certain area and capture multiple images for the user. For example, the first prompt message is a voice prompt: "You can move around in this amusement park, and I will take pictures for you."

[0246] In other words, the scenarios applicable to the embodiments of this application include, but are not limited to: taking one or more photos of a user at a designated location; recording video of a user during user activity; and capturing one or more photos of a user during user activity.

[0247] The first device may output the first prompt information in the following ways: Method 1 and / or Method 2.

[0248] In scenario 1, the first device outputs the first prompt information through its output device.

[0249] The output device may include, but is not limited to, at least one of the following: a speaker, a horn, a display device, a motor, an indicator light, or a projection device. That is, the first device may output the first prompt information in one or more of the following ways: voice prompt, interface display, vibration prompt, laser indication, or projection indication.

[0250] For example, the first prompt message may include a voice message, in which the first device emits a voice message through a speaker or loudspeaker, such as "You can go to the logo at the entrance of the coffee shop, and I will take a picture for you."

[0251] For example, the first prompt message includes a projected image, in which the first device projects the image into the first area via a projection device, allowing the user to determine that an image needs to be captured in the first area.

[0252] For example, the first prompt information includes a first screen displayed via a display device, which may include a marker 1 displayed on an image or map, the marker 1 indicating a first area.

[0253] For example, the first prompt message includes a beam of light, which the first device emits via an indicator light and can be directed to a first area, allowing the user to determine that an image needs to be taken in the first area.

[0254] In scenario 2, the first device outputs a first prompt message, including: the first device sending the first prompt message to the second device. Correspondingly, the second device receives the first prompt message from the first device.

[0255] The second device is, for example, Figure 5 or Figure 7 The first terminal shown can be understood as a user terminal, which may be, but is not limited to, wearable devices such as mobile phones, tablets, or smartwatches.

[0256] After the first device determines the first area, it can send a first prompt message to the second device. The second device can then prompt the user to take an image in the first area based on the first prompt message. The method by which the second device prompts the user to take an image in the first area based on the first prompt message is similar to the method by which the first device outputs the first prompt message in Case 1, and can be referred to the description above, which will not be elaborated here.

[0257] Based on the above embodiments, optionally, the first device may also guide the user to move to the first area in any of the following ways.

[0258] In one possible implementation, method 800 further includes: moving the first device to the user's location and leading the user from the user's location to a first area.

[0259] In other words, the first device leads or guides the user to the first area.

[0260] For example, after the first device moves to the user's location, the user is prompted to follow the first device and is led to the first area.

[0261] For example, the first device outputs a first prompt message through voice prompts or interface prompts, prompting the user to follow the first device to move to the first area to take an image; and the first device leads the user to the first area from the user's location.

[0262] In another possible implementation, method 800 further includes: moving the first device to the first area.

[0263] In other words, after the first device determines the first area, the first device moves to the first area; and can prompt the user to move to the first area to take an image through a first prompt message, such as prompting the user to take an image at the current location of the device through a voice message, such as "Please come to my current location, I will take an image for you".

[0264] By guiding users to the first area in any of the above ways, users can move to the first area more accurately.

[0265] As an optional embodiment, the first prompt information is also used to instruct the user's shooting posture; or, method 800 further includes: the first device outputting a fourth prompt information, the fourth prompt information being used to instruct the user's shooting posture.

[0266] The shooting posture can include body movements, the user's orientation and facial expressions, and items worn or held by the user.

[0267] In other words, in one scenario, the first device, through the first prompt message, not only indicates the first area to the user, but also instructs the user on the shooting posture.

[0268] In another scenario, the first device can output prompts multiple times, where the first prompt is used to indicate the first area, and the fourth prompt is used to indicate the shooting posture. For example, after the user arrives at the first area, the first device prompts the user with the shooting posture through the fourth prompt.

[0269] It should be understood that the method of outputting the fourth prompt message is similar to the method of inputting the first prompt message, as described above, and will not be repeated here. Alternatively, the fourth prompt message can also be that the first device demonstrates a shooting posture to the user. For example, the first device poses itself in the first area and prompts the user to take a picture in that posture from the device's location, so that the user can not only accurately determine the shooting position, but also determine the shooting posture.

[0270] Furthermore, when the first device is filming a user in a first area, or following the user, the filming posture can be a single action, a movement trajectory, or multiple postures. This application does not specifically limit the filming posture in its embodiments.

[0271] The following is a detailed description of several implementation methods of S801.

[0272] In possible implementation 1, obtaining the first instruction includes: the first device receiving the first instruction from the second device.

[0273] That is, the first instruction is a message sent from the second device to the first device. The second device is, for example, a... Figure 5 or Figure 7 The first terminal shown can be understood as a user terminal.

[0274] In one example, in response to a fourth input from the user, the second device sends a first instruction to the first device; correspondingly, the first device receives the first instruction from the second device.

[0275] The fourth input is used to instruct the first device to take an image for the user. The fourth input can be a touch input operation, such as inputting an action on a specific app installed on the second device, which can be used to control the first device. The fourth input can also be a voice command.

[0276] In other words, the user triggers the first device to take an image for the user from the second device.

[0277] In a possible implementation 2, obtaining the first instruction includes: the first device receiving a first input from the user, wherein the first instruction is determined based on the first input.

[0278] The first input may be, but is not limited to, touch input, voice commands, gesture input, or input based on hardware devices such as buttons. This application does not specifically limit the user's input method on the first device side.

[0279] In other words, the first device receiving the first instruction is equivalent to the first device receiving user input that triggers the taking of an image for the user. Or, the first instruction is information determined based on the user's initial input. That is, the user directly triggers the first device to take an image for them. For example, the user issues a voice command to the first device, "Take a picture of me on this lawn."

[0280] In a possible implementation 3, obtaining the first instruction includes: generating the first instruction based on the fulfillment of the triggering condition.

[0281] In other words, the first instruction is an instruction generated internally by the first device. It can also be understood as the first device generating a shooting event when the triggering conditions are met.

[0282] The triggering condition is the condition that prompts the first device to capture an image for the user. The triggering condition may be, for example, a condition related to the surrounding environment and / or the user's state.

[0283] For example, the triggering conditions may include, but are not limited to, one or more of the following:

[0284] The current location is a type 1 location; the surrounding environment matches the characteristics of the shooting scene; or, the user's status matches the user's shooting characteristics.

[0285] The first type of location can be a popular spot for taking photos. This first type of location can be preset, obtained from cloud devices, or determined in real time.

[0286] For example, the first device identifies that the number of people taking photos and checking in at the current location exceeds a certain threshold; the first device determines from various apps such as map apps, travel apps, or social apps that the current location is a popular check-in location; the first device sends information to the cloud to indicate the current location, and the first device receives information 1 from the cloud, which indicates that the current location is a popular check-in location; or, the first device stores multiple locations, which are popular check-in locations, and the current location belongs to one of these multiple locations.

[0287] These multiple locations can be stored in a dynamic database, meaning that the locations included can be updated; or they can be stored in a static database, meaning that the locations included are fixed.

[0288] The surrounding environment matching the characteristics of the shooting scene can also be understood as the first device recognizing the surrounding environment and determining that the surrounding environment is suitable for taking pictures.

[0289] The characteristics of the shooting scene may include, but are not limited to, one or more of the following: scenery with significant visual features (such as distinctive buildings, sculptures, flower fields, viewing platforms, etc.); ambient lighting that conforms to aesthetic principles; or, the presence of special environments or scenery (such as the appearance of rainbows, the approach of animals, etc.).

[0290] The aesthetic principles involved can be algorithms, models, or databases determined based on relevant knowledge in fields such as visual arts or photography. Ambient lighting conforming to aesthetic principles means that the ambient lighting meets the requirements for ambient lighting in the field of photography.

[0291] User status matching user shooting characteristics can also be understood as a user status that is suitable for taking photos, or in other words, user status indicates the user's current emotional need or behavioral intention to capture an image. User status can include various aspects such as posture, emotion, expression, and behavior. Among these, user shooting characteristics may include, but are not limited to: the state of completing a task (such as climbing to the top of a rock or crossing the finish line); the state of interaction climax (such as multiple users laughing or hugging).

[0292] As an example and not a limitation, when the first device outputs a first prompt message based on the fulfillment of a trigger condition to prompt the user to take an image in a first area, the first area can be the user's current location. For example, the first prompt message could be "Please remain in your current state, I will take a picture for you." Alternatively, the first area can be other locations, such as "Please move one step to the left, I will take a picture for you." This application embodiment does not specifically limit this.

[0293] It should be understood that the possible implementation methods 1 to 3 shown above can be implemented independently or in combination. For example, during an outdoor activity, the first device may take images of the user at one time according to possible implementation method 1; at another time according to possible implementation method 2; and at yet another time according to possible implementation method 3. This application does not specifically limit the scope of the embodiments in this regard.

[0294] It can be understood that the first area is the location or area where the user is when the image is taken. The first area is a specific location or area within a place (such as a check-in point), which can be determined in the following ways.

[0295] In possible implementation a, the first instruction is also used to indicate a first location, and the first area is located at the first location.

[0296] In other words, the first instruction obtained by the first device is also used to indicate the first location.

[0297] For example, in conjunction with the possible implementation method 1 above, it is equivalent to the user selecting or inputting the first location on the second device side, that is, the fourth input is also used to select or input the first location.

[0298] Combining with the possible implementation 2 above, it is equivalent to the user selecting or inputting the first location on the first device side, that is, the first input is also used to select or input the first location.

[0299] In conjunction with the possible implementation method 3 above, it is equivalent to the first device determining the first location when it generates the first instruction, such as the current location or the location it is about to arrive at.

[0300] The first location can be understood as a "check-in spot," a suitable location for taking pictures, or a location where the user wants to take pictures. The first location can be a static (or fixed) location, such as a coffee shop, park, building, bookstore, beach, etc.; the first location can also be a temporary location, such as the location where a rainbow appears, a performance venue, etc.

[0301] The relationship between the first location and the first area is that the first area is the region or location at the first location. That is, when the first device determines to take an image of the user at the first location based on the first instruction, it can further determine the region or location (i.e., the first area) where the user should be when taking the image of the user at the first location, and prompt the user to arrive at the first area through the first prompt information so that the image of the user can be taken.

[0302] Based on the above embodiments, if the first location is not the current location, that is, if an image needs to be taken for the user at the first location, the first device needs to go to the first location with the user first. Optionally, method 800 further includes: the first device guiding the user to move to the first location.

[0303] For example, if the user and the first device are in a parking lot, and the user inputs a voice command to the first device to take an image of them at the first location, then the first device can guide the user from the parking lot to the first location.

[0304] In one scenario, if the user knows the route to the first location, then guiding the user to the first location via the first device can also be understood as accompanying or following the user to the first location.

[0305] In another scenario, if the user is unaware of the route to the first location, guiding the user to that location can also be understood as the first device guiding or leading the user there. Alternatively, in this case, the user follows the first device to the first location.

[0306] In addition, in this case, the first device may optionally output one or more prompts to prompt the user to follow the first device to the first location, such as outputting a voice prompt "Please follow me to the first location"; or, for example, during the journey to the first location, it may output voice prompts multiple times, similar to the voice prompts during navigation, such as "Turn left at the next intersection" or "We are about to arrive at the destination".

[0307] Based on the above embodiments, when the first device travels to the first location via the first path, the first path can be determined in the following manner.

[0308] Method 1: If the first device is able to obtain navigation data from its current location to the first location, the first path is the path indicated by the navigation data. For example, the first device can obtain navigation data from its current location to the first location from a navigation app installed on this device (or installed on the second device).

[0309] Method 2: If the first device can obtain map data between its current location and the first location, the first path can be a path determined by the first device based on the map data. For example, based on the map data, the first device can determine information such as various roadblocks and feasible roads between its current location and the first location, and thus determine the first path from the current location to the first location.

[0310] It should be understood that the first device may determine the first path through various algorithms, including but not limited to the optimal path search algorithm (such as the shortest time or the shortest distance). For specific methods of path determination in related fields, please refer to the relevant methods. This application does not limit the specific methods in this regard.

[0311] Optionally, when determining the first path via method 1 or method 2, the first device may first determine multiple candidate paths from its current location to the first location. The first path may be a path determined from multiple candidate paths based on user input. For example, user input may indicate the selection of the path with the shortest time, the shortest distance, or the path with the fewest obstacles.

[0312] Method 3: If the first device cannot obtain map data between its current location and the first location, the first device determines the first path based on the first location, its current location, and real-time obstacle information.

[0313] In this method, as the first device moves, the next path segment is determined in real time based on obstacle information acquired in the current environment. In other words, the first path is a path formed by multiple path segments determined in real time by the first device as it moves, until the first location is reached.

[0314] For example, based on the first location and its current position, the first device can determine the direction to the first location. Following this direction, the first device determines information about various obstacles along that direction, and by avoiding insurmountable obstacles and taking paths with fewer (or easier) obstacles, it can determine a path. Furthermore, as the first device moves, it can continuously determine new paths in the above manner until it reaches the first location.

[0315] As an example and not a limitation, in the first device... Figure 3 In the case of the shooting device 300 shown, such as Figure 9 As shown, the first path can be determined by the sensing system 310 and the control system 340. For example, the sensors in the sensing system 310 collect sensing data (or sensor data), such as, but not limited to, image data collected by a camera, data collected by a torque sensor, data collected by radar, etc.; the control system 340 can acquire the sensing data from the sensing system 310 and determine each segment of the path based on the sensing data.

[0316] In possible implementation b, the first location is the current location of the first device. That is, the first device obtains the first instruction at the first location.

[0317] For example, in conjunction with the possible implementation method 1 above, it is equivalent to the user and the first device arriving at the first location, the user inputting a fourth input on the second device side, the fourth input being used to instruct the user to take an image at the current location.

[0318] Combining with the possible implementation 2 above, it is equivalent to the user inputting a first input on the first device side. The first input is used to instruct the user to take an image at the current location. For example, the first input is a voice command "Please take a picture of me here".

[0319] Combining with the possible implementation method 3 above, this is equivalent to the first device generating the first instruction itself at the first location.

[0320] Optionally, based on the above embodiments, method 800 further includes: when the first device is located at the first location, outputting a second prompt message, the second prompt message being used to confirm with the user whether to take a picture; the first area is located at the first location.

[0321] In other words, when located at the first location, the first device recommends or pushes a service (or shooting service) to the user to capture images.

[0322] The second prompt message can be a prompt message output by the first device through voice prompts and / or interface prompts, and / or the first device can also send the second prompt message to the second device so that the second device can recommend shooting services to the user through voice prompts and / or interface prompts. The specific method is similar to outputting the first prompt message, as described above, and will not be repeated here.

[0323] In one possible scenario, the output of the second prompt message is a step performed before the first device receives the first instruction. For example, in conjunction with possible implementation 1 or possible implementation 2 above, after the first device outputs the second prompt message, the user confirms the shooting service through a fourth input on the second device side or a first input on the first device side; the fourth input or the first input is equivalent to the user's response to the second prompt message.

[0324] In one example, the first device can output a second prompt message based on the fulfillment of the trigger condition, which is similar to the method of generating the first instruction based on the fulfillment of the trigger condition mentioned above. Please refer to the description above, which will not be repeated here.

[0325] In another example, method 800 further includes: a first device receiving personal information of at least one user from a third device, and a second prompt message being determined based on the personal information of at least one user.

[0326] The third device, for example, is the first vehicle mentioned above. Based on user input, or based on the third device releasing the first device (such as the first device detaching from the robot cabin in the third device), or based on the distance between the first device and the third device being greater than a certain threshold, the third device sends at least one user's personal information to the first device; correspondingly, the first device receives at least one user's personal information from the third device.

[0327] At least one user can be a user inside the cabin, or a user sharing the first vehicle with the first device. Personal information may include a personal ID and / or personal preference information, as described above.

[0328] Using a personal ID, the first device can identify its companions in the current environment in real time, i.e., at least one user; or, the first device can identify the user it needs to serve; or, if a specific service target is designated for the first device, the first device can identify a specific service target among at least one user, such as the first user.

[0329] Based on personal preference information, the first device can determine the service type preferred by each user among at least one user, such as whether they prefer photography services. Thus, if at least one user prefers photography services, or if a specific service recipient prefers image-taking services, the device can proactively push photography services to that user and output a second prompt message.

[0330] In another example, the second prompt message is determined based on meeting the triggering conditions and the personal information of at least one user. This case is equivalent to a combination of the two examples above, as described above, and will not be elaborated further here.

[0331] Optionally, before obtaining the first instruction, method 800 further includes: the first device receiving a second input from a user, the second input being used to instruct to follow the first user; following the first user to move to a first location; and the first area being located at the first location.

[0332] The first user can be one user or multiple users, such as some or all of the users mentioned above. Following the first user can also be understood as keeping the distance between oneself and the first user less than a certain threshold.

[0333] In one scenario, as the first device follows the first user and reaches the first location, it generates a first instruction based on the fulfillment of triggering conditions, and actively takes an image for the user.

[0334] In another scenario, as the first device moves alongside the first user, upon reaching the first location, it outputs a second prompt message based on the fulfillment of triggering conditions and / or the personal information of at least one user, to recommend the image-taking service to the user.

[0335] Alternatively, before acquiring the first instruction, method 800 further includes: the first device receiving a second input from a user, the second input being used to instruct following the first user; acquiring the first instruction includes: acquiring the first instruction during the process of following the first user.

[0336] That is, during the process of the first device following the first user, based on the user's input on the first device side or the second device side, the first device obtains a first instruction to instruct the user to take a picture, as described in possible implementation 1 and possible implementation 2 above. Alternatively, during the process of the first device following the first user, a first instruction is generated based on the fulfillment of a trigger condition, as described in possible implementation 3 above.

[0337] Based on the above embodiments, during the movement of the first device, the first device can switch its movement mode (or walking mode). For example, the gait mode can be switched to a wheel rolling mode; or, the running state in the gait mode can be switched to a stair-climbing state, etc. Taking the process of the first device moving to the first location as an example, moving to the first location includes:

[0338] The first device adopts a first forward travel mode and passes through a first road segment. The first forward travel mode is determined based on the road attributes of the first road segment. The first forward travel mode is switched to a second forward travel mode and passes through a second road segment using the second forward travel mode. The second forward travel mode is determined based on the road attributes of the second road segment. The first road segment and the second road segment are the road segments passed through to reach the first location.

[0339] The first and second road segments are merely examples and do not limit the area traversed by the first device to roads. It can also be a location or area with various attributes, such as desert, grassland, or steps. Similarly, the road attribute is not limited to the type of road; it can be a characteristic of the area the first device needs to traverse, such as steps, highways, desert, or grassland.

[0340] The first forward movement mode and the second forward movement mode can be understood as different movement modes. Movement modes include, but are not limited to, gait modes and wheel rolling modes. Alternatively, gait modes and / or wheel rolling modes can be further subdivided into more modes. For example, based on the movement pattern of the first device, gait modes may include: walking mode, running mode, stair climbing mode, and jumping mode, etc.; similarly, based on the speed of the first device, wheel rolling modes may include: high-speed mode and smooth mode, etc. This application does not specifically limit the types of movement modes included in its embodiments.

[0341] During the movement of the first device, the appropriate movement mode for traversing the upcoming road segment can be determined based on the road attributes. For example, a gait mode (such as walking mode) can be used when crossing a lawn; a wheel rolling mode can be used when crossing a road; a stair-climbing mode can be used when crossing stairs; and a jumping mode can be used when crossing obstacles.

[0342] The above provides a detailed explanation of the process by which the first device prompts the user to take an image. Below, the detailed process executed by the first device during the image taking procedure for the user is described.

[0343] Before the first device takes an image of the user, the first device may first determine the location of its application and then move to that location to take an image of the user. In one possible implementation, method 800 further includes:

[0344] The first device controls the first device to move to the first position.

[0345] The first location is determined based on the region of interest (ROI), which is the background area captured by the user, and the first location is related to the ROI. The ROI is determined based on the user's third input. The ROI is determined based on the first location captured by the user, and the ROI is located at the first location.

[0346] In other words, the region of interest (ROI) is the area within the camera's field of view that the first device determines when capturing an image of the user, or the background area when capturing an image of the user. The ROI can be the area at the first location, or it can be any area that can be captured from the first location. For example, it could be the lake surface, the sky, or distant sculptures or buildings that can be captured from a bridge. Therefore, in some scenarios, the ROI is not limited to the area belonging to the first location.

[0347] In one example, the first device captures image data 1 of the surrounding environment at a first location using its built-in camera (visual sensor); based on the image recognition algorithm built into the first device, image data 1 is analyzed in real time. Elements at the first location that meet aesthetic or thematic requirements are identified, i.e., regions of interest.

[0348] For example, the area of ​​interest can be a landmark building or object at the first location: such as the Eiffel Tower, a unique sculpture, or a plaque; the area of ​​interest can be a beautiful natural landscape at the first location, such as a sea of ​​flowers, a uniquely shaped tree, or a waterfall; the area of ​​interest can be a dynamic and interesting element at the first location, such as a fountain in a square, a school of fish swimming, or a fluttering flag; the area of ​​interest can be the light and shadow effects at the first location, such as dappled sunlight filtering through leaves, shimmering water, or the outline lighting of buildings.

[0349] In another example, the region of interest (ROI) can be determined by the first device based on images or videos associated with the first location. These images or videos can be obtained from travel or social media apps installed on the first device, such as photos or videos taken by other users at the first location. Using these images or videos, the first device can determine the background area that appears most frequently, i.e., the ROI.

[0350] For example, if a plaque appears most frequently in these images or videos, then the area containing that plaque could be considered a region of interest. Similarly, if a sculpture appears most frequently as background in these images or videos, then that sculpture could be considered a region of interest.

[0351] In another example, the region of interest can also be the region indicated by the second device. For instance, the second device obtains images or videos related to the first location from a travel or social media app installed on the second device, thereby determining the region of interest and indicating it to the first device.

[0352] It can be understood that the relationship between the region of interest and the first location is as follows: the first location is the shooting location input by the user or determined by the first device itself, which is a general geographical range or a large area; the region of interest is the area at the first location that can be entered into the camera's field of view to serve as the background for the image taken by the user.

[0353] The first area is the location where the user should be. This first area can be determined based on the region of interest (ROI). For example, if the ROI is the area where the logo is placed at the entrance of a coffee shop, the first area could be the left edge of that logo. Alternatively, the first area can be understood as the location or area where the subject is being photographed, while the ROI can be understood as the area of ​​the background. Typically, the first area lies between the ROI and the first location. When the user is in the first area and the camera of the first device is pointed at the ROI, the camera can also capture the user.

[0354] Once the first device determines the region of interest, it is equivalent to determining the scene to be photographed at the first location. This allows us to determine the position that the device should be in when the first device takes an image for the user, i.e., the first position.

[0355] For example, the first position can satisfy the following condition 2: the first device can reach the first position, that is, the first device can move autonomously to the first position, and there are no insurmountable obstacles, etc.; and when the first device is in the first position, the field of view of the camera in the first device includes the region of interest, that is, the camera in the first device can capture the region of interest.

[0356] If there are multiple locations that meet condition 2, the first device can choose the location with better lighting when shooting the area of ​​interest, or it can choose the location with fewer obstacles.

[0357] As an example and not a limitation, in the first device... Figure 3 In the case of the shooting device 300 shown, combined with Figure 10The first position can be determined by the vision processing system 330; and the vision processing system 300 can send information indicating the first position, such as the coordinates corresponding to the first position, to the control system 340; then the control system 340 can drive the components in the mechanical system 360 to move through the drive system 350, so that the first device can move to the first position. For details, please refer to [reference needed]. Figure 3 The description of that location will not be elaborated here.

[0358] Based on the above embodiments, optionally, method 800 further includes: controlling the camera's field of view to align with the region of interest; and / or controlling the gimbal in the first device to follow the region of interest.

[0359] The camera is mounted on a pan-tilt unit.

[0360] In some scenarios, after the first device moves to the first position, the camera's field of view can be controlled to focus on the area of ​​interest in order to determine whether further adjustments to the composition are needed.

[0361] In some scenarios, the first device can follow (monitor or track) the area of ​​interest via a gimbal.

[0362] For example, the area of ​​interest might be a dynamic scene, such as the flow of water in a fountain, slowly moving clouds, or a moving vehicle. To capture the area of ​​interest, a gimbal can be used to follow it.

[0363] For example, the first device may adjust its position to capture the area of ​​interest, and the gimbal can follow the area of ​​interest.

[0364] As an example and not a limitation, in the first device... Figure 3 In the case of the 300 shooting devices shown, it is still combined Figure 10 The region of interest (ROI) and the subject being photographed can be determined by the vision processing system 330; and the vision processing system 300 can send information to the gimbal system 320 to indicate the ROI or the subject being photographed, such as the coordinates of the ROI or the subject being photographed in the image coordinate system; then the gimbal system 320 can follow the ROI or the subject being photographed. For specific details, please refer to [reference needed]. Figure 3 The description of that location will not be elaborated here.

[0365] Similarly, the first area can also be determined by the vision processing system 300. Furthermore, after the user arrives at the first area, the vision processing system 300 can send information indicating the first area or the user to the pan-tilt system 320; then the pan-tilt system 320 can follow the user. For details, please refer to [reference needed]. Figure 3 The description of that location will not be elaborated here.

[0366] It should be understood that the above description uses the example of a first device determining a first location and a first area. In actual application scenarios, the first location and / or the first area can also be determined by a second device or other devices such as the cloud; or, in other words, by the first device and other devices working together. For example, the first device sends image data (such as pictures and / or videos) obtained by capturing the surrounding environment to other devices, and the other devices determine the first location and / or the first area based on the image data and send it to the first device, etc. Specific implementation methods are similar and will not be detailed here.

[0367] Based on the above embodiments, optionally, after the first device reaches the first position, or after the camera's field of view is aligned with the region of interest, the first device may further adjust the composition. Exemplarily, method 800 further includes at least one of the following:

[0368] Adjust the position of the first device; or, adjust the angle of the gimbal; or, adjust the shooting parameters of the camera. The first area is located within the camera's field of view.

[0369] It should be understood that shooting parameters are parameters that affect the output image quality, such as, but not limited to: shooting mode (or field of view), magnification (or focal length), focus point, aperture, shutter speed, ISO, exposure compensation, white balance, filter (or color mode), etc. This application does not specifically limit these parameters.

[0370] For example, by adjusting the position of the first device, adjusting the gimbal, or adjusting one or more shooting parameters, the camera's viewfinder can be aligned with the subject in the area of ​​interest.

[0371] The subject within the area of ​​interest (ROI) can be either the main feature of the ROI or a feature with higher photographic value. For example, if the ROI is a building facade, the subject could be a distinctive arched window or a sculpture; if the ROI is a fountain, the subject could be the tallest central jet of water; if the ROI is light and shadow, the subject could be the brightest patch of light on the ground.

[0372] For example, by adjusting the position of the first device, adjusting the gimbal, or adjusting one or more shooting parameters, the image captured by the current camera can meet the shooting standards.

[0373] In some scenarios, the shooting standard can be the shooting standard determined by the primary device based on the current shooting scene. It can also be understood as an image aesthetic evaluation standard, including but not limited to standards related to lighting, composition, etc.

[0374] In other scenarios, the first device has multiple preset shooting standards corresponding to various scenarios. The shooting standard corresponding to the current shooting scenario is determined from these multiple shooting standards.

[0375] Multiple shooting standards can also be understood as multiple shooting templates, such as including but not limited to one or more of the following: composition rules (or composition principles), image proportions, background and foreground processing methods (such as whether to add a framed foreground to increase the sense of depth), lighting requirements, etc.

[0376] For example, the first device has preset correspondences between various types of shooting scenes, multiple numbers of users, and multiple shooting standards. By combining the types of scenes and the number of users in the current shooting scene, the corresponding shooting standard can be determined. Scene types could be, for example, the main scene types in the area of ​​interest, such as flower fields, trees, buildings, the sea, beaches, traffic flow, neon lights, etc.

[0377] During the composition adjustment process, the position of the first device, the angle of the gimbal, and the shooting parameters can be determined by the vision processing system 330. The composition adjustment process can be understood as narrowing the gap between the current composition and the ideal composition (i.e., the shooting standard). For example, based on the image currently captured by the camera and the shooting standard, the vision processing system 330 determines the deviation between the two, such as the deviation in dimensions like the horizontal tilt angle and the proportion of the subject; then, based on this deviation, it can determine the adjustment method for the position of the first device, such as determining the direction and distance of movement; it can also determine the adjustment method for the gimbal, such as determining the rotation direction and rotation angle; and it can also determine the adjustment method for the shooting parameters, such as determining the magnification, shooting mode, white balance parameters, and filter parameters.

[0378] It should be understood that the first area is the location or area where the user should be, and the first area is always within the camera's field of view. The first area can be determined before the first device adjusts the composition, for example, based on the region of interest; or, the first area can be determined during the composition adjustment process; or, the first area can be determined after the composition adjustment.

[0379] For example, the visual processing system 330 can determine the position (i.e., the first area) where the user should be located based on the camera's field of view and certain compositional principles. For instance, based on the rule of thirds, the user can be placed in the left / right third of the frame; based on central symmetry, the user can be positioned symmetrically with the subject in the background; based on leading lines, scene lines can be used to guide the viewer's eye to the user; based on framing, the user can be placed within natural frames such as doorways or windows; based on specific proportions, the user's height proportion in the frame and relative size to background landmarks can be set to specific values.

[0380] In other words, based on the camera's field of view (or captured image) and certain compositional principles, the user's position within the image can be determined, thereby identifying the first area. These compositional principles can be, for example, determined based on the camera's field of view; different compositional principles can be applied depending on the objects within the field of view.

[0381] Optionally, based on the above embodiments, the first area is also determined based on the number of users to be photographed.

[0382] Since the number of users is different and the size of the area they occupy is different, the size and location of the first area determined by the first device may be different. Therefore, the mapping criteria used to determine the first area may be different. Thus, the first device can also determine the first area based on the number of users.

[0383] Furthermore, the process of adjusting the composition using the first device can also be based on the number of users, and / or the shooting criteria can be determined based on that number of users. For example, when shooting a single user, the shooting criteria might include: highlighting the individual, with the overall background serving that single user. When shooting multiple users, the shooting criteria might include: expressing the relationships between the users, ensuring each user is clear and visible, and maintaining a balanced overall layout. Therefore, shooting criteria and / or composition adjustments can also be based on the number of users.

[0384] In one possible implementation, the first instruction is also used to indicate the number of users to be photographed.

[0385] For example, in conjunction with the method of obtaining the first instruction in possible implementation 1 or possible implementation 2 described above, the fourth input or the first input is also used to indicate the number of users to be photographed. That is, during the process of the user inputting an instruction to the first device or the second device, the number of users to be photographed is also indicated. Taking a voice instruction as an example, the user can output to the first device, "Please take pictures of me and my friends," etc.

[0386] For example, in conjunction with the method of obtaining the first instruction in possible implementation 3 above, where the first instruction is an instruction generated by the first device itself, the number of users to be photographed is determined by the first device.

[0387] As an example and not a limitation, the first device determines the number of users based on the user status of at least one user. For example, if the user status of two of the at least one users is suitable for image capture, then the number of users could be two, etc.

[0388] In another possible implementation, method 800 further includes receiving a fifth input from the user, the fifth input indicating the number of users to be photographed. That is, based on the first instruction, the first device has not determined the number of users. The first device can then confirm the number of users with the user, such as by outputting a prompt message a through voice prompts and / or interface prompts. Prompt message a is used to confirm the number of users to be photographed with the user; the fifth input can be understood as the user's response to prompt message a, and can be the number of users entered by the user through touch input, voice commands, etc.

[0389] It is understandable that the process of adjusting the composition shown above can also be performed after the user arrives at the first area; or, the process of adjusting the composition shown above can be performed before the user arrives at the first area, and after adjusting the composition, the user is prompted to take an image in the first area (such as outputting the first prompt message).

[0390] Based on the above embodiments, in one possible implementation, after the user arrives at the first area, the first device may continue to adjust the composition.

[0391] For example, even if the composition has been adjusted before the user reaches the first area, once the user reaches the first area, it may be determined that the current composition still does not meet the shooting standards, so the composition can be adjusted further.

[0392] For example, after a user arrives at the first area, the first device takes one or more images for the user, but the user is not satisfied with the one or more images. If the first device obtains the user's sixth input, which is used to indicate that the user is not satisfied with the currently captured image, or the sixth input is used to indicate the user's shooting needs, then based on the sixth input, the first device can continue to adjust the composition.

[0393] For example, method 800 further includes at least one of the following:

[0394] The first device outputs a third prompt message, which prompts the user to move in the first direction; or,

[0395] Adjust the position of the first device; or,

[0396] Adjust the angle of the gimbal in the first device; or,

[0397] Adjust the camera's shooting parameters and set the camera on the gimbal.

[0398] The method for outputting the third prompt message is similar to the method for outputting the first prompt message, as described above.

[0399] In some possible scenarios, upon reaching the first area, the first device may determine that the user's current position still needs further adjustment, and may prompt the user to move. The first direction can be any direction. The third prompt can not only prompt the user to move in the first direction, but also indicate the distance to move, such as prompting the user to "move one step to your left."

[0400] Alternatively, in some scenarios, a third prompt is used to guide the user to move to a second area. In other words, the third prompt can indicate a new area or location to the user. The second area is similarly defined to the first area; it is the new location the user should be in when taking an image. For example, if the user is standing on the second step, the third prompt could be "Please stand on the third step."

[0401] Alternatively, in some scenarios, a third prompt can be used to suggest a new shooting pose to the user. In other words, the primary device can also prompt the user to switch shooting poses.

[0402] Alternatively, the first device may guide the user to move in a first direction or to a second area. For example, the first device may move to the user's current location (such as the first area) and indicate the mode of movement to the user through its own movement; or, the first device may move to the second area to indicate the new location to the user.

[0403] The methods for adjusting the position of the first device, the angle of the gimbal, and the shooting parameters are described above and will not be repeated here.

[0404] Based on the above embodiments, after the user's location, the location of the first device, and the composition are all adjusted, method 800 further includes: the first device capturing first image data.

[0405] The first image data may include one or more images, or one or more video clips.

[0406] Optionally, method 800 further includes: the first device sending part or all of the image data in the first image data to the third device; correspondingly, the third device receiving the part or all of the image data from the first device.

[0407] The third device is, for example, the first vehicle mentioned above. The first device can communicate with the third device via wireless or wired communication, as described above.

[0408] In one scenario, based on user input, the first device sends some or all of the image data from the first image data to the third device. For example, the user triggers the first device to transmit data to the third device through touch input, voice commands, or other means.

[0409] In another scenario, based on the detection that the distance between the third device and the first device is less than a certain threshold, the first device sends part or all of the image data from the first image data to the third device.

[0410] In another scenario, based on establishing a short-range wireless communication connection with a third device, such as Bluetooth, the first device sends part or all of the image data from the first image data to the third device.

[0411] In another scenario, based on the first device returning to the third device, such as returning to the robot cabin of the third device, the first device sends part or all of the image data from the first image data to the third device.

[0412] After the third device acquires part or all of the image data, the image data can be displayed through one or more display devices in the third device.

[0413] For example, the third device receives a seventh input from the user and, in response to the seventh input, displays target image data via one or more display devices within the cockpit.

[0414] The seventh input can be touch input, voice command, gesture input, etc. This application embodiment does not specifically limit this user input type.

[0415] The seventh input is used to instruct the display of images or videos of the target user. For example, if the seventh input is "I want to see the interaction moments between me and my puppy", then the third device can display images and videos including "me" and "puppy" through one or more display devices.

[0416] It is understood that the third device stores user information for one or more users, which may include user IDs, as described above. Using the user IDs of one or more users, the third device can determine which of those users the target user indicated by the seventh input is.

[0417] It can also be understood that the above first image data is only an example. In actual application scenarios, the first device can transmit some or all of the image data (including photos and videos) captured during this trip to the third device.

[0418] Optionally, method 800 further includes capturing second image data after the user switches from the first area to another area, and / or after the user changes their shooting posture. The second image data includes one or more images and / or one or more video clips.

[0419] In other words, during the process of taking images for a user, new photos or videos can continue to be taken for the user after the user changes position and / or posture.

[0420] The above illustrates the process of the first device taking images for the user. The following examples illustrate the overall process of the first device taking images for the user.

[0421] In one example, Figure 11 This is a flowchart illustrating a service method 1100 provided in an embodiment of this application. Method 1100 can be executed by a first device. Figure 11 As shown, method 100 includes the following steps:

[0422] S1101, The first device acquires the first instruction.

[0423] It should be understood that, based on the first instruction, the first device can determine to capture an image for the user at a first location. The implementation of S1101 is similar to that of S801, and specific details can be found in the description above.

[0424] S1102, The first device determines the region of interest at the first location.

[0425] S1103. The first device determines a first position based on the region of interest and moves to the first position.

[0426] Or, to put it another way, the first device arrives at the shooting position of this device.

[0427] S1104. The first device adjusts the composition. That is, the first device, at the first position, aligns the camera's field of view with the area of ​​interest and adjusts the composition, such as performing one or more of the following: adjusting the position of the first device, adjusting the angle of the gimbal, or adjusting the shooting parameters, etc. For details, please refer to the description in method 800, which will not be elaborated here.

[0428] S1105. After adjusting the composition, the first device outputs the first prompt message, notifying the user that they have arrived at the first area. And / or, the first device can also guide the user to move to the first area.

[0429] For example, the first device moves to the user's location and leads the user from the user's location to the first area; or, the first device moves to the first area to indicate the location indicated by the first area to the user.

[0430] It should be understood that when the first device guides the user to the first area, after adjusting the composition, the first device can first record the adjusted position, which may be slightly different from the first position; and the angle of the gimbal and the shooting parameters can remain unchanged. After guiding the user to the first area, the first device can return to the adjusted position.

[0431] S1106. After the user arrives at the first area, the first image data is captured for the user.

[0432] Alternatively, after the user arrives at the first area, the composition can be readjusted before taking the first image data for the user.

[0433] In another example, Figure 12 This is a flowchart illustrating a service method 1200 provided in an embodiment of this application. Method 1200 can be executed by a first device. Figure 11 As shown, method 100 includes the following steps:

[0434] S1201, The first device acquires the first instruction.

[0435] It should be understood that, based on the first instruction, the first device can determine to capture an image for the user at a first location. The implementation of S1101 is similar to that of S801, and specific details can be found in the description above.

[0436] S1202, The first device determines the region of interest at the first location.

[0437] S1203. The first device outputs a first prompt message to notify the user that they have arrived at the first area. And / or, the first device may also guide the user to move to the first area.

[0438] S1204, The first device moves to the first position. That is, the first device arrives at the shooting position.

[0439] S1205, First equipment adjustment layout.

[0440] S1206. After the user arrives at the first area, the first image data is captured for the user.

[0441] Alternatively, after the user arrives at the first area, the composition can be readjusted before taking the first image data for the user.

[0442] It should be understood that the difference between method 1200 and method 1100 is that in method 1100, the first device moves to the first position and adjusts the composition before prompting the user to move to the first area, thus reducing the user's waiting time in the first area; in method 1200, the first device prompts the user to reach the first area first, and then moves to the first position and adjusts the composition, allowing the first device to adjust the composition more quickly. The rest are similar, and the specific implementation methods of each step can be found in the description of method 800, which will not be repeated here.

[0443] Based on the methods described above, as an optional embodiment, method 800, method 1100, or method 1200 further includes:

[0444] The third device sends the personal information of at least one user to the first device; correspondingly, the first device receives the personal information of at least one user from the third device. The first device obtains the behavioral posture data of a second user, who belongs to at least one user. The first device outputs a fifth prompt message, which is used to confirm with the second user whether to execute the first service, which is determined based on the second user's personal information and behavioral posture data.

[0445] It should be understood that the way the first device outputs the fifth prompt message is similar to the way it outputs the first prompt message, as described above, and will not be elaborated here.

[0446] At least one user's personal information and the third device can be referenced as described above. Behavioral posture data is similar to the user state described above, and can be determined, for example, through sensor data collected by cameras or other sensors. Behavioral posture data can be used to indicate a user's state, such as fatigue, drowsiness, excitement, or other emotional states; it can also be used to indicate behaviors such as running, dancing, or taking selfies. Through behavioral posture data and personal information, the emotional needs or behavioral intentions of the second user can be determined, identifying the services the second user currently requires, and thus proactively providing the first service to the user.

[0447] For example, if the second user is an adult and is identified as being sleepy or tired, the first service could be a coffee ordering service; if the second user is idle and their personal preference information includes a preference for singing, the first service could be a karaoke service, etc.

[0448] In other words, as the first device accompanies the user on their journey, it can detect the user's status in real time, and then combine the user's status and personal information to push suitable services to the user in real time, so as to improve the user's travel experience.

[0449] As an example and not a limitation, in the first device... Figure 3 In the case of the shooting device 300 shown, with Figure 9 Similarly, the camera in the perception system 310 can collect image data; the control system 340 can determine the user's status and identity based on the image data, and then push suitable services to the user.

[0450] In addition to providing services to users while they are outdoors, in some possible scenarios, in-cabin services can also be provided to users while they are returning to the vehicle, or after they have returned to the vehicle.

[0451] For example, method 800, method 1100 or method 1200 further includes: during the process of going to the location of the third device, or after returning to the third device, outputting a sixth prompt message, the sixth prompt message being used to confirm with the user whether to perform the second service, the second service being a service provided by the third device.

[0452] The second service can be cabin services, such as massage, heated seats, photo or video projection, heated steering wheel, or turning on the vehicle's air conditioning.

[0453] The second service can be determined based on one or more of the following: the amount of exercise during the trip, the ambient temperature, or the user's condition. For example, if the ambient temperature is low or high, the second service could be turning on the vehicle's air conditioning. If the amount of exercise during the trip is high, or if the distance to the third device is long, the second service could be a massage, etc.

[0454] It's understandable that some services can be pushed out during the journey to the location of the third device, such as seat heating, steering wheel heating, and turning on the vehicle's air conditioning, so that these services can be performed in advance before the user returns to the cabin. Some services can be pushed out after the user returns to the cabin, such as massage services, photo or video playback, etc.

[0455] It can also be understood that the way the first device outputs the sixth prompt message is similar to the way it outputs the first prompt message, as described above, and will not be elaborated here.

[0456] It should be noted that the order of steps shown in the methods provided in this application is for illustrative purposes only. In actual application scenarios, the order in which the first device executes the steps may also be different. This application does not impose specific limitations on this.

[0457] The service methods of the embodiments of this application have been described above. The apparatus for executing the above methods provided in the embodiments of this application is described below. Those skilled in the art will understand that the methods and apparatus can be combined with and referenced by each other, and the related apparatus provided in the embodiments of this application can execute the steps in the above methods.

[0458] The apparatus described below includes modules or units for performing each part of the above embodiments. The modules or units shown may be software or hardware, hardware, or a combination of both. The apparatus is only briefly illustrated below; for details of implementation, please refer to the description of the foregoing method embodiments, which will not be repeated hereafter.

[0459] Figure 13 This is a schematic block diagram of a service device 1300 provided in an embodiment of this application. Figure 13 As shown, the device 1300 includes a control module 1310 and an interaction module 1320.

[0460] Among them, the control module 1310 includes, for example, Figure 3 The control system 340 and / or vision processing system 330 can be used to implement the functions of the control system 340 and / or vision processing system 330; the interaction module 1302 includes, for example, Figure 3 The interactive system 380 in the text can be used to implement the functions of the interactive system 380.

[0461] In one possible implementation, the service device 1300 is used to implement the steps performed by the first device in the above method embodiments.

[0462] The control module 1310 is used to: acquire a first instruction, which instructs the user to take an image. For example, the first instruction is an instruction generated by the control module 1310, or an instruction acquired through the communication system 350 and / or the interaction system 380.

[0463] The interaction module 1320 is used to output a first prompt message, which prompts the user to take an image in the first area.

[0464] Optionally, the control module 1310 is used to: control the service device 1300 to move to the user's location and lead the user from the user's location to the first area; or, control the service device 1300 to move to the first area.

[0465] Optionally, the control module 1310 is configured to: receive a first instruction from a second device; or, receive a first input from a user, wherein the first instruction is determined based on the first input; or, generate a first instruction based on the fulfillment of a trigger condition.

[0466] Optionally, the interaction module 1320 is used to: when located at the first location, output a second prompt message, the second prompt message being used to confirm with the user whether to take a picture; the first area is located at the first location.

[0467] Optionally, the service device 1300 also includes a communication module, such as Figure 3 The communication system 370 in the middle, the communication module is used to: receive personal information of at least one user from a third device, and the second prompt information is determined based on the personal information of at least one user.

[0468] Optionally, the interaction module 1320 is configured to: receive a second input from a user, the second input being used to indicate following the first user;

[0469] The control module 1310 is used to: control the service device 1300 to follow the first user to the first location; the first area is located at the first location.

[0470] Optionally, the first instruction may also be used to indicate a first location, wherein the first area is located at the first location.

[0471] Optionally, the control module 1310 is used to: control the service device 1300 to guide the user to a first location.

[0472] Optionally, the control module 1310 is used to: control the service device 1300 to adopt a first forward mode and pass through a first road segment, the first forward mode being determined based on the road attributes of the first road segment; switch the first forward mode to a second forward mode and adopt the second forward mode to pass through a second road segment, the second forward mode being determined based on the road attributes of the second road segment; the first road segment and the second road segment are the road segments passed through to reach the first location.

[0473] Optionally, the control module 1310 is used to: control the service device 1300 to move to a first position; the first position is determined based on a region of interest, which is a background area photographed by the user, and the first position is related to the region of interest; the region of interest is determined based on a third input from the user; the region of interest is determined based on a first location photographed by the user, and the region of interest is located at the first location.

[0474] Optionally, the control module 1310 is used to: control the camera's field of view to be aligned with the region of interest; and / or, the pan-tilt unit in the control device 1300 follows the region of interest; wherein the camera is mounted on the pan-tilt unit. Alternatively, the service device 1300 may further include a pan-tilt module, and... Figure 3 Similar to the gimbal system 320 in the middle, the gimbal module is used to: control the camera's field of view to be aligned with the region of interest; and / or control the gimbal in the service device 1300 to follow the region of interest.

[0475] Optionally, the control module 1310 or the pan-tilt module is used for one or more of the following: adjusting the position of the service device 1300; or, adjusting the angle of the pan-tilt; or, adjusting the shooting parameters of the camera; wherein the first area is located within the shooting field of view of the camera.

[0476] Optionally, after the user is in the first area, the control module 1310 or the pan-tilt module is used to: output a third prompt message to prompt the user to move in the first direction; or, adjust the position of the service device 1300; or, adjust the angle of the pan-tilt in the service device 1300; or, adjust the shooting parameters of the camera, which is set on the pan-tilt.

[0477] Optionally, the first prompt message is also used to instruct the user on the shooting posture; or, the interaction module 1320 is used to output a fourth prompt message, which is used to instruct the user on the shooting posture.

[0478] Optionally, after outputting the first prompt message, the control module 1310 is further configured to: control the capture of first image data after the user is located in the first area. Alternatively, the service device 1300 may also include a visual processing module, such as... Figure 3 The visual processing system 310 in the middle is used to capture and obtain the first image data.

[0479] Optionally, the control module 1310 or the vision processing module is further configured to: capture second image data after the user switches from the first area to another area, and / or after the user changes the shooting posture.

[0480] Optionally, the communication module is also used to: send part or all of the image data in the first image data to a third device.

[0481] Optionally, the first instruction may also be used to indicate the number of users to be photographed.

[0482] Optionally, the communication module is further configured to: receive personal information from at least one user of a third device; the control module 1310 is further configured to acquire behavioral posture data of a second user, the second user belonging to at least one user; the interaction module 1320 is configured to: output a fifth prompt message, the fifth prompt message being used to confirm with the second user whether to execute the first service, the first service being determined based on the second user's personal information and behavioral posture data.

[0483] Optionally, the interaction module 1320 is used to output a sixth prompt message during the process of going to the location of the third device, or after returning to the third device. The sixth prompt message is used to confirm with the user whether to perform the second service, which is a service provided by the third device.

[0484] It should be understood that the device 1300 here is embodied in the form of a functional module. The term "module" here can refer to application-specific integrated circuits (ASICs), electronic circuits, processors (e.g., shared processors, proprietary processors, or group processors) and memory for executing one or more software or firmware programs, integrated logic circuits, and / or other suitable components supporting the described functionality. For example, when a module is implemented in the form of a processing element scheduler code, the processing element can be a general-purpose processor, such as a central processing unit (CPU), or other processors capable of calling program code, such as a controller. Furthermore, these modules can be integrated together to implement a system-on-a-chip (SOC).

[0485] In an optional example, those skilled in the art will understand that the device 1300 may specifically be the first device in the above method embodiments. The device 1300 may be used to execute the various processes and / or steps corresponding to the first device in the above method embodiments. To avoid repetition, it will not be described again here.

[0486] The aforementioned device 1300 has the function of implementing the corresponding steps executed by the control device in the aforementioned method; the aforementioned function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the aforementioned function. In embodiments of this application, Figure 13 The device 1300 in the middle can also be a chip, such as a SOC.

[0487] Figure 14 A schematic diagram of a service apparatus 1400 provided in an embodiment of this application is shown. Apparatus 1400 can be a chip system, or an apparatus configured with a chip system to implement the methods described in the above method embodiments. In this embodiment, the chip system can be composed of chips, or it can include chips and other discrete devices.

[0488] like Figure 14 As shown, the device 1400 may include a processor 1410, which can be used to execute computer programs or instructions in memory to perform the various steps and / or processes corresponding to the first device in the above method embodiments.

[0489] In one possible implementation, the device 1400 further includes a communication interface 1420. The communication interface 1420 can be used to communicate with other devices via a transmission medium, thereby enabling the device 1400 to communicate with other devices. The communication interface 1420 may be, for example, a transceiver, an input / output interface, a pin, a bus, a transceiver circuit, or a device capable of transmitting and receiving functions. The processor 1410 can utilize the communication interface 1420 to input and output data for executing the various steps and / or processes corresponding to the first device in the above method embodiments.

[0490] In one possible implementation, the device 1400 further includes at least one memory 1430 for storing program instructions and / or data. The memory 1430 is coupled to the processor 1410. The coupling in this embodiment is an indirect coupling or communication connection between devices, units, or modules, and can be electrical, mechanical, or other forms, used for information exchange between devices, units, or modules. The processor 1410 may operate in conjunction with the memory 1430. The processor 1410 may execute program instructions stored in the memory 1430.

[0491] Optionally, the memory 1430 may be a memory disposed in the device 1400. Exemplarily, the memory 1430 may be integrated with the processor 1410; or, the memory 1430 may be disposed separately from the processor 1410.

[0492] Alternatively, memory 1430 may be memory outside of device 1400. It may also be memory outside of device 1400.

[0493] It should be understood that the device 1400 can be used, for example, to perform the processing steps in the above method embodiments, such as determining the interfaces involved in the above method embodiments. The device can also instruct the data of these interfaces to be displayed on the screen via the communication interface 1420.

[0494] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in the embodiments of this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation entry points are provided for users to choose to authorize or refuse.

[0495] This application provides an electronic device, which includes a processor and a memory; the memory stores computer execution instructions; the processor executes the computer execution instructions stored in the memory, causing the electronic device to perform the above-described method.

[0496] This application provides an electronic device for performing the above-described method.

[0497] This application provides a vehicle that can be releasably connected to a first device, the first device being used to perform the above-described method.

[0498] This application provides a chip. The chip includes a processor, which is used to call a computer program in memory to execute the technical solutions in the above embodiments. Its implementation principle and technical effects are similar to those in the related embodiments described above, and will not be repeated here.

[0499] This application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program. When the computer program is executed by a processor, it implements the methods described above. The methods described in the above embodiments can be implemented wholly or partially by software, hardware, firmware, or any combination thereof. If implemented in software, the functionality can be stored as one or more instructions or code on or transmitted over the computer-readable medium. The computer-readable medium can include computer storage media and communication media, and can also include any medium that can transfer a computer program from one place to another. The storage medium can be any target medium accessible by a computer.

[0500] In one possible implementation, a computer-readable medium may include random access memory (RAM), read-only memory (ROM), compact disc read-only memory (CD-ROM) or other optical disc storage, magnetic disk storage or other magnetic storage devices, or any other medium intended to carry or store required program code in the form of instructions or data structures, and accessible by a computer. Furthermore, any connection is appropriately referred to as a computer-readable medium. For example, if software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, then coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. As used herein, disks and optical discs include optical discs, laser discs, optical discs, digital versatile discs (DVDs), floppy disks, and Blu-ray discs, where disks typically reproduce data magnetically, while optical discs optically reproduce data using lasers. Combinations of the above should also be included within the scope of computer-readable media.

[0501] This application provides a computer program product, which includes a computer program that, when run, causes a computer to perform the above-described method.

[0502] It should be noted that the modules or components in the above embodiments can be one or more integrated circuits configured to implement the above methods, such as one or more application-specific integrated circuits (ASICs), one or more digital signal processors (DSPs), or one or more field-programmable gate arrays (FPGAs), etc. Furthermore, when a module is implemented through processing element scheduler code, the processing element can be a general-purpose processor, such as a central processing unit (CPU) or other processors capable of calling program code, such as a controller. Additionally, these modules can be integrated together to implement a system-on-a-chip (SOC).

[0503] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this application is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., a solid-state disk (SSD)).

[0504] It is understood that the various numerical designations used in the embodiments of this application are merely for descriptive convenience and are not intended to limit the scope of the embodiments of this application.

[0505] It is understood that, in the embodiments of this application, the order of the above-mentioned process numbers does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0506] In this embodiment of the application, the indication includes explicit indication (also known as direct indication) and implicit indication (also known as indirect indication). Explicit indication information A refers to information A; implicit indication information A refers to indicating information A through the correspondence between information A and information B, and direct indication information B. The correspondence between information A and information B can be predefined, pre-stored, pre-burned, or pre-configured; alternatively, it can refer to indicating information A through information B and preset rules.

[0507] In this embodiment, information C is used to determine information D, which includes determining information D based solely on information C, and determining it based on information C and other information. Furthermore, information C can also be used to determine information D indirectly, for example, in the case where information D is determined based on information E, and information E is determined based on information C.

[0508] In this application embodiment, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates an "or" relationship between the preceding and following related objects, but it does not exclude the possibility of indicating an "and" relationship. The specific meaning can be understood in conjunction with the context. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c; a and b; a and c; b and c; or a and b and c. Here, a, b, and c can be single or multiple.

[0509] In this application embodiment, the use of prefixes such as "first" and "second" is merely for the purpose of distinguishing and describing different things belonging to the same name category, and does not constrain the order, size, or quantity of things. For example, "first threshold" and "second threshold" are simply different thresholds, and there is no temporal sequence, size, or priority relationship between them.

[0510] In the embodiments of this application, "sending" and "receiving" can be performed between devices, such as between a second device and a shooting device; or they can be performed within a device, such as between components, modules, chips, software modules, or hardware modules within the device via a bus, wiring, or interface.

[0511] In the embodiments of this application, "when," "if," and "if" all refer to the device making a corresponding processing under certain objective circumstances, and are not limited to a time, nor do they require the device to perform a judgment action when it is implemented, nor do they imply any other limitations.

[0512] In the embodiments of this application, the words "example," "exemplarily," "for example," or "such as" are used to indicate that they are examples, illustrations, or explanations. Any embodiment or design described as "example," "exemplarily," "for example," or "such as" in this application should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of the words "example," "exemplarily," "for example," or "such as" is intended to present the relevant concepts in a specific manner.

Claims

1. A service method, characterized in that, Applied to a first device, the method includes: Obtain a first instruction, the first instruction being used to instruct the user to take an image; Output a first prompt message, which prompts the user to take an image in the first area.

2. The method according to claim 1, characterized in that, The method further includes: The first device moves to the user's location and guides the user from that location to the first area; or, The first device moves to the first area.

3. The method according to claim 1 or 2, characterized in that, The acquisition of the first instruction includes: Receive the first instruction from the second device; or, Receive the user's first input, the first instruction being determined based on the first input; or, The first instruction is generated based on the fulfillment of the triggering conditions.

4. The method according to any one of claims 1 to 3, characterized in that, Before obtaining the first instruction, the method further includes: When the user is at the first location, a second prompt message is output to confirm whether to take a picture; the first area is located at the first location.

5. The method according to claim 4, characterized in that, The method further includes: The system receives personal information from at least one user from a third device, and the second notification information is determined based on the personal information of the at least one user.

6. The method according to any one of claims 1 to 5, characterized in that, Before obtaining the first instruction, the method further includes: Receive a second input from the user, the second input being used to indicate following the first user; Follow the first user to the first location; the first area is located at the first location.

7. The method according to any one of claims 1 to 5, characterized in that, The first instruction is also used to indicate a first location, wherein the first area is located at the first location.

8. The method according to claim 7, characterized in that, The method further includes: Guide the user to the first location.

9. The method according to claim 6 or 8, characterized in that, The movement to the first location includes: The first forward travel mode is adopted, and the first forward travel mode is determined based on the road attributes of the first road segment. The first forward travel mode is switched to the second forward travel mode, and the second forward travel mode is used to pass through the second road segment. The second forward travel mode is determined based on the road attributes of the second road segment. The first road segment and the second road segment are the road segments passed through to reach the first location.

10. The method according to any one of claims 1 to 9, characterized in that, The method further includes: The first device moves to the first position; The first location is determined based on a region of interest, which is the background area captured by the user, and the first location is related to the region of interest; the region of interest is determined based on a third input from the user; the region of interest is determined based on a first location captured by the user, and the region of interest is located at the first location.

11. The method according to claim 10, characterized in that, The method further includes: Control the camera's field of view to be aimed at the region of interest; and / or control the gimbal in the first device to follow the region of interest; The camera is mounted on the gimbal.

12. The method according to claim 11, characterized in that, The method further includes at least one of the following: Adjust the position of the first device; or, Adjust the angle of the gimbal; or, Adjust the shooting parameters of the camera; The first area is located within the field of view of the camera.

13. The method according to any one of claims 1 to 12, characterized in that, After the user is located in the first area, the method further includes at least one of the following: Output a third prompt message, which prompts the user to move in the first direction; or, Adjust the position of the first device; or, Adjust the angle of the gimbal in the first device; or, Adjust the shooting parameters of the camera, which is mounted on the gimbal.

14. The method according to any one of claims 1 to 13, characterized in that, The first prompt information is also used to instruct the user's shooting posture; or, the method further includes: outputting a fourth prompt information, the fourth prompt information being used to instruct the user's shooting posture.

15. The method according to any one of claims 1 to 14, characterized in that, After outputting the first prompt message, the method further includes: After the user is in the first area, the first image data is captured.

16. The method according to claim 15, characterized in that, The method further includes: The second image data is captured after the user switches from the first area to another area, and / or after the user changes the shooting posture.

17. The method according to claim 15 or 16, characterized in that, The method further includes: Send some or all of the image data from the first image data to a third device.

18. The method according to any one of claims 1 to 17, characterized in that, The first instruction is also used to indicate the number of users to be photographed.

19. The method according to any one of claims 1 to 18, characterized in that, The method further includes: Receive personal information from at least one user from a third device; Obtain the behavioral posture data of the second user, who belongs to the at least one user; A fifth prompt message is output, which is used to confirm with the second user whether to execute the first service, which is determined based on the second user's personal information and the behavioral posture data.

20. The method according to any one of claims 1 to 19, characterized in that, The method further includes: During the process of traveling to the location of the third device, or after returning to the third device, a sixth prompt message is output. The sixth prompt message is used to confirm with the user whether to execute the second service, which is a service provided by the third device.

21. A service device, characterized in that, The device includes a control module and an interaction module; The control module is used to: acquire a first instruction, the first instruction being used to instruct the user to take a picture; The interaction module is used to output a first prompt message, which prompts the user to take a picture in the first area.

22. The apparatus according to claim 21, characterized in that, The control module is also used to: control the device to move to the user's location and lead the user from the user's location to the first area; or, control the device to move to the first area.

23. The apparatus according to claim 21 or 22, characterized in that, The control module is used for: Receive the first instruction from the second device; or, Receive the user's first input, the first instruction being determined based on the first input; or, The first instruction is generated based on the fulfillment of the triggering conditions.

24. The apparatus according to any one of claims 21 to 23, characterized in that, The interaction module is used to: receive a second input from the user, the second input being used to indicate following the first user; The control module is used to: control the device to follow the first user to a first location; the first area is located at the first location.

25. The apparatus according to any one of claims 21 to 24, characterized in that, The control module is used to: control the first device to move to a first position; The first location is determined based on the region of interest, which is the background area captured by the user, and the first location is related to the region of interest; The region of interest is determined based on a third input from the user; the region of interest is determined based on a first location captured for the user, and the region of interest is located at the first location.

26. A vehicle, characterized in that, The vehicle can be released from a first device, the first device being used to perform the method as described in any one of claims 1-20.

27. An electronic device, characterized in that, The electronic device includes: one or more processors and memory; The memory is coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, the one or more processors invoking the computer instructions to cause the electronic device to perform the method as described in any one of claims 1-20.

28. A chip system, characterized in that, The chip system is applied to an electronic device, the chip system including one or more processors, the one or more processors being used to invoke computer instructions to cause the electronic device to perform the method as described in any one of claims 1-20.

29. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes computer instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 1-20.

30. A computer program product, characterized in that, The computer program product includes computer program code that, when run on an electronic device, causes the electronic device to perform the method as described in any one of claims 1-20.

Images