Vehicle task intelligent migration method and device, medium and product

Abstract

The invention discloses a vehicle task intelligent migration method and device, a medium and a product. The method comprises the steps of determining whether a target person has a migration demand or not according to scene data acquired in real time in a vehicle running process; if it is determined that the target person has the migration demand, interaction with the target person is carried out based on a progressive confirmation strategy, and whether the target person confirms to carry out migration operation is identified according to the interaction condition; and if the migration operation is confirmed to be carried out, executing cross-device task migration based on the migration strategy to realize intelligent migration of the vehicle task. According to the technical scheme, whether the personnel have the task migration requirement or not can be recognized in time according to the scene data, automatic migration operation is carried out based on a progressive confirmation strategy and personnel confirmation, intelligent sensing, seamless migration and self-adaptive presentation of cross-device intelligent tasks are achieved, the intelligent level of a vehicle is improved, and the user experience is improved. And the interaction experience of personnel is improved.

Description

Technical Field

[0001] This invention relates to the field of vehicle technology, and in particular to a method, apparatus, medium, and product for intelligent transfer of vehicle tasks. Background Technology

[0002] With the widespread adoption of smart devices, users typically bring multiple devices such as smartphones, tablets, and smartwatches into the car cabin. However, current in-vehicle infotainment systems suffer from issues such as task interruption and fragmentation, lack of spatial awareness, limited interaction methods, and insufficient support for multi-user scenarios.

[0003] Therefore, how to achieve intelligent perception, migration, and adaptive presentation of intelligent tasks across devices is an urgent problem to be solved. Summary of the Invention

[0004] This invention provides a method, device, medium, and product for intelligent migration of vehicle tasks, which realizes intelligent perception, seamless migration, and adaptive presentation of intelligent tasks across devices, improves the intelligence level of vehicles, and enhances the interactive experience for users.

[0005] According to one aspect of the present invention, a vehicle task intelligent transfer method is provided, comprising:

[0006] During vehicle operation, based on real-time collected scene data, it is determined whether the target personnel have a relocation need;

[0007] If it is determined that the target personnel have a migration need, then an interactive strategy is used to interact with the target personnel to identify whether the target personnel have confirmed the migration operation based on the interaction.

[0008] If the migration operation is confirmed, cross-device task migration will be performed based on the migration strategy to achieve intelligent migration of vehicle tasks.

[0009] According to another aspect of the present invention, a vehicle task intelligent migration device is provided, comprising:

[0010] The determination module is used to determine whether target personnel have a migration need during vehicle operation based on real-time collected scene data;

[0011] The identification module is used to interact with the target personnel based on a progressive confirmation strategy if it is determined that the target personnel have a migration need, so as to identify whether the target personnel confirm the migration operation based on the interaction.

[0012] The migration module is used to perform cross-device task migration based on the migration strategy if a migration operation is confirmed, thereby realizing intelligent migration of vehicle tasks.

[0013] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0014] At least one processor; and

[0015] A memory communicatively connected to the at least one processor; wherein,

[0016] The memory stores a computer program that can be executed by the at least one processor, which enables the at least one processor to perform the vehicle task intelligent migration method according to any embodiment of the present invention.

[0017] According to another aspect of the present invention, a computer-readable storage medium is provided, the computer-readable storage medium storing computer instructions for causing a processor to execute and implement the vehicle task intelligent migration method according to any embodiment of the present invention.

[0018] According to another aspect of the present invention, a computer program product is also provided, the computer program product including a computer program that, when executed by a processor, implements the vehicle task intelligent migration method of any embodiment of the present invention.

[0019] The technical solution of this invention, during vehicle operation, determines whether a target person has a migration need based on real-time collected scene data. If a migration need is determined, an interaction is initiated with the target person using a progressive confirmation strategy to determine whether they confirm the migration operation. If the migration operation is confirmed, cross-device task migration is executed based on a migration strategy, achieving intelligent migration of vehicle tasks. By timely identifying whether a person has a task migration need based on scene data and automatically performing the migration operation after confirmation with the person using a progressive confirmation strategy, intelligent perception, seamless migration, and adaptive presentation of cross-device intelligent tasks are achieved, improving the vehicle's intelligence level and enhancing the user's interactive experience.

[0020] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0021] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0022] Figure 1 This is a flowchart of a vehicle task intelligent migration method provided in an embodiment of the present invention;

[0023] Figure 2 This is a structural block diagram of a vehicle task intelligent migration device provided in an embodiment of the present invention;

[0024] Figure 3 This is a schematic diagram of the structure of the electronic device provided in an embodiment of the present invention. Detailed Implementation

[0025] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0026] It should be noted that the terms "first," "second," "target," "candidate," and "alternative," etc., used in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the invention described herein can be practiced in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus. The acquisition, storage, use, and processing of data in the technical solutions of this application comply with relevant laws and regulations.

[0027] It should be noted that the user information collected in this invention is information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, storage, use, processing, transmission, provision, disclosure, and application of this data all comply with the relevant laws, regulations, and standards of the relevant countries and regions, and necessary confidentiality measures have been taken. This process does not violate public order and good morals, and corresponding operation entry points are provided for users to choose to authorize or reject automated decision-making results. If the user chooses to reject, the process proceeds to the expert decision-making process. In other words, the relevant information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for display, data used for analysis, etc.) involved in this invention are all information and data authorized by the user or fully authorized by all parties, and the collection, use, and processing of this data comply with the relevant laws, regulations, and standards of the relevant regions.

[0028] It should be noted that in related technologies, tasks performed by users on personal devices outside the vehicle (such as navigation, music playback, video calls, etc.) cannot be automatically and seamlessly continued to the vehicle's infotainment system upon entering the vehicle. Manual re-operation is required, causing an interruption in the experience, i.e., a task interruption and fragmentation problem. Furthermore, existing solutions cannot perceive the precise three-dimensional position and orientation of devices within the cabin, as well as the user's interaction intentions, resulting in a lack of contextual intelligence in task flow between devices, i.e., a lack of spatial awareness. Further, existing solutions primarily rely on wireless networks for device interaction, lacking the recognition and understanding of natural user behaviors (such as gaze, gestures, and body posture), failing to achieve intuitive task transfer, i.e., a problem of limited interaction methods. Finally, in scenarios with multiple passengers, existing systems struggle to distinguish the devices and task requirements of different users, easily leading to task mismatch and privacy leaks, i.e., insufficient support for multi-user scenarios. To address these issues, this invention uses multi-sensor fusion to obtain scene data, constructs the spatial relationship between devices and users within the cabin, and combines this with user intent recognition to achieve intelligent perception, transfer, and adaptive presentation of tasks. Specific implementation methods will be described in detail in subsequent embodiments.

[0029] Example 1

[0030] Figure 1 This is a flowchart of a vehicle task intelligent migration method provided by an embodiment of the present invention. This embodiment is applicable to situations where, based on scene data, it promptly identifies whether personnel have task migration needs, and performs automated migration operations after confirming with personnel based on a progressive confirmation strategy. This method can be executed by a vehicle task intelligent migration device, which can be implemented in hardware and / or software. This vehicle task intelligent migration device can be configured in an electronic device, such as in a vehicle. Figure 1 As shown, the intelligent transfer method for vehicle tasks includes:

[0031] S101. During vehicle operation, determine whether the target personnel have a relocation need based on the scene data collected in real time.

[0032] Scene data refers to data that characterizes the scene information of people and intelligent devices in the vehicle. Scene data includes at least one of the following: spatial location information determined based on ultra-wideband anchor points, the location information of candidate occupants in the vehicle, and image information captured by the target camera. Target occupants refer to the personnel for whom migration needs are identified; they can be the driver, front-seat passenger, or rear-seat passenger in the vehicle. Migration needs include at least one of the following: migrating a personal terminal's navigation task to the vehicle terminal, migrating a vehicle terminal's call task to a personal terminal, and migrating a personal terminal's conferencing task to another terminal. Other terminals are the personal terminals or vehicle terminals belonging to other personnel in the vehicle. Other personnel can be candidate occupants other than the target occupants.

[0033] Optionally, during vehicle operation, based on real-time collected scene data, it is determined whether the target personnel have a migration need, including: during vehicle operation, scene data is collected in real time through at least one of preset ultra-wideband anchor points, millimeter-wave radar, and target cameras; the scene data is analyzed to determine at least one of the target personnel's identity information, intent information, voice information, and location information of the target device to which the target personnel belong, in order to identify whether the target personnel have a migration need.

[0034] The preset Ultra Wide Band (UWB) anchor points refer to UWB tags pre-configured in preset locations inside the vehicle cabin and / or on the target personnel's mobile terminals. All smart devices (mobile phones, tablets, etc.) have built-in or external UWB tags.

[0035] For example, by measuring each preset ultra-wideband anchor point, the signal arrival time difference is determined, achieving a three-dimensional spatial positioning accuracy of ±10cm. Through multi-antenna phase difference calculation, the orientation of the device is identified. Furthermore, the position and motion vector of each candidate device in the vehicle can be updated in real time to achieve motion trajectory tracking.

[0036] Specifically, the target cameras can be wide-angle camera arrays pre-positioned in locations such as the rearview mirror, A-pillar, and roof of the vehicle. Through visual analysis of the image sequences captured by the target cameras, it is possible to perform user facial orientation and gaze tracking, gesture recognition, and device physical status recognition. Specifically, deep learning models can be used to determine the user's gaze point, recognize interactive gestures such as pointing, grasping, and swiping, and identify whether the device is being held, placed, or charging.

[0037] Millimeter-wave radar, specifically a 60GHz millimeter-wave radar mounted on the top of the cockpit, can penetrate non-metallic materials to achieve occupant positioning with privacy protection (not relying on visual images, thus protecting privacy) and micro-motion detection (detecting breathing and subtle movements to determine user activity). Millimeter-wave radar can also operate in all weather conditions without being affected by lighting conditions.

[0038] Optionally, after acquiring data based on at least one of the preset ultra-wideband anchor points, millimeter-wave radar, and target camera, scene data can be obtained by fusion processing based on an extended Kalman filter.

[0039] Optionally, during vehicle operation, scene data is collected in real time using preset ultra-wideband anchor points, millimeter-wave radar, and target cameras. This includes: constructing a positioning network based on ultra-wideband anchor points pre-configured in the vehicle cabin, and determining the device location information of candidate devices based on the positioning network and ultra-wideband anchor points pre-configured in candidate devices included in the vehicle; determining the personnel location information of candidate personnel in the vehicle by identifying and processing the point cloud collected by millimeter-wave radar, and acquiring image information through the target camera, so as to determine the real-time scene data collected based on the device location information, personnel location information, and image information.

[0040] Among them, candidate devices are all intelligent devices detected in the vehicle, such as vehicle terminals, personal terminals belonging to target personnel with different identities, etc.

[0041] For example, 4-6 UWB anchor points (such as the front left UWB anchor point, the front right UWB anchor point, the rear left UWB anchor point, and the rear right UWB anchor point) can be arranged in the cockpit to form a positioning network, and the device location information of the candidate devices can be determined according to the UWB tags pre-configured in each candidate device.

[0042] It should be noted that by fusing multimodal sensors, a spatial relationship model between intelligent devices and people in the vehicle cabin can be constructed, generating accurate scene data to facilitate timely identification of migration needs.

[0043] Optionally, the scene data is analyzed to determine the target person's identity information, intent information, and the location information of the target device to which the target person belongs. This includes: determining the target person's identity information based on the person's location information in the scene data; associating the device and the person based on the device and person's location information in the scene data to determine the location information of the target device to which the target person belongs; and performing intent analysis on the target person based on the image information in the scene data to determine the target person's intent information. The identity information includes whether the person is a driver, front passenger, or rear passenger.

[0044] Optionally, based on the device location information and personnel location information in the scene data, devices and personnel with location deviations less than a preset threshold can be identified as associated candidate devices and candidate personnel, so as to determine the relationship between each candidate device (such as a personal terminal) and each candidate personnel. The location of the vehicle terminal can be a pre-set fixed location, that is, to determine the location information of the candidate personnel and candidate devices.

[0045] For example, a target person can be identified by facial recognition or voiceprint recognition, and the ownership of the device can be confirmed by digital certificate or pairing history to prove the ownership of the device. At the same time, the historical interaction pattern can be used to assist in the judgment to determine the target device to which the target person belongs.

[0046] Optionally, each candidate can be identified as a target person, and their migration needs can be analyzed. Candidates with migration needs can be identified as target persons. Alternatively, a candidate can be identified as a target person in response to instructions issued by a candidate in the vehicle via voice, gesture, or other means. After identifying the target person, the location information of the target device to which the target person belongs can be determined based on the location information of the target person and the association between the candidate and the candidate device.

[0047] Optionally, based on the image information in the scene data, the intent of the target personnel is analyzed to determine the intent information of the target personnel, including: determining the image information of the target personnel within a preset monitoring period based on the scene data, analyzing the visual information of the target personnel; determining the migration intent and migration intent level of the target personnel to obtain intent information.

[0048] The visual information includes at least one of the following: the duration of the target person's gaze at the target fixation point, the target device corresponding to the interactive gesture, the target device's motion acceleration, the target device's historical habit patterns, and scene context information. The migration intent level is categorized as auxiliary migration intent, basic migration intent, moderate migration intent, or strong migration intent. The task context can be during a call or navigation, etc. Different weights can be configured for different migration intent levels; for example, auxiliary migration intent, basic migration intent, moderate migration intent, and strong migration intent can be set to weights of 0.1, 0.2, 0.3, and 0.4, respectively.

[0049] For example, if the task context is determined to be that the target person is navigating on a personal terminal, then if the target person's gaze lingers at the target gaze point for a longer than a preset duration (e.g., two seconds) and the interaction gesture is pointing towards the migration device, then the migration intention level can be determined to be a strong migration intention. If the task context is determined to be that the target person is navigating on a personal terminal, and the target device's location information determines that the target person picks up the personal terminal (i.e., the target device), and the image information determines that the target person is looking at the central control screen (i.e., the vehicle terminal), then the target person's migration intention can be determined to be a medium migration intention. If the task context is determined to be that the target person is navigating on a personal terminal, and the target person has pre-configured a historical habit mode, then the target person's migration intention can be determined to be a basic migration intention if the task context is determined to be that the target person is navigating on a personal terminal.

[0050] Optionally, identifying whether the target person has a migration need includes: based on the target person's identity information and intent information, if the identity information is determined to be a driver, the migration intent in the intent information is the intent to migrate the navigation task to the vehicle terminal, and the migration intent level in the intent information is a strong migration intent, then it is determined that the target person has a migration need to migrate the personal terminal navigation task to the vehicle terminal.

[0051] For example, in a scenario where a target person enters a vehicle after setting up navigation on their mobile phone, the location of the target person's mobile phone can be identified through ultra-wideband anchor points when the target person enters the vehicle with their mobile phone. Furthermore, visual analysis can be performed based on the image information collected by the target camera to determine that the target person is the driver and has looked down at the vehicle's central control screen multiple times, i.e., the vehicle terminal. In summary, it can be preliminarily identified that the target person has a migration need for navigation task migration.

[0052] For example, in a scenario where a rear passenger is having a video conference and wants to share it with the front passenger for discussion, the task context can detect that the rear passenger's tablet is currently engaged in a video conference. If the rear passenger then emits a voice message indicating a specific migration intention, such as "share it with the front passenger," the rear passenger can be considered the target person, the tablet belonging to the rear passenger the target device, and the intention information is to migrate the personal terminal's conference task to another terminal. This confirms a migration requirement to move the rear passenger's video conference task to the front vehicle terminal. Furthermore, the level of intent can be analyzed by considering the target person's gaze.

[0053] For example, in a scenario where a person is making a voice call in the car and preparing to get out, the system can analyze the location of the person's mobile phone (i.e., the target device) using ultra-wideband anchors when the vehicle stops and the door unlocks. This analysis can determine whether the target device has been picked up from the onboard charger. If so, it can be determined that there is a need to migrate the voice call task from the car infotainment system to the driver's personal terminal.

[0054] S102. If it is determined that the target personnel have a migration need, then interact with the target personnel based on a progressive confirmation strategy, and identify whether the target personnel confirm the migration operation based on the interaction.

[0055] The progressive confirmation strategy refers to a strategy that uses different levels of reminders and confirmations to guide target personnel to confirm their migration needs.

[0056] It should be noted that the solution of the present invention only collects the necessary information for task migration during the migration operation. Sensitive data is only processed locally on the device. At the same time, different permissions can be set for different types of tasks, such as public tasks, personal tasks and privacy tasks. For example, public tasks can be seen by all passengers, personal tasks can be seen only by the device owner, and privacy tasks require additional authentication before migration can be performed. This ensures the security of privacy data while performing migration tasks and improves the user experience.

[0057] Optionally, an interactive mechanism based on a progressive confirmation strategy is used to identify whether the target personnel have confirmed the migration operation based on the interaction. This includes: prompting the target personnel for migration confirmation using a preset first-level prompt strategy; if no confirmation is detected, prompting the target personnel for migration confirmation using a preset second-level prompt strategy; if no confirmation is detected, a timer is started, and if the target personnel do not confirm within a preset time after the timer starts, it is determined that the migration operation will not be performed; if a confirmation is detected, the migration operation is confirmed to proceed.

[0058] The preset Level 1 prompt strategy is a mild prompt strategy, which may involve a slight light emission or vibration at the edge of the target device. The preset Level 2 prompt strategy is a stronger prompt strategy, which may prompt the target person to give a confirmation command through eye tracking or a confirmation gesture. The preset duration is 5 seconds.

[0059] It should be noted that by using a gradual confirmation strategy to interact with the target personnel and then performing the migration operation only after the target personnel have confirmed the transaction, accidental triggering can be avoided and the interactive experience of the target personnel can be improved.

[0060] S103. If the migration operation is confirmed, then based on the migration strategy, cross-device task migration is performed to achieve intelligent migration of vehicle tasks.

[0061] The migration strategy refers to the strategy for migrating specific tasks from the target device to the migration device and how they are presented. Specifically, it is a task presentation strategy that can be adaptively adjusted based on the capabilities of the migration device. The migration device is the device that continues to execute the task after the task is migrated, while the target device can be the device that executed the task before the migration.

[0062] Optionally, if the migration strategy is to migrate the navigation tasks of the target personnel and target devices to the vehicle terminal and display them on a visual screen, then relevant information about the navigation tasks in the target devices can be obtained based on a pre-configured communication protocol and displayed on the vehicle terminal to perform cross-device task migration and realize intelligent migration of vehicle tasks.

[0063] For example, in a navigation task migration scenario—that is, when the migration requirement is to transfer a navigation task from a personal terminal to a vehicle terminal—a primary prompt can be made by displaying soft light effects at the edges of the phone and central control screen. If the target user does not perform the operation within a preset time period, a secondary prompt can be made through voice prompts, reminding the target user to confirm the migration by nodding or gesturing. The migration operation is then executed after the target user's confirmation is detected. Specifically, the migration operation may include: synchronizing the navigation status (destination, route, etc.) of the target device to the vehicle terminal; launching the navigation application on the vehicle terminal and displaying an optimized in-vehicle interface; automatically switching the navigation on the target device to a simplified display; and finally, automatically playing the navigation voice through the in-vehicle audio system after the vehicle starts.

[0064] For example, in a meeting sharing scenario, where the migration requirement is to transfer a personal terminal meeting task to another terminal, the scope of sharing can be further inquired of the target personnel, such as "only the video screen is shared, or does it include the meeting audio?" If the target personnel confirm "video only" in their voice, the migration operation can be performed. The specific operation process can be as follows: the tablet meeting video stream is encrypted and transmitted to the screen in front, while the audio remains in the tablet's headset to protect meeting privacy. Finally, the screen in front displays "Viewing the shared meeting," while allowing passengers in the back row to maintain control of the meeting during the sharing process.

[0065] For example, in a scenario where the disembarkation task is continuous, that is, when the migration requirement is to transfer the call task from the vehicle terminal to the personal terminal, if the migration requirement is confirmed, the target person can be reminded by voice that "the call is being transferred to your mobile phone, and you can continue after getting off the vehicle". Further, when the target person is detected to open the car door, the migration operation is performed. Specifically, the call audio can be seamlessly switched to the mobile phone earpiece, "the call has been transferred" can be displayed on the vehicle terminal, and finally the call interface can be displayed on the target device to maintain the call connection, so that the target person can continue the call on the target device after getting off the vehicle.

[0066] It should be noted that this invention constructs a spatial relationship model between in-cabin devices and users through multimodal sensor fusion, and combines it with user intent recognition algorithms to achieve intelligent perception, migration and adaptive presentation of tasks, realize task continuity between different intelligent devices in the cabin, and provide users with a truly intelligent and seamless in-vehicle connectivity experience.

[0067] The technical solution of this invention, during vehicle operation, determines whether a target person has a migration need based on real-time collected scene data. If a migration need is determined, an interaction is initiated with the target person using a progressive confirmation strategy to determine whether they confirm the migration operation. If the migration operation is confirmed, cross-device task migration is executed based on a migration strategy, achieving intelligent migration of vehicle tasks. By timely identifying whether a person has a task migration need based on scene data and automatically performing the migration operation after confirmation with the person using a progressive confirmation strategy, intelligent perception, seamless migration, and adaptive presentation of cross-device intelligent tasks are achieved, improving the vehicle's intelligence level and enhancing the user's interactive experience.

[0068] Example 2

[0069] Figure 2 This is a structural block diagram of a vehicle task intelligent migration device provided in an embodiment of the present invention. This embodiment is applicable to situations where personnel are identified in a timely manner based on scene data to determine if they have a task migration need, and an automated migration operation is performed after confirmation with the personnel based on a progressive confirmation strategy. The vehicle task intelligent migration device provided by the present invention can execute the vehicle task intelligent migration method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method. The vehicle task intelligent migration device can be implemented in hardware and / or software and configured in an electronic device with vehicle task intelligent migration function, such as... Figure 2 As shown, the vehicle task intelligent migration device may specifically include:

[0070] The determination module 201 is used to determine whether the target personnel have a migration need based on the scene data collected in real time during vehicle operation.

[0071] The identification module 202 is used to interact with the target personnel based on a progressive confirmation strategy if it is determined that the target personnel have a migration need, so as to identify whether the target personnel confirm the migration operation based on the interaction.

[0072] The migration module 203 is used to perform cross-device task migration based on the migration strategy if the migration operation is confirmed, so as to realize intelligent migration of vehicle tasks.

[0073] The technical solution of this invention, during vehicle operation, determines whether a target person has a migration need based on real-time collected scene data. If a migration need is determined, an interaction is initiated with the target person using a progressive confirmation strategy to determine whether they confirm the migration operation. If the migration operation is confirmed, cross-device task migration is executed based on a migration strategy, achieving intelligent migration of vehicle tasks. By timely identifying whether a person has a task migration need based on scene data and automatically performing the migration operation after confirmation with the person using a progressive confirmation strategy, intelligent perception, seamless migration, and adaptive presentation of cross-device intelligent tasks are achieved, improving the vehicle's intelligence level and enhancing the user's interactive experience.

[0074] Furthermore, module 201 is specifically used for:

[0075] The scene data collected in real time is used to determine whether the target personnel have a migration need, including:

[0076] During vehicle operation, scene data is collected in real time by using at least one of the following: a preset ultra-wideband anchor point, millimeter-wave radar, and a target camera.

[0077] By analyzing the scene data, at least one of the target person's identity information, intent information, voice information, and location information of the target device to which the target person belongs can be determined to identify whether the target person has a migration need.

[0078] Furthermore, the determining module 201 is also used for:

[0079] During vehicle operation, a positioning network is constructed based on ultra-wideband anchor points pre-configured in the vehicle cabin, and the device location information of the candidate devices is determined based on the positioning network and the ultra-wideband anchor points pre-configured in the candidate devices contained in the vehicle.

[0080] By identifying and processing the point cloud data collected by millimeter-wave radar, the location information of the candidates in the vehicle is determined, and image information is collected by the target camera. Based on the device location information, personnel location information, and image information, the real-time scene data is determined.

[0081] Furthermore, the determining module 201 is also used for:

[0082] Based on the location information of the people in the scene data, the identity information of the target person is determined; the identity information is that of the driver, the front passenger, or the rear passenger.

[0083] Based on the device location information and personnel location information in the scene data, the devices and personnel are associated to determine the location information of the target device to which the target personnel belong;

[0084] Based on the image information in the scene data, the intent of the target person is analyzed to determine the target person's intent information.

[0085] Furthermore, the determining module 201 is also used for:

[0086] Based on scene data, image information of target personnel within a preset monitoring period is determined, and visual information of target personnel is obtained through analysis. The visual information includes at least one of the following: the dwell time of the target personnel's gaze at the target gaze point, the target device corresponding to the interactive gesture, the motion acceleration of the target device, the historical habit patterns of the target device, and scene context information.

[0087] Determine the migration intention and migration intention level of the target personnel to obtain intention information; the migration intention level is auxiliary migration intention, basic migration intention, medium migration intention, or strong migration intention.

[0088] Furthermore, the migration requirements include at least one of the following: migrating personal terminal navigation tasks to vehicle terminals, migrating vehicle terminal call tasks to personal terminals, and migrating personal terminal conferencing tasks to other terminals;

[0089] The determination module 201 is also used for:

[0090] Based on the target person's identity information and intent information, if the identity information is determined to be a driver, the intent information indicates a migration intention to migrate the navigation task to the vehicle terminal, and the intent information indicates a strong migration intention level, then it is determined that the target person has a migration need to migrate the navigation task from their personal terminal to the vehicle terminal.

[0091] Furthermore, the identification module 202 is specifically used for:

[0092] Based on the progressive confirmation strategy, a first-level prompt strategy is used to prompt the target personnel to confirm the migration. If no confirmation operation is detected from the target personnel, a second-level prompt strategy is used to prompt the target personnel to confirm the migration.

[0093] If no confirmation action is detected from the target personnel, a timer will be started. If the target personnel do not perform a confirmation action within the preset time after the timer starts, the migration operation will not be performed.

[0094] If a confirmation action is detected from the target person, then the migration operation is confirmed.

[0095] Example 3

[0096] Figure 3 This is a schematic diagram of the structure of the electronic device provided in an embodiment of the present invention. Figure 3A schematic diagram of an electronic device 10, which can be used to implement embodiments of the present invention, is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0097] like Figure 3 As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory 12 or a random access memory 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer program stored in the read-only memory 12 or loaded from storage unit 18 into the random access memory 13. The random access memory 13 may also store various programs and data required for the operation of the electronic device 10. The processor 11, read-only memory 12, and random access memory 13 are interconnected via a bus 14. An input / output interface 15 is also connected to the bus 14.

[0098] Multiple components in electronic device 10 are connected to input / output 15, including: input unit 16, such as a keyboard, mouse, etc.; output unit 17, such as various types of displays, speakers, etc.; storage unit 18, such as a disk, optical disk, etc.; and communication unit 19, such as a network card, modem, wireless transceiver, etc. Communication unit 19 allows electronic device 10 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0099] Processor 11 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, central processing units, graphics processing units, various special-purpose artificial intelligence computing chips, various processors running machine learning model algorithms, digital signal processors, and any suitable processor, controller, microcontroller, etc. Processor 11 performs the various methods and processes described above, such as intelligent migration methods for vehicle tasks.

[0100] In some embodiments, the vehicle task intelligent migration method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on electronic device 10 via read-only memory 12 and / or communication unit 19. When the computer program is loaded into random access memory 13 and executed by processor 11, one or more steps of the vehicle task intelligent migration method described above may be performed. Alternatively, in other embodiments, processor 11 may be configured to perform the vehicle task intelligent migration method by any other suitable means (e.g., by means of firmware).

[0101] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays, application-specific integrated circuits (ASICs), application-specific standard products (ASICs), system-on-a-chip (SoCs), complex programmable logic devices (PLCs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0102] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0103] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory, read-only memory, erasable programmable read-only memory, optical fibers, portable compact disk read-only memory, optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0104] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a cathode ray tube or liquid crystal display) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (e.g., voice input, speech input, or tactile input).

[0105] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0106] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a host product within the cloud computing service system to address the shortcomings of traditional physical hosts and virtual reality services, such as high management difficulty and weak business scalability.

[0107] In one embodiment, the present invention further includes a computer program product, which includes a computer program that, when executed by a processor, implements the vehicle task intelligent migration method of any embodiment of the present invention.

[0108] In the implementation of a computer program product, computer program code for performing the operations of this invention can be written in one or more programming languages ​​or a combination thereof. Programming languages ​​include object-oriented programming languages ​​as well as conventional procedural programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including local area networks (LANs) or wide area networks (WANs), or it can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0109] It should be understood that the various processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein. The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A method for intelligent transfer of vehicle tasks, characterized in that, include: During vehicle operation, based on real-time collected scene data, it is determined whether the target personnel have a relocation need; If it is determined that the target personnel have a migration need, then an interactive strategy is used to interact with the target personnel to identify whether the target personnel have confirmed the migration operation based on the interaction. If the migration operation is confirmed, cross-device task migration will be performed based on the migration strategy to achieve intelligent migration of vehicle tasks.

2. The method according to claim 1, characterized in that, During vehicle operation, based on real-time collected scene data, it is determined whether the target personnel have a relocation need, including: During vehicle operation, scene data is collected in real time by using at least one of the following: a preset ultra-wideband anchor point, millimeter-wave radar, and a target camera. By analyzing the scene data, at least one of the target person's identity information, intent information, voice information, and location information of the target device to which the target person belongs can be determined to identify whether the target person has a migration need.

3. The method according to claim 2, characterized in that, During vehicle operation, scene data is collected in real time using preset ultra-wideband anchor points, millimeter-wave radar, and target cameras, including: During vehicle operation, a positioning network is constructed based on ultra-wideband anchor points pre-configured in the vehicle cabin, and the device location information of the candidate devices is determined based on the positioning network and the ultra-wideband anchor points pre-configured in the candidate devices contained in the vehicle. By identifying and processing the point cloud data collected by millimeter-wave radar, the location information of the candidates in the vehicle is determined, and image information is collected by the target camera. Based on the device location information, personnel location information, and image information, the real-time scene data is determined.

4. The method according to claim 2, characterized in that, Analyze the scene data to determine the target person's identity information, intent information, and the location information of the target device to which the target person belongs, including: Based on the location information of the people in the scene data, the identity information of the target person is determined; the identity information is that of the driver, the front passenger, or the rear passenger. Based on the device location information and personnel location information in the scene data, the devices and personnel are associated to determine the location information of the target device to which the target personnel belong; Based on the image information in the scene data, the intent of the target person is analyzed to determine the target person's intent information.

5. The method according to claim 4, characterized in that, Based on image information in the scene data, intent analysis is performed on the target personnel to determine their intent information, including: Based on scene data, image information of target personnel within a preset monitoring period is determined, and visual information of target personnel is obtained through analysis. The visual information includes at least one of the following: the dwell time of the target personnel's gaze at the target gaze point, the target device corresponding to the interactive gesture, the motion acceleration of the target device, the historical habit patterns of the target device, and scene context information. Determine the migration intention and migration intention level of the target personnel to obtain intention information; the migration intention level is auxiliary migration intention, basic migration intention, medium migration intention, or strong migration intention.

6. The method according to claim 2, characterized in that, in, Migration requirements include at least one of the following: migrating personal terminal navigation tasks to vehicle terminals, migrating vehicle terminal call tasks to personal terminals, and migrating personal terminal conferencing tasks to other terminals; Accordingly, identifying whether target personnel have migration needs includes: Based on the target person's identity information and intent information, if the identity information is determined to be a driver, the intent information indicates a migration intention to migrate the navigation task to the vehicle terminal, and the intent information indicates a strong migration intention level, then it is determined that the target person has a migration need to migrate the navigation task from their personal terminal to the vehicle terminal.

7. The method according to claim 1, characterized in that, A progressive confirmation strategy is used to interact with target personnel, and the interaction status is used to identify whether the target personnel have confirmed the migration operation, including: Based on the progressive confirmation strategy, a first-level prompt strategy is used to prompt the target personnel to confirm the migration. If no confirmation operation is detected from the target personnel, a second-level prompt strategy is used to prompt the target personnel to confirm the migration. If no confirmation action is detected from the target personnel, a timer will be started. If the target personnel do not perform a confirmation action within the preset time after the timer starts, the migration operation will not be performed. If a confirmation action is detected from the target person, then the migration operation is confirmed.

8. A vehicle task intelligent transfer device, characterized in that, include: The determination module is used to determine whether target personnel have a migration need during vehicle operation based on real-time collected scene data; The identification module is used to interact with the target personnel based on a progressive confirmation strategy if it is determined that the target personnel have a migration need, so as to identify whether the target personnel confirm the migration operation based on the interaction. The migration module is used to perform cross-device task migration based on the migration strategy if a migration operation is confirmed, thereby realizing intelligent migration of vehicle tasks.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that, when executed by a processor, implement the vehicle task intelligent migration method according to any one of claims 1-7.

10. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the vehicle task intelligent migration method as described in any one of claims 1-7.

Images