Vehicle-machine interaction method and device, electronic equipment and storage medium

Abstract

The invention provides a vehicle-machine interaction method and device, electronic equipment and a storage medium. The method is applied to a vehicle machine system of a vehicle, and comprises the following steps: acquiring data of a real pet, and generating a virtual pet based on the data of the real pet; wherein the data of the real pet comprises image data or video data of the real pet; acquiring behavior state information of a real pet; and controlling the virtual pet to execute the action or expression corresponding to the behavior state information. In the mode, real-time two-way linkage between the vehicle machine virtual pet assistant and a family real pet can be realized, the authenticity and emotional effect of virtual pet accompanying are improved, meanwhile, an interaction path between the vehicle machine and the pet IoT equipment is opened, and the consistency and immersion of cross-scene experience are improved.

Description

Technical Field

[0001] This invention relates to the field of smart cockpit technology, and in particular to a vehicle-machine interaction method, device, electronic device, and storage medium. Background Technology

[0002] In recent years, smart cockpits and smart homes have been rapidly merging, with in-car virtual assistants / avatars gradually gaining the ability to understand scenarios, interact with personalization, and control vehicles; while in the home, pet cameras, smart feeders, pet teasers, and other remotely controllable pet IoT (Internet of Things) devices have emerged.

[0003] However, the two-way systems are mostly fragmented, lacking a closed-loop solution that allows for real-time bidirectional mapping between the "real pet's state / behavior" and the "in-car display." In terms of 3D content generation, generative AI (Artificial Intelligence), 3D reconstruction (such as Neural Radiance Fields, NeRF), and personalized subject generation (such as DreamBooth, a personalized text-to-image generation technology) have become mature underlying capabilities, providing the technological foundation for "rapidly generating exclusive 3D images from a small number of user-owned photos."

[0004] Currently, existing in-car virtual pets mainly have the following drawbacks: 1. Without incorporating real-life pet behavior / demand data streams, it is impossible to drive the virtual pet in the car to perform "real-time behavior mirroring" or "status prompts"; 2. The two-way linkage mechanism between the car infotainment system and home pet IoT devices (feeders, pet toys, cameras) is not provided (e.g., clicking / voice in the car → feeding / playing device action on the home device; the home device detects water shortage / litter needs cleaning → virtual pet behavior and alarm on the car infotainment system). 3. Without using personalized generation and 3D reconstruction, the user's own pet is realistically transformed into a 3D assistant image and presented consistently with multiple terminals in the cockpit (central control screen / passenger screen / remote screen / head-up display system HUD / augmented reality AR glasses). Summary of the Invention

[0005] In view of this, the purpose of the present invention is to provide a vehicle-machine interaction method, device, electronic device and storage medium for performing user-real pet modeling, virtual pet assistant generation and vehicle-home linkage interaction.

[0006] In a first aspect, embodiments of the present invention provide a vehicle-to-everything (V2X) interaction method applied to a vehicle's V2X system. The method includes: acquiring data of a real pet; generating a virtual pet based on the data of the real pet; wherein the data of the real pet includes: image data or video data of the real pet; acquiring behavioral state information of the real pet; and controlling the virtual pet to perform actions or expressions corresponding to the behavioral state information.

[0007] In optional embodiments of this application, the steps of obtaining real pet data and generating virtual pets based on the real pet data include: obtaining real pet data uploaded by users through terminal devices or physical media; wherein the terminal devices include: mobile phones and computers; or, obtaining real pet data collected by IoT devices; wherein the IoT devices include: cameras, feeders, and sensors.

[0008] In an optional embodiment of this application, the step of generating a virtual pet based on real pet data includes: generating a three-dimensional image of a virtual pet based on real pet data through three-dimensional modeling and generative artificial intelligence.

[0009] In an optional embodiment of this application, the step of obtaining the behavioral status information of a real pet includes: collecting the status information of the real pet's movement, eating, drinking and resting through an Internet of Things device as behavioral status information.

[0010] In an optional embodiment of this application, the step of controlling the virtual pet to perform actions or expressions corresponding to the behavioral state information includes: determining the pet's needs based on the behavioral state information; wherein, the pet's needs include: hunger, thirst, or loneliness; generating actions or expressions corresponding to the behavioral state information based on the pet's needs; controlling the virtual pet to perform actions or expressions corresponding to the behavioral state information, and informing the user of the pet's needs through voice or prompts.

[0011] In optional embodiments of this application, the method further includes: displaying a virtual pet on the screen of the vehicle system or on a device connected to the vehicle system; wherein the device connected to the vehicle system includes: augmented reality glasses; acquiring user interaction commands; wherein the interaction commands include: voice commands, touch commands, or gesture commands; controlling the virtual pet to perform actions or expressions corresponding to the interaction commands; and exchanging control signals corresponding to the commands with IoT devices to cause the IoT devices to perform actions corresponding to the control signals.

[0012] In an optional embodiment of this application, the above method further includes: sending the behavior status information of the real pet to an external terminal device so that the terminal device displays the behavior status information of the real pet.

[0013] Secondly, embodiments of the present invention also provide a vehicle-machine interaction device applied to a vehicle's in-vehicle system. The device includes: a virtual pet generation module for acquiring data of a real pet and generating a virtual pet based on the data of the real pet; wherein, the data of the real pet includes: image data or video data of the real pet; a real pet status acquisition module for acquiring behavioral status information of the real pet; and a virtual pet action mapping module for controlling the virtual pet to perform actions or expressions corresponding to the behavioral status information.

[0014] Thirdly, embodiments of the present invention also provide an electronic device, including a processor and a memory, wherein the memory stores computer-executable instructions that can be executed by the processor, and the processor executes the computer-executable instructions to implement the above-described vehicle-machine interaction method.

[0015] Fourthly, embodiments of the present invention also provide a computer-readable storage medium storing computer-executable instructions. When the computer-executable instructions are invoked and executed by a processor, the computer-executable instructions cause the processor to implement the above-described vehicle-machine interaction method.

[0016] The embodiments of the present invention bring the following beneficial effects: This invention provides a vehicle-mounted infotainment system (V2S) interaction method, device, electronic device, and storage medium. The method involves acquiring data from a real pet and generating a virtual pet based on that data. The real pet data includes image or video data of the real pet. It also involves acquiring behavioral state information of the real pet and controlling the virtual pet to perform actions or expressions corresponding to that behavioral state information. This approach enables real-time two-way interaction between the V2S virtual pet assistant and a real pet, enhancing the realism and emotional connection of the virtual pet's companionship. Furthermore, it establishes an interaction pathway between the V2S system and pet IoT devices, improving the consistency and immersion of the cross-scenario experience.

[0017] Other features and advantages of this disclosure will be set forth in the following description, or some features and advantages may be inferred from the description or determined without doubt, or may be learned by practicing the techniques described above.

[0018] To make the above-mentioned objects, features and advantages of this disclosure more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings. Attached Figure Description

[0019] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0020] Figure 1 A flowchart of a vehicle-machine interaction method provided in an embodiment of the present invention; Figure 2 A flowchart of another vehicle-machine interaction method provided in an embodiment of the present invention; Figure 3 A logical schematic diagram of a vehicle-machine interaction method provided in an embodiment of the present invention; Figure 4 This is a schematic diagram of the structure of a vehicle-machine interaction device provided in an embodiment of the present invention; Figure 5 This is a schematic diagram of another vehicle-machine interaction device provided in an embodiment of the present invention; Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. Detailed Implementation

[0021] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0022] Currently, while existing technologies have made progress in areas such as "in-vehicle virtual pets," "home pet monitoring and interaction devices," and "3D modeling and personalized generation," they still suffer from the following shortcomings: data between in-vehicle virtual pets and real pets is fragmented; home pet IoT systems are not integrated with in-vehicle systems; cross-terminal experiences are inconsistent, and scenarios are disconnected; virtual pets lack personalization; and pet needs lack emotional expression.

[0023] In summary, these shortcomings limit users from obtaining a genuine, continuous, and personalized pet companionship experience in the smart cockpit.

[0024] Based on this, the present invention provides a vehicle-machine interaction method, device, electronic device, and storage medium, specifically providing a vehicle-machine assistant system and method for a virtual pet based on multimodal interaction and home IoT linkage. It can be applied to the fields of smart cockpit and smart home IoT. Through vehicle-machine virtual pet assistant + home IoT pet device interoperability + 3D personalized modeling + emotion-driven mapping, it can realize two-way real-time linkage between vehicle-machine virtual pet and real pet at home, connect vehicle-machine and pet IoT devices, support consistent personalized virtual pet interaction across multiple terminals, and enhance the companionship experience through emotional expression.

[0025] To facilitate understanding of this embodiment, a vehicle-machine interaction method disclosed in this embodiment of the invention will first be described in detail.

[0026] Example 1: This invention provides a vehicle-to-vehicle (V2V) interaction method applied to a vehicle's infotainment system. This method enables V2V interaction based on a virtual pet assistant and a home pet IoT device. (See also...) Figure 1 The flowchart shown illustrates a vehicle-to-machine (V2M) interaction method, which includes the following steps: Step S102: Obtain data of the real pet and generate a virtual pet based on the data of the real pet.

[0027] The data for real pets includes: image data or video data of real pets.

[0028] In this embodiment, a virtual pet can be generated, for example, by acquiring image data or video data of a real pet and generating a virtual pet based on the image data or video data of the real pet.

[0029] In some embodiments, data on real pets uploaded by users through terminal devices or physical media can be acquired; wherein the terminal devices include: mobile phones and computers; or, data on real pets collected by Internet of Things (IoT) devices can be acquired; wherein the IoT devices include: cameras, feeders, and sensors.

[0030] In this embodiment, the data of the real pet can be data uploaded by the user through terminal devices such as mobile phones and computers or physical media such as USB flash drives, or data collected through pet IoT devices such as cameras, feeders and sensors.

[0031] In some embodiments, a 3D image of a virtual pet can be generated based on data from a real pet through 3D modeling and generative artificial intelligence.

[0032] In this embodiment, a 3D image of a virtual pet that is highly similar to the user's real pet can be generated through 3D modeling and generative AI algorithms.

[0033] 3D modeling is the process of creating a 3D digital model of a real object (in this example, a real pet). Generative AI algorithms are a branch of artificial intelligence that focus on creating new content, such as text, images, 3D models, and even music, by learning patterns in data. Its core lies in understanding the joint probability distribution of data, rather than simply classifying or predicting.

[0034] Step S104: Obtain the actual behavior status information of the pet.

[0035] In this embodiment, the behavioral status information of the real pet can also be obtained through IoT devices.

[0036] In some embodiments, behavioral status information can be obtained from the movement, eating, drinking, and resting status information of a real pet collected by an IoT device.

[0037] In this embodiment, IoT devices such as home monitoring cameras, smart feeders, and sensors can be used to collect real-world pet behavior information (including information on movement, eating, drinking, and resting).

[0038] In this embodiment, the IoT device can upload the collected behavioral status information to the vehicle's in-vehicle infotainment system.

[0039] Step S106: Control the virtual pet to perform actions or expressions corresponding to the behavior status information.

[0040] In this embodiment, virtual pet action mapping can be performed. After obtaining the behavior status information, the vehicle system can control the virtual pet to perform actions or expressions corresponding to the behavior status information.

[0041] In some embodiments, pet needs can be determined based on behavioral state information; wherein, pet needs include: hunger, thirst, or loneliness; actions or expressions corresponding to the behavioral state information are generated based on the pet needs; the virtual pet is controlled to perform the actions or expressions corresponding to the behavioral state information, and the user is informed of the pet's needs through voice or prompts.

[0042] In this embodiment, after acquiring behavioral status information, the vehicle-mounted system can first determine the pet's needs corresponding to the behavioral status information, and then drive the virtual pet of the vehicle-mounted system to perform corresponding actions and expressions based on the pet's needs such as hunger, thirst, or loneliness. Furthermore, after determining the pet's needs, the vehicle-mounted system can also inform the user of the pet's needs through voice or prompts.

[0043] This invention provides a vehicle-mounted infotainment system (V2S) interaction method. The method acquires data from a real pet and generates a virtual pet based on that data. The real pet data includes image or video data of the real pet. It also acquires behavioral state information of the real pet and controls the virtual pet to perform actions or expressions corresponding to that information. This approach enables real-time two-way interaction between the V2S virtual pet assistant and a real pet, enhancing the realism and emotional connection of the virtual pet. Furthermore, it establishes an interaction pathway between the V2S system and pet IoT devices, improving the consistency and immersion of the cross-scenario experience.

[0044] Example 2: This embodiment provides another vehicle-to-machine (V2M) interaction method, which is implemented based on the above embodiment. The focus is on describing the specific methods of V2M system interaction and remote control. See also... Figure 2 The flowchart shown represents another vehicle-to-machine (V2M) interaction method, which includes the following steps: Step S202: Obtain data of the real pet and generate a virtual pet based on the data of the real pet.

[0045] The vehicle-mounted system in this embodiment can receive image or video data of a real pet uploaded by the user or collected by IoT devices. Through 3D modeling and generative AI algorithms, the system reconstructs and trains the image or video data of the real pet to generate a 3D model of a virtual pet that is highly similar to the user's real pet.

[0046] The 3D model of the virtual pet mentioned above may include appearance data and a basic action library.

[0047] Step S204: Obtain the actual behavior status information of the pet.

[0048] In this embodiment, IoT devices such as smart cameras, feeders, water dispensers, and motion sensors in the home can be used to collect real-time data on the behavior of pets, including their exercise, eating, resting, and abnormal alarm information, and then upload the data to the vehicle's infotainment system.

[0049] Step S206: Control the virtual pet to perform actions or expressions corresponding to the behavior status information.

[0050] The vehicle-mounted system in this embodiment can analyze the collected behavioral status information and generate corresponding virtual pet actions, expressions, and voice prompts based on the behavioral status information. For example, when the pet is eating, the virtual pet performs the eating action; when it detects that the water dispenser is low on water, the virtual pet exhibits anxious behavior and gives the voice prompt "The pet is thirsty."

[0051] Step S208: Display the virtual pet on the screen of the vehicle infotainment system or on a device connected to the vehicle infotainment system.

[0052] Among the devices connected to the vehicle's infotainment system are augmented reality glasses.

[0053] In this embodiment, virtual pets can also be displayed on the screens of in-vehicle infotainment systems such as the large in-vehicle screen, passenger screen, remote screen, and HUD, or on devices connected to the in-vehicle infotainment system such as AR (augmented reality) glasses.

[0054] For example, virtual pet motion mapping can be achieved through the following steps 1-5: Step 1: The vehicle system obtains real-time information about the pet's behavior from home IoT devices (such as cameras, feeders, or sensors).

[0055] Step 2: Analyze the behavioral status information to determine whether the pet is eating, drinking, active, hibernating, or in an abnormal state.

[0056] Step 3: Match the virtual pet's action library, performance library, and voice library built into the vehicle's infotainment system.

[0057] Step 4: Generate the corresponding virtual pet's actions or expressions, such as: a dog wagging its tail, a cat rolling around, a message saying "dehydrated", or "haven't played with me in a long time".

[0058] Step 5: Synchronize the virtual pet's movements or expressions to various terminals (e.g., large screen, passenger screen, HUD, AR glasses) to achieve immersive emotional companionship.

[0059] Step S210: Obtain the user's interaction commands; control the virtual pet to execute the actions or expressions corresponding to the interaction commands.

[0060] Interactive commands include: voice commands, touch commands, or gesture commands.

[0061] In this embodiment, users can interact with the virtual pet through voice, touch, or gesture commands. The vehicle's infotainment system can acquire the user's interaction commands and control the virtual pet to perform the corresponding actions or expressions.

[0062] Step S212: Exchange the control signal corresponding to the instruction to the IoT device so that the IoT device can perform the action corresponding to the control signal.

[0063] In this embodiment, the vehicle system can also send control signals to the family pet IoT device according to the user's interactive commands, so as to realize remote feeding, playing with, or environmental adjustment.

[0064] For example, users can interact with virtual pets through the car's infotainment screen, voice commands, or touch controls. The system then sends control signals to home IoT devices based on these interactions to remotely feed, interact with, or adjust the environment. For instance, when a user clicks the "feed" icon on the virtual pet, a home feeder will dispense food.

[0065] In some embodiments, the behavior status information of the real pet can also be sent to an external terminal device so that the terminal device can display the behavior status information of the real pet.

[0066] The vehicle system in this embodiment can send real pet behavior status information to various external terminal devices, thereby achieving consistent display and seamless experience across multiple terminals.

[0067] For example, the vehicle infotainment system can be displayed simultaneously on various terminals such as the vehicle's main screen, passenger screen, remote screen, HUD, AR glasses, mobile phone, and computer, maintaining a consistent display of virtual avatars, actions, and states, and ensuring the continuity and immersion of the cross-terminal experience.

[0068] The method provided in this embodiment of the invention can realize real-time two-way interaction between the virtual pet assistant in the car and the real pet at home, so that users can not only get realistic virtual companionship in the car, but also intuitively understand the real status of their family pet and perform remote interactive control, thereby improving the emotional experience and cross-scene continuity of the smart cockpit.

[0069] See also Figure 3 The diagram illustrates a logical approach to in-vehicle infotainment interaction. Users can send voice or touch commands to the system, such as saying, "Feed the puppy," or clicking a button on the system's screen. The system's virtual pet assistant can determine the corresponding actions, expressions, and voice feedback based on user commands or behavioral information. Users can view real-time animations and hear voice feedback on their devices.

[0070] like Figure 3 As shown, IoT devices can collect real-world pet behavior information, such as camera footage, feeder detection of food intake, and water bowl sensor detection of drinking status; they can also upload behavior information, such as pet behavior, location, and needs.

[0071] like Figure 3 As shown, the virtual pet assistant in the vehicle system can also control IoT devices according to user commands, such as automatically feeding or activating a pet teaser.

[0072] The in-vehicle interaction method based on the linkage between a virtual pet assistant and a family pet IoT provided in this embodiment of the invention has the following main advantages: I. Enhance the authenticity and emotional connection of companionship: Because the virtual pet assistant's movements and expressions can be mapped to the real-time behavior and status of the family's real pet, the virtual pet image that the user sees in the car is closer to the real pet, thus significantly enhancing the emotional immersion and companionship experience.

[0073] II. Achieving interconnectivity between in-vehicle systems and home IoT devices: This application enables the direct conversion of voice and touch commands from the vehicle's infotainment system into control signals for home pet IoT devices (such as feeders, pet toys, and cameras), allowing for remote feeding and play. Compared to existing methods that can only be operated independently via a mobile phone, this significantly improves interaction efficiency and convenience.

[0074] III. Multi-terminal consistency and scenario-based experience: The virtual pet assistant can be simultaneously displayed on the in-vehicle infotainment screen, passenger screen, remote screen, HUD, and AR glasses, creating a consistent interactive experience across multiple devices. Furthermore, the pet's behavior will adapt to different driving scenarios (such as waiting at a red light, long-distance driving, and camping mode), meeting users' needs for continuous companionship across various scenarios.

[0075] IV. High degree of personalization: Through 3D modeling and generative AI, users can quickly generate their own 3D virtual pet image using a small number of pet photos. Compared with traditional fixed models or limited customization methods, this application can provide a personalized effect of "one pet for every person", enhancing user stickiness and differentiated value.

[0076] V. Directly communicating pet needs: This embodiment can anthropomorphically express the real pet's states of hunger, thirst, loneliness, and activity through the virtual pet's expressions, movements, and voice. Users can intuitively understand the pet's needs without actively checking the monitoring, improving information transmission efficiency and user experience.

[0077] In summary, the method provided in this embodiment can overcome the shortcomings of the prior art, such as the separation between virtual pets and real pets, the lack of interoperability between vehicle systems and home IoT, inconsistent cross-terminal experiences, insufficient personalization, and unintuitive communication of needs. It can significantly improve the companionship value, interactive convenience, and scene integration of the vehicle virtual pet assistant, and meet the comprehensive needs of users in the smart cockpit for realism, personalization, and continuous cross-scene companionship.

[0078] Example 3: Corresponding to the above method embodiments, this invention provides a vehicle-to-everything (V2X) interaction device applied to a vehicle's V2X system. See [link to related documentation]. Figure 4 The diagram shows a structural schematic of a vehicle-to-machine (V2M) interactive device, which includes: The virtual pet generation module 41 is used to acquire data of a real pet and generate a virtual pet based on the data of the real pet; wherein, the data of the real pet includes: image data or video data of the real pet; The real pet status acquisition module 42 is used to acquire real pet behavior status information; The virtual pet action mapping module 43 is used to control the virtual pet to perform actions or expressions corresponding to the behavior status information.

[0079] This invention provides a vehicle-mounted interactive device that acquires data from a real pet and generates a virtual pet based on that data. The real pet data includes image or video data of the real pet; it also acquires behavioral state information of the real pet; and controls the virtual pet to perform actions or expressions corresponding to the behavioral state information. This method enables real-time two-way interaction between the vehicle-mounted virtual pet assistant and a real pet at home, enhancing the realism and emotional impact of the virtual pet's companionship. Simultaneously, it establishes an interactive pathway between the vehicle-mounted system and pet IoT devices, improving the consistency and immersion of the cross-scenario experience.

[0080] The aforementioned virtual pet generation module is used to acquire data of real pets uploaded by users through terminal devices or physical media; wherein the terminal devices include: mobile phones and computers; or, to acquire data of real pets collected by Internet of Things (IoT) devices; wherein the IoT devices include: cameras, feeders, and sensors.

[0081] The aforementioned virtual pet generation module is used to generate a 3D image of a virtual pet based on real pet data through 3D modeling and generative artificial intelligence.

[0082] The aforementioned real pet status collection module is used to collect real pet movement, eating, drinking, and resting status information through IoT devices as behavioral status information.

[0083] The aforementioned virtual pet action mapping module is used to determine the pet's needs based on behavioral state information; wherein, the pet's needs include: hunger, thirst, or loneliness; generate actions or expressions corresponding to the behavioral state information based on the pet's needs; control the virtual pet to perform the actions or expressions corresponding to the behavioral state information, and inform the user of the pet's needs through voice or prompts.

[0084] The virtual pet generation module in this embodiment may include a user input unit and a modeling generation unit. The user input unit can take image or video data of a real pet uploaded by the user, and its output can be transmitted to the modeling generation unit to generate a 3D virtual avatar. The modeling generation unit can use AI modeling to generate a 3D model and basic motion library for the virtual pet. Its input can be image or video data, and its output can be a virtual avatar model, which is then passed to the virtual pet motion mapping module.

[0085] In this embodiment, the real pet status acquisition module can obtain real-time pet status data from devices such as home cameras, feeders, water dispensers, and motion sensors, and send it to the virtual pet motion mapping module for processing.

[0086] In this embodiment, the virtual pet action mapping module can generate actions, expressions, and voice prompts corresponding to the virtual pet based on the real pet's status and modeling results, and send them to the home IoT device via control signals, or synchronize behavioral status information to the multi-terminal display module.

[0087] See Figure 5 The diagram shows another vehicle-to-everything (V2X) interactive device, which further includes: a user interaction module 44, used to display a virtual pet on the screen of the V2X system or on a device connected to the V2X system; wherein the device connected to the V2X system includes: augmented reality glasses; acquiring user interaction commands; wherein the interaction commands include: voice commands, touch commands, or gesture commands; controlling the virtual pet to perform actions or expressions corresponding to the interaction commands; and exchanging control signals corresponding to the commands with IoT devices so that the IoT devices perform actions corresponding to the control signals.

[0088] The vehicle system in this embodiment can perform remote operations, such as feeding and playing with pets, and drive home IoT devices through control signals.

[0089] like Figure 5 As shown, the above-mentioned device also includes: a behavior status information sending module 45, used to send the behavior status information of the real pet to an external terminal device so that the terminal device can display the behavior status information of the real pet.

[0090] In this embodiment, the virtual pet can be displayed on multiple terminals such as the in-vehicle large screen, the passenger screen, the HUD, and AR glasses to achieve a consistent interactive experience.

[0091] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the vehicle-machine interaction device described above can be referred to the corresponding process in the aforementioned embodiments of the vehicle-machine interaction method, and will not be repeated here.

[0092] Example 4: This invention also provides an electronic device for running the above-described vehicle-to-machine interaction method; see [link to previous document]. Figure 6 The diagram shows the structure of an electronic device, which includes a memory 100 and a processor 101. The memory 100 is used to store one or more computer instructions, which are executed by the processor 101 to implement the above-mentioned vehicle-machine interaction method.

[0093] Furthermore, Figure 6 The electronic device shown also includes a bus 102 and a communication interface 103, with the processor 101, the communication interface 103 and the memory 100 connected via the bus 102.

[0094] The memory 100 may include high-speed random access memory (RAM) and may also include non-volatile memory, such as at least one disk storage device. Communication between this system network element and at least one other network element is achieved through at least one communication interface 103 (which can be wired or wireless), such as the Internet, wide area network, local area network, metropolitan area network, etc. The bus 102 may be an ISA bus, PCI bus, or EISA bus, etc. The bus can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 6 The symbol is represented by a single double-headed arrow, but this does not mean that there is only one bus or one type of bus.

[0095] Processor 101 may be an integrated circuit chip with signal processing capabilities. In implementation, each step of the above method can be completed by the integrated logic circuitry in the hardware of processor 101 or by instructions in software form. Processor 101 can be a general-purpose processor, including a Central Processing Unit (CPU), a Network Processor (NP), etc.; it can also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this invention. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this invention can be directly manifested as execution by a hardware decoding processor, or execution by a combination of hardware and software modules in the decoding processor. The software module can reside in a readily available storage medium in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, or registers. This storage medium is located in memory 100, and processor 101 reads information from memory 100 and, in conjunction with its hardware, completes the steps of the method described in the foregoing embodiments.

[0096] This invention also provides a computer-readable storage medium storing computer-executable instructions. When these computer-executable instructions are called and executed by a processor, they cause the processor to implement the above-described vehicle-machine interaction method. For specific implementation details, please refer to the method embodiments, which will not be repeated here.

[0097] The computer program products of the vehicle-to-machine interaction method, device, and electronic device provided in the embodiments of the present invention include a computer-readable storage medium storing program code. The instructions included in the program code can be used to execute the methods in the preceding method embodiments. For specific implementation, please refer to the method embodiments, which will not be repeated here.

[0098] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the system and / or device described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0099] Furthermore, in the description of the embodiments of the present invention, unless otherwise explicitly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in the present invention based on the specific circumstances.

[0100] If a function is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0101] In the description of this invention, it should be noted that the terms "center," "upper," "lower," "left," "right," "vertical," "horizontal," "inner," and "outer," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing the invention and for simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0102] Finally, it should be noted that the above-described embodiments are merely specific implementations of the present invention, used to illustrate the technical solutions of the present invention, and not to limit it. The scope of protection of the present invention is not limited thereto. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art can still modify or easily conceive of changes to the technical solutions described in the foregoing embodiments within the technical scope disclosed in the present invention, or make equivalent substitutions for some of the technical features; and these modifications, changes, or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be covered within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A vehicle-machine interaction method, characterized in that, The method, applied to an in-vehicle infotainment system, includes: Acquire data of a real pet, and generate a virtual pet based on the data of the real pet; wherein, the data of the real pet includes: image data or video data of the real pet; Obtain the behavioral status information of the real pet; Control the virtual pet to perform actions or expressions corresponding to the behavioral state information.

2. The method according to claim 1, characterized in that, The steps of acquiring data from real pets and generating virtual pets based on that data include: Acquire data on real pets uploaded by users through terminal devices or physical media; wherein, the terminal devices include: mobile phones and computers; Alternatively, data about the real pet can be acquired from IoT devices, including cameras, feeders, and sensors.

3. The method according to claim 1, characterized in that, The steps for generating a virtual pet based on the data of the real pet include: A virtual pet's 3D image is generated based on the data of the real pet using 3D modeling and generative artificial intelligence.

4. The method according to claim 2, characterized in that, The steps for obtaining the behavioral status information of the real pet include: The movement, eating, drinking, and resting status information of the real pets collected through IoT devices are used as behavioral status information.

5. The method according to claim 1, characterized in that, The steps of controlling the virtual pet to perform actions or expressions corresponding to the behavioral state information include: The pet's needs are determined based on the behavioral state information; wherein, the pet's needs include: hunger, thirst, or loneliness; Generate actions or expressions corresponding to the behavioral status information based on the pet's needs; The system controls the virtual pet to perform actions or expressions corresponding to the behavioral status information, and informs the user of the pet's needs through voice or prompts.

6. The method according to claim 2, characterized in that, The method further includes: The virtual pet is displayed on the screen of the vehicle infotainment system or on a device connected to the vehicle infotainment system; wherein, the device connected to the vehicle infotainment system includes: augmented reality glasses; Obtain user interaction commands; wherein, the interaction commands include: voice commands, touch commands, or gesture commands; Control the virtual pet to perform the actions or expressions corresponding to the interactive commands; The control signal corresponding to the interaction command is sent to the IoT device to cause the IoT device to execute the action corresponding to the control signal.

7. The method according to claim 1, characterized in that, The method further includes: The behavior status information of the real pet is sent to an external terminal device so that the terminal device can display the behavior status information of the real pet.

8. A vehicle-to-everything (V2X) interactive device, characterized in that, The device is used in a vehicle infotainment system and includes: A virtual pet generation module is used to acquire data from real pets and generate virtual pets based on the data from the real pets; wherein, the data from the real pets includes: image data or video data of the real pets; The real pet status acquisition module is used to acquire the behavioral status information of the real pet; The virtual pet action mapping module is used to control the virtual pet to perform actions or expressions corresponding to the behavior status information.

9. An electronic device, characterized in that, It includes a processor and a memory, the memory storing computer-executable instructions that can be executed by the processor, the processor executing the computer-executable instructions to implement the vehicle-machine interaction method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when invoked and executed by a processor, cause the processor to implement the vehicle-machine interaction method according to any one of claims 1 to 7.

Images