Method for providing digital animation of given graphic element, control device, storage medium, motor vehicle, server device and system

By centrally storing the status data of graphic elements on the server and synchronizing them when switching devices, the problem of virtual assistant status synchronization between different devices is solved, seamless switching and personalized support of graphic elements are achieved, and the user experience and information consistency between devices are improved.

CN120704626APending Publication Date: 2025-09-26AUDI AG
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202510346910.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2024-03-25
Filing Date
2025-03-24
Publication Date
2025-09-26

AI Technical Summary

Technical Problem

In the existing technology, the database of the virtual assistant needs to be stored and updated separately on each device, which requires users to be retrained when using it between different devices, and it is impossible to synchronize the latest status of graphic elements.

Method used

The status data of graphic elements are centrally stored on the server through the control device and synchronized to the target display device when the device is switched. The device switching is determined by using motor vehicle sensors and user intention recognition to ensure that the graphic elements remain up to date and consistent on different devices.

Benefits of technology

It achieves seamless switching and synchronization of graphic elements across different devices, reduces the need for repeated training for users, improves user experience and information consistency across devices, and enhances the personalization and efficiency of virtual assistants.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120704626A_ABST
    Figure CN120704626A_ABST
Patent Text Reader

Abstract

The invention relates to a method for providing a digital animation of a given graphical element (38). A control device (20): determines (S1) a first display device (12) having a display element (32) used by a user at a first time; the method includes determining (S2) a user's intent of use of a structurally separated second display device (14), determining (S3) the second display device, and determining (S4) status data upon determination (S1) of the intent of use, storing (S5) the status data on a storage medium (28) of the server device (22), the determined state data indicates a given graphic element (38) and / or a digital animation thereof at a first time before the user performs the device switching. The control device (20) provides (S7) an animation data set comprising the status data stored on the server device (22) and transmits (S9) the animation data set to the second display device (14) at a second time. The invention also relates to a corresponding device and system (10).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a method for providing a digital animation of a given graphical element, particularly an avatar. The digital animation is output by moving one or more display devices. The present invention also relates to a control device, a storage medium, a server device, and a system comprising two or at least two display devices and corresponding control units. Background Art

[0002] For example, many manufacturers of computers or motor vehicles use personal assistants, such as virtual assistants, to assist users of display devices in using the display devices.

[0003] Thanks to advances in display technology and improvements in vehicle operation, personal assistants in motor vehicles are now supporting drivers with tasks such as scheduling. Drivers benefit from the benefits of virtual assistants when using their vehicles, which reduce their workload and make vehicle operation easier. As a result, drivers can perform their tasks more efficiently and more focused.

[0004] DE 10 2008 028 512 A1 relates to a communication system having a display unit and a virtual presence which can be visually displayed on the display unit and is designed for communicating with a natural person in natural language.

[0005] DE 10 2009 018 591 A1 discloses a motor vehicle having an operating device for operating the motor vehicle, wherein the operating device comprises a display for displaying variable information and an operating element associated with the display. The motor vehicle comprises a database containing operating instructions relevant to the operation of the motor vehicle, and the operating instructions can be selected from the database by means of the operating device and transmitted in converted or unconverted form to a mobile device having a display device that is not associated with the motor vehicle. Summary of the Invention

[0006] The object of the present invention is to improve the manner of operation involving a plurality of different devices.

[0007] The stated object is achieved by the method according to the invention, the device according to the invention and the system according to the invention according to the independent claims. The dependent claims provide advantageous developments.

[0008] The present invention provides for a database describing graphical elements and / or their animations to be centrally stored and updated during use. This allows, for example, a personal assistant to be provided with an up-to-date version that the user can use on different devices, always in its latest state. This also improves continuous use across multiple devices, as the user does not have to carry previously used devices to transfer the database. Thus, the present invention allows for the coupling of different devices, such as a mobile terminal, with a motor vehicle.

[0009] The method for providing a digital animation of a given graphical element according to the present invention is executed by a control device. A control device is understood to be a device or device component that is configured to receive and evaluate signals, generate control signals, and transmit these control signals to other devices or device components. To this end, the control device may preferably include a receiving module and / or a transmitting module. The control device may be designed, for example, as a control device or a control chip.

[0010] The digital animation of a given graphical element, which can also be referred to as display content, is understood to be a presentation form of variable information that is visually output. This animation can preferably be an avatar. An avatar is a virtual being that is visually displayed, for example, on a screen, and is preferably configured or designed to communicate with a natural person using natural language. It can also be referred to as a digital representation of "presence." For example, if the graphical element is the image of a small robot, the animation of the small robot can be used to display a moving robot with its own facial expressions and body language.

[0011] The control device identifies a first display device having a display element, which is used by a user at a first moment, and whose display element outputs a digital animation of a given graphical element. The first moment occurs before the device switches to another device. The user may preferably be a given user, such as a user who has been authenticated and / or logged in to use the first display device, or a user designated as the user of the first display device. If the user activates a personal assistant on a screen of a motor vehicle, for example, the control device may define the screen of the motor vehicle as the first display device.

[0012] A display device is understood to be a device or device component designed to output visible content. The display device can preferably be designed as a screen or monitor, wherein the component of the display device that outputs the display content is the display surface.

[0013] The control device determines the user's intention to use the second display device, which is another device, i.e., determines the user's intention to use the other device. In other words, the control device determines an intended device switch. Here, the control device can, for example, determine the user's predicted intention to use, the actual intention to use, or, for example, the control device can determine whether a given intention to use criterion is met, which describes a given minimum probability that the user intends to switch devices. If the first display device is, for example, the display device of a motor vehicle, and the control device determines that the user leaves the motor vehicle and takes his smartphone with him, there may be an intention to use the display device of the smartphone. In another example, the control device can first determine that the user leaves the motor vehicle, and at a later moment the control device can determine that the user switches on his smartphone. Therefore, when the user uses the first display device, the user does not necessarily have to carry a device with a second display device.

[0014] The control device determines the second display device, i.e., for example, it can determine that the second display device is the display device of the user's smartphone because the user has opened the smartphone. The determined second display device is structurally separate from the first display device, i.e., it is the display device of another device. In other words, the second display device is the display device that the user is expected to use or may intend to use by switching devices. To this end, the control device can optionally first determine whether the determined second display device is in use, for example, by recognizing that the user has opened their smartphone and / or, for example, has called up an auxiliary program that uses a given graphical element as a personal assistant.

[0015] When determining the intended use, the control device determines state data and stores the state data on a storage medium of the server device. The determined state data describes a given graphical element and / or a digital animation of the given graphical element, wherein the first moment is a moment during use of the first display device, i.e., before a device switch is performed. In other words, the first moment is the moment when the first display device outputs the animation of the given graphical element.

[0016] State data may also be referred to as a database of a given graphical element and / or an animation of a given graphical element.

[0017] According to the method according to the present invention, a control device provides an animation data set including state data stored on a server device and transmits the provided animation data set to a second display device at a second moment for displaying the animation data set. The animation data set describes an embodiment of a given graphical element using the state data determined, or describes the given graphical element in a supplemented or modified form.

[0018] Therefore, the server device used to transmit information about the used graphic elements is a device that does not belong to the devices corresponding to the two display devices.

[0019] In contrast to the prior art, where databases for virtual beings, such as assistant programs, are permanently stored in the vehicle or mobile device, the method according to the present invention enables the "distribution" of animations in their latest form and with the latest information. This allows any number of devices to always have access to updated versions of graphical elements. This also means that graphical elements with the latest knowledge and / or appearance are available to all devices. Users do not have to "retrain" their personal assistants for each device. Graphical elements (particularly virtual beings such as avatars) become companions in daily life through appearance recognition, acquiring a personality and thus a face as the personal assistant, accompanying the user throughout much of the day. Furthermore, the method according to the present invention reduces data rates because each device does not have its own separate database for the personal assistant. Consequently, the method according to the present invention can also synchronize or coordinate multiple devices.

[0020] Preferably, the method according to the present invention can additionally provide that the control device, for example, upon determining the intended use or at a second point in time, generates a control signal indicating the end of displaying the graphical element on the first display device, and the control device can then transmit the control signal to the first display device. This creates the impression of a graphical element "jumping" from one device to another, even if the first display device is used only after the virtual assistant has been used on the other device. This also allows for a very close personal relationship with the personal assistant.

[0021] At least one or both of the display devices can be a display device of a mobile terminal, such as a smartwatch, smartphone, laptop, VR glasses (i.e., data glasses configured and designed to display virtual reality) or AR glasses (i.e., data glasses configured and designed to display augmented reality). In a preferred embodiment of the method according to the present invention, one of the two display devices can be a display device, such as a screen, in the center console of the motor vehicle, and the other of the display devices can be a display device outside the motor vehicle, such as a smartphone display, a laptop display, a household appliance display, or a smartwatch display. This resulting link between the mobile terminal and the motor vehicle significantly improves the operating concept of the personal assistant and integrates the motor vehicle into the user's daily life when the user is not using the motor vehicle. Thus, the control device can also store information acquired during the trip, such as the destination, as knowledge states and use this information constructively outside the motor vehicle to support the user. This makes the virtual personal assistant even more efficient.

[0022] In an improved embodiment, to determine the user's intention to use the vehicle, the control device can preferably determine whether the user is entering and / or exiting the vehicle, and / or the user's intention to enter and / or exit the vehicle. This serves as an indicator of intentional device switching and reliably indicates a device switch. The user's entry or exit of the vehicle is also symbolically represented and visualized by a digitally animated "jump." This further enhances the connection with the personal assistant and makes user support more efficient.

[0023] In another refinement of the method according to the invention, which can optionally be combined with the previous refinement, the display device is a component of a motor vehicle, and the control device can determine the intended use based on the motor vehicle's sensor system. Preferably, the control device can determine the intended use based on the following signals: an ignition signal received from the motor vehicle's ignition; and / or a seatbelt signal received from a sensor for checking seatbelts, which can indicate, for example, whether the driver's seatbelt is fastened or unfastened; and / or a door signal received from the motor vehicle's locking system, which can indicate whether a motor vehicle door is opened, closed, unlocked, and / or locked; and / or a pressure signal received from a motor vehicle seat sensor, from which the control device can infer, for example, whether the user is standing or sitting; and / or a monitoring signal from a monitoring camera of the motor vehicle, preferably an exterior and / or interior camera of the motor vehicle. This is a particularly useful indicator for inferring whether the user intends to use the motor vehicle's display device or no longer wishes to use the motor vehicle's display device.

[0024] Alternatively or additionally, the control device can determine the usage intention by: gesture recognition of a predetermined user gesture; and / or the approach and / or withdrawal of one device from another device; and / or voice recognition of a user's voice command; and / or the user logging in and / or out of a given digital space with a user account. This makes the operation and activation of the digital animation particularly intuitive.

[0025] The determined state data may preferably describe graphical data and / or animation data of a given graphical element, i.e., data describing the appearance and / or properties of the given graphical element, and / or data describing the movement behavior of, for example, an animated graphical element. If the given graphical element is an avatar, the state data determined at the first moment may, for example, indicate that the avatar has the image and appearance of a small robot with a given shape, a given color, and a given expression.

[0026] Preferably, the graphic data may additionally describe characteristics of this virtual being, such as an amusing appearance, humorous communication, and / or, for example, smooth, brisk, or agile movements. Thus, after a device switch, the graphic elements appear on the display elements of the second display device in the same manner as before on the first display device.

[0027] In a further embodiment, the control device can determine the size and / or characteristics of the display elements of the second display device and adapt the graphical data to the determined size and / or characteristics. In this case, for example, a virtual avatar displayed on the central screen of a motor vehicle might appear as a small robot with rich facial expressions, while at a later time, on the screen of, for example, a smartwatch, it might appear as a small robot. This optimizes the display for the specific device and makes better use of the display surface.

[0028] In another embodiment, the determined status data may describe an information data set associated with a given graphical element at a first moment. If, for example, a user is in a motor vehicle while in a conversation with a virtual avatar, and if the control device collects relevant information from this conversation, such as where the user intends to drive the motor vehicle or why the user interrupted the journey, or if the program describing the virtual assistant downloads and stores information, for example, from the internet, this information is still available when using a second device, thus significantly improving the efficiency of the overall user experience across multiple devices. This information forming the knowledge level of the personal assistant may originate, for example, from the internet, or from other devices, such as navigation devices, or be analyzed and stored based on communications with the user. Preferably, the information data set may describe information communicated with a given user and / or information about one or more journeys of a given user in a motor vehicle.

[0029] For application cases or application situations that may occur in the method and are not explicitly described here, it can be provided that according to the method an error message and / or a request for user feedback is output and / or a default setting and / or a predetermined initial state is set.

[0030] The present invention also includes a control device for a motor vehicle. The control device may include a data processing device or processor device configured to execute an embodiment of the method according to the present invention. To this end, the processor device may include at least one microprocessor and / or at least one microcontroller and / or at least one FPGA (Field Programmable Gate Array) and / or at least one digital signal processor (DSP). In particular, a central processing unit (CPU), a graphics processing unit (GPU), or a neural processing unit (NPU) may be used as the microprocessor. Furthermore, the processor device may include program code configured to execute an embodiment of the method according to the present invention when executed by the processor device. The program code may be stored in a data memory of the processor device. The processor device may be based on, for example, at least one printed circuit board and / or at least one system on a chip (SoC).

[0031] As another solution, the present invention also includes a computer-readable storage medium containing program code that, when executed by a computer or computer network, causes the computer or computer network to perform an embodiment of the method according to the present invention. The storage medium can be provided at least partially as a non-volatile data memory (e.g., as a flash memory and / or a solid state drive (SSD)) and / or at least partially as a volatile data memory (e.g., as random access memory (RAM)). The storage medium can be located in the computer or computer network. However, the storage medium can also, for example, operate as a so-called app store server and / or cloud server on the Internet. A processor circuit, for example, having at least one microprocessor, can be provided via the computer or computer network. The program code can be provided as binary code and / or as assembly code and / or as source code in a programming language (e.g., C) and / or as a program script (e.g., Python). The storage medium can be, for example, in the form of a micro memory card, a memory chip, or other data storage device. This achieves the advantages already mentioned.

[0032] The above-mentioned object is also achieved by a motor vehicle having an embodiment of the control device according to the invention. This brings about the advantages already discussed above. The motor vehicle according to the invention is preferably designed as a motor vehicle, in particular a passenger car or truck, or as a bus or motorcycle.

[0033] The above-mentioned object is achieved by a server device for operation on the Internet, such as a data server, a backend and / or a data cloud, wherein the server device has an embodiment of the storage medium according to the invention.

[0034] This object is also achieved by a system according to the present invention comprising two or at least two display devices, as well as embodiments of a control device according to the present invention and / or embodiments of a server device according to the present invention. The advantages described above also apply. In this case, the two display devices are display devices of different devices. In particular, the system according to the present invention can include two devices with corresponding display devices, as well as a server device.

[0035] The present invention also includes improvements to the control device according to the invention, the storage medium according to the invention, the motor vehicle according to the invention, the server device according to the invention, and the system according to the invention, which have the features already described in conjunction with the improvements to the method according to the invention. For this reason, the corresponding improvements to the control device according to the invention, the storage medium according to the invention, the motor vehicle according to the invention, the server device according to the invention, and the system according to the invention will not be described in detail here.

[0036] The present invention also includes combinations of features of the described embodiments. Therefore, the present invention also includes implementations that each have a combination of features of several of the described embodiments, as long as these embodiments are not described as mutually exclusive. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] The following describes embodiments of the present invention.

[0038] Figure 1 Schematic diagrams showing embodiments of a system according to the invention, an apparatus according to the invention and a method according to the invention;

[0039] Figure 2 A schematic diagram showing another embodiment of the system according to the present invention, the server device according to the present invention and the method according to the present invention; and

[0040] Figure 3 A schematic diagram shows another embodiment of the system according to the present invention, the server device according to the present invention, and the method according to the present invention. DETAILED DESCRIPTION

[0041] The embodiments described below are preferred embodiments of the present invention. In the embodiments, the described components of the embodiments are respectively individual features of the present invention that can be considered independently of one another, and these features also improve the present invention independently of one another. Therefore, the present disclosure should also include features of the embodiments in addition to the illustrated feature combinations. In addition, the described embodiments may also be supplemented by other features of the already described features of the present invention.

[0042] In the figures, the same reference numerals respectively denote elements having the same function.

[0043] Figure 1 A schematic diagram of a system 10 is shown having a plurality of display devices 12, 14, 36. Here, the respective display devices 12, 14, 36 are structurally separate from one another and belong to different devices 16, 18, 34. Therefore, the system 10 can also have at least two or more devices 16, 18, 34. In addition to the display devices 12, 14, 36 or devices 16, 18, 34, the system 10 also includes an embodiment of a control device 20 or a server device 22 having a control device 20.

[0044] exist Figure 1 In the example of , the device 16 is preferably a motor vehicle 24. Figure 1 In the example of FIG. 2 , although the control device 20 is shown as a component of a server device 22 , it may alternatively be a component of one of the devices 16 , 18 , for example a control device of a motor vehicle 24 .

[0045] The control device 20 may desirably include a processor device 26 and / or a storage medium 28. The processor device 26 may, for example, have one or more microchips or microprocessors. The storage medium 28 may, for example, be designed as a memory chip, a hard disk, or other common storage media. Figure 1 The embodiment shown in FIG as a component of server device 22 is preferred, with storage medium 28 of control device 20 also serving as a storage medium for storing status data of a given graphic element and its digital animation. Server device 22 can be designed as a conventional data server, such as a hardware server or a data cloud. Data communication with display devices 12 , 14 is preferably achieved via a wireless data communication connection 30 , such as an Internet connection, a WLAN connection, a mobile radio connection, or a Bluetooth connection.

[0046] exist Figure 1In the exemplary embodiment, the exemplary motor vehicle 24 may preferably include a display as a display device 12, such as a screen in the center console or a screen on the dashboard of the motor vehicle 24. Such a display device 12 may include a display surface as a display element 32. The display device 14 may also include a display surface as a display element 32, wherein the device 18 may be designed, for example, as data glasses or VR glasses. Other embodiments of the device 18 may include, for example, a computer, a laptop, a smartwatch, or a computer or data glasses that a user can access and log into a virtual world ("metaverse").

[0047] exist Figure 1 In the example, a user may use, for example, a motor vehicle 24 having a display device 12 for motor vehicle 24 and a plurality of different mobile devices, such as devices 18 and 34. For example, before driving motor vehicle 24, the user may use device 34, such as a smartphone, having a display device 36 to display a digital animation of a given graphical element 38. Preferably, given graphical element 38 may be represented as a virtual presence, particularly an avatar. In this case, the first display device may be display device 36 of device 34, while the second display device may be the display device of motor vehicle 24. If the user of motor vehicle 24 then uses device 18 after driving or during a break in driving, such as using exemplary data glasses while the user is at a motorway service station, the relative relationship between display devices 12 and 14 may be switched when given graphical element 38 is switched, so that display device 12 becomes the first display device and display device 14 may be defined as the second display device. In other words, at this time, the "first display device" is the display device that outputs the given graphic element 38 before the device is switched, and the "second display device" is the display device that subsequently takes over the given graphic element, that is, the graphic element 38 subsequently "jumps" to the second display device.

[0048] A given graphical element 38 can be, for example, an animated representation of a small robot, or another graphic, for example, depending on user-specific settings. Communication with the user is achieved through digital animation of the given graphical element 38, which can be displayed, for example, in motion and / or three-dimensionally, and is preferably controlled by program code that supports voice recognition and, preferably, voice output controlled by, for example, artificial intelligence.

[0049] exist Figure 1In the example, a user of motor vehicle 24 may be planning a vacation trip to the south of France. A given graphical element 38 may preferably be a virtual being, particularly an avatar, which may, for example, have the appearance of a small robot and be animated in motion on the display using digital animation, combined with voice recognition and voice output. For example, using artificial intelligence, i.e., an artificial neural network, a database of avatars may be provided, allowing the user to converse with the avatars, and information about the user's conversations may be stored in the database. Thus, for example, before using motor vehicle 24, the user may already use the avatar, configured as a personal assistant, to obtain information about traffic conditions and weather during the trip and store corresponding information about the planned travel route. This information may be determined and stored as a result of voice recognition, and / or downloaded from the internet or retrieved from another device, such as a navigation system.

[0050] Preferably, the exemplary avatar can initially be connected to artificial intelligence via the control device 20, and / or the exemplary avatar can be newly provided with artificial intelligence (e.g., similar to a chatbot that uses artificial intelligence to communicate with a user via text-based messages and / or images). The artificial intelligence continuously learns, thus serving as a kind of "avatar memory." In this context, an artificial neural network can be combined with or integrated into the control device 20, for example.

[0051] Artificial intelligence or artificial neural networks can be understood as software code stored on a computer-readable storage medium that represents one or more networked artificial neurons or can emulate their functionality. The software code can also include multiple software codes, which can, for example, have different functions. Artificial neural networks can, in particular, implement nonlinear models or algorithms that map an input to an output, where the input is represented by an input feature vector or input sequence, and the output can, for example, include an output class for a classification task, one or more predicted values, or a predicted sequence.

[0052] The control device 20 may accordingly determine in S1 that, at the time of using the device 34 , such as a smartphone, the display device 36 of the device is used to output the virtual avatar, and may accordingly determine that the display device 36 is the first display device at this time.

[0053] In order to determine S2 the user's usage intention at the time of switching from using the display of device 34 to using display device 12 of motor vehicle 24, control device 20 can, for example, receive and evaluate geographic data of motor vehicle 24 and device 34, and determine that device 34 is close to motor vehicle 24 when the user approaches motor vehicle 24 and the control device, for example, determines that the user is close to motor vehicle 24. For example, control device 20 can predict an expected device switch when the minimum distance between the user or mobile terminal device and motor vehicle 24 falls below a given value.

[0054] Alternatively, the control device 20 may determine that the user has entered the motor vehicle 24 to determine the intention to use the switching display device (S2), for example, through a signal received by the control device 20 from a wireless key of the motor vehicle 24, a voice command received from the user, or based on a signal from the motor vehicle sensor device 40, the vehicle sensor device, for example, determines that a door is open and may transmit a corresponding signal to the control device 20.

[0055] Alternatively or additionally, control device 20 may receive a signal (or signals) from vehicle sensor device 40 , such as: an ignition signal indicating that vehicle 24 has been started; a seatbelt signal indicating that the seatbelt is fastened in the driver's seat; a signal from a locking device in vehicle 24 indicating that a vehicle door has been opened; and / or a pressure signal from a seat sensor in vehicle 24 indicating that pressure is being applied to the driver's seat. In the latter case, control device 20 may infer, for example, that the driver has entered vehicle 24 and, therefore, wishes to use the center console screen. Additionally or alternatively, control device 20 may receive and evaluate monitoring signals from vehicle 24 , such as from a monitoring camera and indicating, for example, one or more images of the vehicle interior and / or the vehicle exterior. Control device 20 may recognize, for example, through image recognition, that a user is approaching vehicle 24 or that a person is present in vehicle 24 and thereby determine the intended use ( S2 ).

[0056] When switching accordingly from a motor vehicle 24 as a device 16 whose display device 12 is used by the user while driving to the display device 14, the control device 20 can correspondingly determine at a later moment that the user has gotten out of the motor vehicle 24 or intends to get out of the vehicle, has switched off the ignition, has released the seat belt, has opened or locked the door, the pressure load on the driver's seat has ended and / or a corresponding image or video recording has been made.

[0057] Additionally or alternatively, other triggers can be used to determine the use intention of other display devices, for example, determining S2 the use intention for device switching by means of gesture recognition, by a user's voice command, and / or by determining that the user has logged in and / or logged out of a user account in the digital space. The latter approach is particularly advantageous if, for example, the exemplary personal assistant, i.e., the digital animation of a given graphical element 38, is used in the metaverse.

[0058] Alternatively, the target device can be selected by presetting or by communication, ie, for example, by an operating gesture or a voice command.

[0059] exist Figure 1In the example of , the control device 20 may exemplarily determine the screen of the center console of the motor vehicle 24 as the second display device 12 at the moment of switching the device (S3). The moment (S4) for determining the status data of a given graphic element 38 may be the moment of switching the device ("switching moment"), or preferably the moment before the device is switched. Ideally, the control device 20 may determine (S4) the status data at regular intervals and store the status data on the storage medium 28 of the server device 22 already before the device is switched (S5). Figure 1 In the example of FIG, the state data or database of the digital animation of the graphic element 38 may indicate, for example, that a given graphic element 38 is designed as a small robot and optionally provide detailed descriptions of the graphic element 38, such as the resolution, size and detail richness of the graphic element 38. However, it may be ideally provided that the control device 20 adapts the specific details, such as the resolution and amount of detail of the graphic element 38, to the display device 12, 14, 36 to be used. Thus, for example, in Figure 1 In the example of , a lower resolution of the graphical element 38 may be set on the display device 36 of the apparatus 34 due to the limited screen area, and the resolution may vary according to the determined second display device 12 .

[0060] Preferably, the status data determined by the control device 20 in S4 during use of the device 34 (S4) may include a data set of information, for example, information about a travel route determined during use of the smartphone, information from a weather query and traffic news obtained. This information may indicate the "knowledge level" of the avatar.

[0061] In S6, control device 20 determines, for example, that a user has started motor vehicle 24 and therefore turns on the screen of the center console, i.e., exemplary display device 12. At a second moment, i.e., when second display device 12 is being used, control device 20 provides an animation dataset in S7, which includes status data stored on storage medium 28. The animation dataset may include only the database, i.e., only the stored status data, or, in addition to the status data, also include a signal for outputting graphical element 38 by display element 32.

[0062] exist Figure 1In the example, control device 20 may adapt ( S8 ) the state data as described above to output graphical elements 38 . Control device 20 may determine, for example, that graphical elements 38 output by the center console screen may have a higher resolution due to the center console screen size and, for example, may display more details of the exemplary robot, as determined in the animation dataset. At S9 , server device 22 transmits the provided animation dataset to the center console screen of motor vehicle 24 via data communication connection 30 . The virtual avatar is then output and animated on the center console screen during driving.

[0063] Optionally, the program in motor vehicle 24 that can animate graphical element 38 can also include a driver training program. For example, control device 20 can detect and evaluate driving data. If the driver drives particularly well, for example, during a drive through southern France—for example, by being particularly fuel-efficient, particularly careful, and / or consistently adhering to speed limits—the driver can earn "points." If the driver achieves a given score, control device 20 can, for example, adapt ( S8 ) the graphic data of graphical element 38 so that, upon reaching the given score, the avatar is additionally displayed wearing a racing cap. The next time control device 20 determines the status data in S4 , the representation of the racing cap can be stored in a database.

[0064] At another point during a car trip to southern France, the driver may decide to take a short break at a rest stop, for example. For example, using seat sensors or by detecting that a user has exited the motor vehicle 24 while wearing another device 18, such as data glasses, the control device 20 may now determine the screen of the center console of the motor vehicle 24 as the first display device (S1) and the exemplary data glasses as the second display device 14 (S3), i.e., the display device 14 that "takes over" the avatar from the center console screen. When the center console screen no longer displays graphical elements 38, the control device 20 may adapt the database stored in the storage medium 28 (S8) so that the avatar is displayed only in a stylized manner on the data glasses. The adapted database, i.e., the provided animation data set, may then be transferred from the storage medium 28 to the device 18 in S9.

[0065] During a rest stop, the driver can, for example, purchase a milkshake. This can optionally be received and evaluated by control device 20, for example by linking to a digital program that can also detect, for example, a transfer to the user's credit card. Alternatively, control device 20 can analyze the milkshake order, for example by voice recognition via the microphone of device 18, and adapt the database for the avatar (S8) so that the avatar is shown holding a milkshake from that moment on. When the user, wearing the data glasses, approaches motor vehicle 24, the avatar database can again be transmitted via server device 22 to display device 12 of motor vehicle 24.

[0066] If one of devices 18 , 34 is, for example, a smartwatch, the control device may, for example, perform an adaptation S8 such that the avatar is highly stylized. If the control device 20 determines that the user is logged into the metaverse, the avatar may preferably be adapted ( S8 ) such that the avatar has a very high resolution and, for example, displays additional details such as other body parts. If the control device 20 determines, for example by analyzing images captured by an interior camera, that a child is present in the motor vehicle 24 , the control device 20 may, for example, adapt the animation dataset such that the avatar has a very childlike appearance, such as very large eyes and brightly colored clothing.

[0067] Ideally, it can be provided that the devices 18, 34 and the motor vehicle 24 are user-specific devices 18, 34. For this purpose, for example, the devices 18, 34 and the motor vehicle 24 can be registered under a user name.

[0068] Figure 2 Another embodiment is shown schematically and shows a section 42 of a system 10, a mobile terminal device 44, such as a smartphone, located on a table, and a section 46 of the cockpit of a motor vehicle 24 with a display device 12, such as a center console screen. Two devices and their displays are shown, on which a given graphic element, preferably designed as a small robot, is displayed. However, in all embodiments, provision can be made for the output of the graphic element 38 on the respective first display device to be terminated as soon as a device switch occurs. Figure 2 The arrows in FIG. 3 represent the device switching and the “jump” of the graphic element 38. For the sake of clarity, Figure 2 The control device 20 is not shown in the figure, and the server device 22 is not shown either. Figure 2 Parts not shown may be reference Figure 1 A portion of the system 10 and method is described.

[0069] Figure 3Another embodiment is shown, and the focus is on switching the display of graphical elements 38 to different devices, such as a mobile terminal 44, a display device 12 of a motor vehicle 24, a display device 36 of a refrigerator 48, a display device of a smartwatch 50, and preferably in a metaverse 52 via data glasses 54. Here, the server device 22 is shown in a stylized manner and can preferably include the control device 20. However, Figure 3 Parts not shown may be reference Figure 1 A portion of the system 10 and method is described.

[0070] In general, these examples demonstrate how a virtual avatar, for example as a graphical element 38 , can be “jumped” from, for example, a smartphone to a motor vehicle 24 .

[0071] In another embodiment, communication between motor vehicle 24 and the driver's smartphone or smartwatch occurs, for example, upon exiting motor vehicle 24. Here, the exemplary avatar moves to the device 18 that the driver carries with them upon exiting motor vehicle 24. The digital representation of the exemplary avatar exists on a server device 22, such as a central server or cloud, and is transmitted to the corresponding device 18, 34, 44, 48, 50, 54, 52, here an exemplary smartphone. The driver experiences the transfer of the exemplary avatar from one device to another. The same process preferably occurs upon boarding the vehicle: communication occurs between motor vehicle 24 and, for example, a phone, the digital instance is loaded into motor vehicle 24 from the exemplary cloud, and the avatar is visually transferred to motor vehicle 24. Jumping to another device 18, 34, 44, 48, 50, 54, 52, such as a "smart" home device or a virtual world such as a "metaverse," is also possible.

[0072] The digital representation of the exemplary avatar is stored ( S5 ) in a server device 22 , for example in the so-called cloud, so that the exemplary avatar can be transferred between smart devices, for example, in order to continue to accompany the user.

[0073] According to another exemplary technical embodiment, it may be preferably provided that:

[0074] 1. Identify exiting a motor vehicle 24.

[0075] 2. The motor vehicle 24 is connected to the smart device.

[0076] 3. Loading a digital representation of an example avatar from the example cloud onto a smart device.

[0077] 4. The exemplary avatar disappears from the motor vehicle 24 and appears on the smart device.

[0078] 5. The same situation occurs when entering a motor vehicle 24, only in reverse.

[0079] 6. The same situation can also occur between other devices.

[0080] In another embodiment, a digital representation of an exemplary avatar, as a graphical element 38, may preferably reside on a central server or cloud. Instances of the exemplary avatar accompany the user and can be transferred between end devices. For example, upon entering a motor vehicle 24, the exemplary avatar transfers from a mobile phone to the vehicle display, while upon exiting the motor vehicle 24, the avatar transfers from the motor vehicle 24 to the phone. Entry and exit can be detected, for example, by direct communication with the device. Provision can also be made for the avatar to transfer to, for example, a smartwatch, a "smart" home appliance, and / or even into the virtual world of the "metaverse."

Claims

1. A method for providing a digital animation of a given graphic element (38), wherein: Control device (20): - determining (S1) a first display device (12) having a display element (32), which is used by a user at a first moment, and the display element (32) of which outputs a digital animation of a given graphical element (38), - determining (S2) a user's intention to use a second display device (14), and determining (S3) a second display device (14), which is structurally separated from the first display device (12), that the user intends to use the second display device by device switching, - when determining the usage intention (S1), determining (S4) state data and storing (S5) the state data on a storage medium (28) of the server device (22), wherein the determined state data describes a given graphical element (38) and / or its digital animation at a first moment before the user switches the device, - providing (S7) an animation data set comprising state data stored on the server device (22), and - transmitting ( S9 ) the provided animation data set to a second display device ( 14 ) at a second moment; In this case, the server device (22) is a device other than the device with respect to the two display devices (12, 14, 36).

2. The method according to claim 1, characterized in that One of the two display devices (12) is a display device (12) of a motor vehicle (24), and the other of the display devices (14) is a display device (14) outside the motor vehicle.

3. The method according to claim 2, characterized in that In order to determine the use intention (S2), the control device (20) determines: entering the motor vehicle (24) and / or leaving the motor vehicle (24); and / or the user's intention to enter and / or leave the motor vehicle (24).

4. The method according to claim 2 or 3, characterized in that The control device (20) determines (S2) the use intention based on the following signals: - an ignition signal received from an ignition device of a motor vehicle (24); and / or - a seat belt signal received from a sensor used to check the seat belt; and / or - a door signal received from a locking device of the motor vehicle (24), the door signal indicating opening, closing, unlocking and / or locking of a door of the motor vehicle (24); and / or - a pressure signal received from a seat sensor of a motor vehicle (24); and / or - A monitoring signal from a monitoring camera of the motor vehicle (24), preferably an external camera and / or an internal camera of the motor vehicle (24).

5. The method according to any one of the preceding claims, characterized in that The control device (20) determines (S2) the use intention as follows: - gesture recognition via predefined user gestures; and / or - approaching and / or moving away from a device (18) having one of the display devices (12, 14, 36) by means of a device (16) having one of the display devices (12); and / or - through voice recognition of the user's voice commands; and / or - by a user logging into a given digital space with a user account and / or logging out of a user account from a given digital space.

6. The method according to any one of the preceding claims, characterized in that The determined status data are graphic data of a given graphic element (38), which describe the appearance and / or properties of the given graphic element (38).

7. The method according to claim 6, characterized in that The control device (20) determines the size and / or properties of a display element (32) of the second display device (14) and adapts (S8) the graphic data to the determined size and / or the determined properties.

8. The method according to any one of the preceding claims, characterized in that The determined status data describe an information data set associated with a given graphical element (38) at a first moment; preferably, the information data set describes information about communications with a given user and / or information about one or more trips made by the given user using the motor vehicle (24).

9. The method according to any one of the preceding claims, characterized in that At least one of the two display devices (12, 14, 36) is a display device (12, 14, 36) of a mobile terminal device, preferably a display device of a smart watch, a display device of a smart phone, a display device of a laptop computer, a display device of VR glasses or a display device of AR glasses.

10. The method according to any one of the preceding claims, characterized in that The digital animation of the given graphical element (38) represents a virtual being, preferably a virtual avatar.

11. A control device (20) configured to carry out the method according to any one of the preceding claims.

12. A storage medium (28) having a program code, which is configured to carry out the method according to any one of claims 1 to 10 when executed by a processor device (26).

13. A server device (22) for operation in the Internet and comprising a storage medium (28) according to claim 12.

14. A motor vehicle (24) having a control device (20) according to claim 11.

15. A system (10) comprising at least two display devices (12, 14, 36), and a control device (20) according to claim 11 and / or a server device (22) according to claim 13.

Citation Information

Patent Citations

  • Communication system and methods for representing information during communication

    DE102008028512A1

  • Motor vehicle i.e. land vehicle utilizable in road traffic, has operating device by which operating instructions of database are selectable, where instructions are transmitted to mobile device in converted or unconverted form

    DE102009018591A1