Method and device for providing game by infotainment system of vehicle on basis of driver device

Abstract

An embodiment of the present invention relates to a method for providing a game by an infotainment system of a vehicle on the basis of a driver device, the method comprising the steps of: receiving, from the driver device of the vehicle, an operation signal of the vehicle through a vehicle game controller application installed in the infotainment system of the vehicle; and transmitting the operation signal of the vehicle to a user terminal located inside the vehicle through the vehicle game controller application.

Description

Method and device for a vehicle infotainment system to provide a game based on a driver device

[0001] The present invention relates to a method and apparatus for providing a game based on a driver device in an infotainment system of a vehicle. More specifically, the present invention relates to a method for enabling a game to be executed inside a vehicle by utilizing the driver device of a vehicle as a game input device, and to a method of linking the infotainment system of a vehicle and a user terminal for performing this.

[0002]

[0003] Recently, vehicle infotainment systems have been evolving to include various features designed to enhance driver convenience and create a more pleasant in-vehicle environment. While existing systems primarily focused on audio and navigation functions, the utilization of in-vehicle interfaces is increasing as diverse functions are gradually integrated.

[0004] [Prior Art Literature]

[0005] [Patent Literature]

[0006] (Patent Document 1) Korean Published Patent 10-2021-0119010 (2021.10.05)

[0007]

[0008] To solve the aforementioned problems, the present invention aims to provide a method and system that utilizes a vehicle's driver device as a game input device to provide a more intuitive and immersive game environment. It converts operation signals such as the vehicle's steering wheel, accelerator pedal, and brake into input values ​​such as character movement and viewpoint control within the game, thereby enabling interaction with the game. Furthermore, it utilizes the vehicle's driving environment signals (e.g., seat angle, rain detection, humidity detection, etc.) as setting elements for the game, thereby allowing the vehicle's internal and external environment to be reflected in real-time during gameplay.

[0009] Through the method of the present invention, users can experience more intuitive and realistic gameplay inside the vehicle and can be provided with a new way to enjoy entertainment even while stopped.

[0010] The problems to be solved in this specification are not limited to those described above and may include various extensions that can be derived from the embodiments of the invention described below.

[0011]

[0012] A method for providing a game based on a driver device in an infotainment system of a vehicle according to one embodiment of the present specification comprises: receiving a vehicle operation signal from the driver device of the vehicle through a vehicle game controller application installed in the infotainment system of the vehicle; and transmitting the vehicle operation signal through the vehicle game controller application to a user terminal located inside the vehicle.

[0013] In one embodiment, the vehicle game controller application is executed when the vehicle is in a stationary state and can be automatically terminated when the vehicle moves or is ready to move.

[0014] In one embodiment, the operation signal of the vehicle may be related to one or more of steering wheel steering, accelerator pedal position, brake state, and gear state.

[0015] In one embodiment, the user terminal executes the game, and the game can be controlled based on a vehicle operation signal received from the vehicle's infotainment system.

[0016] In one embodiment, the user terminal has a user game controller application installed that links with the vehicle game controller application, and the user game controller application controls operation signals for an application belonging to a game category among applications running on the user terminal, and the user game controller application can apply operation signals of the vehicle received from the vehicle's infotainment system to the game.

[0017] In one embodiment, the user terminal can apply the vehicle operation signal received from the vehicle's infotainment system to the game through the user terminal's operating system without passing through a separate game controller application.

[0018] In one embodiment, the movement or action of the in-game character can be controlled based on the operation signal of the vehicle.

[0019] In one embodiment, the method further includes the steps of receiving a driving environment signal of a vehicle from a driving environment device of a vehicle through a vehicle game controller application installed in the infotainment system of the vehicle, and transmitting the driving environment signal of the vehicle through the vehicle game controller application to a user terminal located inside the vehicle, wherein the driving environment device includes one or more of a rain detector, a seat angle, a thermometer inside and outside the vehicle, a hygrometer inside and outside the vehicle, and a light detection sensor inside the vehicle, and the user terminal executes the game, and the game can be controlled based on the vehicle operation signal and driving environment signal received from the infotainment system of the vehicle.

[0020] In one embodiment, the game is executed on the infotainment system of the vehicle, and the executed game can be displayed on the user terminal through mirroring.

[0021] In one embodiment, the game may be installed on the user terminal or provided through the web accessed by the user terminal.

[0022] In one embodiment, the vehicle is an electric vehicle, and the method may further include: receiving energy state information including one or more of the vehicle's battery state of charge (SoC), charging power amount, and estimated time of completion of charging through the vehicle's infotainment system; dynamically adjusting game balancing parameters including one or more of the game's difficulty, item drop rate, or session progress speed based on the energy state information; and shortening the remaining stage length of the game or increasing the reward probability based on the estimated time of completion of charging, thereby inducing the game session to naturally end at the time of completion of charging.

[0023] In one embodiment, when entering a game mode in which the game is executed, the method may further include: receiving tilt information including pitch and roll of the vehicle from an inertial measurement unit (IMU) or gyroscope sensor equipped in the vehicle; correcting the zero-point of an operation signal including the neutral angle of the steering wheel and the initial position of the accelerator pedal or brake based on the tilt information; and applying an adaptive dead-zone filter in proportion to the magnitude of the tilt to remove vibration or mechanical noise included in the operation signal.

[0024] A computer program according to one embodiment of the present specification may be stored on a computer-readable recording medium to execute the above-described method on a computer.

[0025] An infotainment system of a vehicle according to one embodiment of the present specification can implement the method described above.

[0026]

[0027] According to the present invention, by utilizing a vehicle's driver device as a game input device, intuitive operation is possible without a separate controller, and more immersive interaction can be provided by reflecting the vehicle's driving environment signals into the game environment. Furthermore, through the linkage between the vehicle's infotainment system and the user terminal, the environment inside and outside the vehicle can be reflected in real time, thereby providing expanded usability compared to existing infotainment systems.

[0028] According to the present invention, since the execution of a game controller application can be controlled by considering the vehicle's gear status and whether the vehicle has been impacted, an environment can be provided where a game can be played inside the vehicle while maintaining safety. In addition, when the game is terminated or interrupted, the vehicle's door locking function is utilized to allow the user to clearly distinguish between the game and actual vehicle operation, thereby preventing malfunctions or confusion.

[0029] According to the present invention, by dynamically adjusting game balancing in conjunction with the battery charging status of an electric vehicle, the charging waiting time can be naturally converted into an entertainment experience. In addition, by using the vehicle's attitude sensor to correct the zero point of operation of the driver device, a precise game operation environment can be provided regardless of the terrain where the vehicle is stopped.

[0030] It should be understood that the effects of this specification are not limited to the matters described above and can be extended to various contents that can be derived from the detailed description of the embodiments of the invention below.

[0031]

[0032] FIG. 1 is a drawing illustrating an example of an operating environment of a system according to one embodiment of the present specification.

[0033] FIG. 2 is a block diagram for explaining the internal configuration of a computing device in one embodiment of the present specification.

[0034] FIG. 3 is a diagram showing the relationship between a vehicle, a server, and a user terminal according to one embodiment of the present specification.

[0035] FIG. 4 is a flowchart of a method for an infotainment system of a vehicle to provide a game based on a driver device according to one embodiment of the present specification.

[0036] FIG. 5 is a flowchart of a method for an infotainment system of a vehicle to provide a game based on a driver device according to one embodiment of the present specification.

[0037] FIG. 6 is a diagram illustrating the operation of an in-vehicle infotainment system (310) according to one embodiment of the present specification.

[0038] FIG. 7 is a block diagram schematically illustrating the data flow between a vehicle infotainment system and a user terminal according to one embodiment of the present invention.

[0039] FIG. 8 illustrates a method of operating a game on a user terminal using a game controller application of a vehicle infotainment system in another embodiment.

[0040] FIG. 9 is a diagram illustrating a method of providing a game in a vehicle infotainment system according to another embodiment of the present specification.

[0041] FIG. 10 illustrates an example in which an infotainment system of a vehicle according to one embodiment of the present specification provides a game by further utilizing environmental information of the vehicle.

[0042] In describing the embodiments of this specification, if it is determined that a detailed description of known configurations or functions could obscure the essence of the embodiments of this specification, such detailed description is omitted. Furthermore, parts of the drawings unrelated to the description of the embodiments of this specification have been omitted, and similar parts are denoted by similar reference numerals.

[0043] In the embodiments of this specification, when a component is described as being "connected," "combined," or "joined" with another component, this may include not only a direct connection but also an indirect connection in which another component exists in between. Furthermore, when a component is described as "comprising" or "having" another component, this means that, unless specifically stated otherwise, it does not exclude the other component but may include additional components.

[0044] In the embodiments of this specification, terms such as first, second, etc. are used solely for the purpose of distinguishing one component from another component and do not limit the order or importance of the components unless specifically stated otherwise. Accordingly, within the scope of the embodiments of this specification, the first component in an embodiment may be referred to as the second component in another embodiment, and likewise, the second component in an embodiment may be referred to as the first component in another embodiment.

[0045] In the embodiments of this specification, distinct components are intended to clearly explain their respective features and do not imply that the components are necessarily separated. That is, multiple components may be integrated to form a single hardware or software unit, or a single component may be distributed to form multiple hardware or software units. Therefore, such integrated or distributed embodiments are included within the scope of the embodiments of this specification, even if not otherwise mentioned.

[0046] In this specification, the term "network" may encompass both wired and wireless networks. In this context, the network may refer to a communication network where data exchange between devices, systems, and devices can be performed, and is not limited to a specific network.

[0047] The embodiments described herein may have aspects that are entirely hardware, partially hardware and partially software, or entirely software. In this specification, terms such as “unit,” “device,” or “system” refer to computer-related entities, such as hardware, a combination of hardware and software, or software. For example, in this specification, a unit, module, device, or system, etc., may be, but are not limited to, a running process, processor, object, executable, thread of execution, program, and / or computer. For example, both an application running on a computer and the computer may correspond to a unit, module, device, or system, etc., in this specification.

[0048] Furthermore, in this specification, the term "device" may refer not only to mobile devices such as smartphones, tablet PCs, wearable devices, and Head Mounted Displays (HMDs), but also to fixed devices such as PCs or home appliances equipped with display functions. Additionally, as an example, the term "device" may refer to an in-vehicle cluster or an IoT (Internet of Things) device. In other words, in this specification, the term "device" may refer to any device capable of running an application and is not limited to a specific type. For convenience of explanation, the term "device" is used below to refer to a device on which an application runs.

[0049] In this specification, the communication method of the network is not limited, and connections between each component may not be connected using the same network method. The network may include not only communication methods utilizing communication networks (e.g., mobile communication networks, wired internet, wireless internet, broadcasting networks, satellite networks, etc.) but also short-range wireless communication between devices. For example, the network may include any communication method that allows objects to network with each other and is not limited to wired communication, wireless communication, 3G, 4G, 5G, or any other method. For example, wired and / or networks include Local Area Network (LAN), Metropolitan Area Network (MAN), Global System for Mobile Network (GSM), Enhanced Data GSM Environment (EDGE), High Speed ​​Downlink Packet Access (HSDPA), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Zigbee, Wi-Fi, VoIP (Voice over Internet Protocol), LTE Advanced, IEEE802.16m, WirelessMAN-Advanced, HSPA+, 3GPP Long Term Evolution (LTE), Mobile WiMAX (IEEE 802.16e), UMB (formerly EV-DO Rev. C), Flash-OFDM, iBurst and MBWA (IEEE 802.20) A communication network may be referred to by one or more communication methods selected from the group consisting of systems, HIPERMAN, Beam-Division Multiple Access (BDMA), Wi-MAX (World Interoperability for Microwave Access) and ultrasonic communication, but is not limited thereto.

[0050] The components described in the various embodiments do not necessarily mean essential components, and some may be optional components. Accordingly, embodiments consisting of a subset of the components described in the embodiments are also included within the scope of the embodiments of this specification. Furthermore, embodiments including other components in addition to the components described in the various embodiments are also included within the scope of the embodiments of this specification.

[0051] Hereinafter, embodiments of the present specification will be examined in detail with reference to the drawings.

[0052] FIG. 1 is a diagram illustrating an example of an operating environment of a system according to an embodiment of the present specification. Referring to FIG. 1, a user device (110) and one or more servers (120, 130, 140) are connected through a network (1). FIG. 1 is an example for explaining the invention, and the number of user devices or servers is not limited to that shown in FIG. 1.

[0053] The user device (110) may be a fixed terminal or a mobile terminal implemented as a computer system. The user device (110) may be, for example, a smartphone, a mobile phone, a navigation system, a computer, a laptop, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a tablet PC, a game console, a wearable device, an IoT (Internet of Things) device, a VR (Virtual Reality) device, an AR (Augmented Reality) device, etc. For example, in the embodiments, the user device (110) may refer to one of various physical computer systems capable of communicating with other servers (120-140) via a network (1) using substantially wireless or wired communication methods.

[0054] Each server may be implemented as a computer device or a plurality of computer devices that communicate with a user device (110) via a network (1) to provide commands, code, files, content, services, etc. For example, the server may be a system that provides each service to a user device (110) connected via the network (1). As a more specific example, the server may provide the service intended by the application (e.g., providing information) to the user device (110) through an application that is a computer program installed and running on the user device (110). As another example, the server may distribute a file for the installation and operation of the above-mentioned application to the user device (110) and receive user input information to provide a corresponding service.

[0055] FIG. 2 is a block diagram for explaining the internal configuration of a computing device (200) in an embodiment of the present specification. Such a computing device (200) may be applied to a user device (110) or a server (120-140) described above with reference to FIG. 1, and each device and server may have the same or similar internal configuration by adding or excluding some components.

[0056] Referring to FIG. 2, the computing device (200) may include memory (210), a processor (220), a communication module (230), and a transceiver (240). The memory (210) is a non-transient computer-readable recording medium and may include a permanent mass storage device such as RAM (random access memory), ROM (read only memory), a disk drive, an SSD (solid state drive), or a flash memory. Here, a permanent mass storage device such as a ROM, SSD, flash memory, or a disk drive may be included in the aforementioned device or server as a separate permanent storage device distinct from the memory (210). Additionally, the memory (210) may store an operating system and at least one program code (e.g., code for a browser installed and running on a user device (110), or code for an application installed on a user device (110), etc., to provide a specific service). These software components may be loaded from a computer-readable recording medium separate from memory (210). This separate computer-readable recording medium may include computer-readable recording media such as a floppy drive, disk, tape, DVD / CD-ROM drive, memory card, etc.

[0057] In another embodiment, software components may be loaded into memory (210) via a communication module (230) rather than a computer-readable recording medium. For example, at least one program may be loaded into memory (210) based on a computer program (e.g., the application described above) that is installed by files provided through a network (1) by developers or a file distribution system (e.g., the server described above) that distributes installation files for the application.

[0058] The processor (220) may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input / output operations. Instructions may be provided to the processor (220) by memory (210) or a communication module (230). For example, the processor (220) may be configured to execute instructions received according to program code stored in a recording device such as memory (210).

[0059] The communication module (230) can provide a function for the user device (110) and the server (120-140) to communicate with each other through the network (1), and each of the device (110) and / or the server (120-140) can provide a function for communicating with other electronic devices.

[0060] The transmitting and receiving unit (240) may be a means for interfacing with an external input / output device (not shown). For example, the external input device may include devices such as a keyboard, mouse, microphone, camera, etc., and the external output device may include devices such as a display, speaker, haptic feedback device, etc.

[0061] As another example, the transmitting and receiving unit (240) may be a means for interfacing with a device in which the functions for input and output are integrated into one, such as a touchscreen.

[0062] Additionally, in other embodiments, the computing device (200) may include more components than those of FIG. 2 depending on the nature of the device to which it is applied. For example, when the computing device (200) is applied to a user device (110), it may be implemented to include at least some of the input / output devices described above, or it may include additional components such as a transceiver, a GPS (Global Positioning System) module, a camera, various sensors, a database, etc. As a more specific example, when the user device is a smartphone, it may be implemented to include additional components such as an accelerometer or gyroscope sensor, a camera module, various physical buttons, buttons using a touch panel, input / output ports, and a vibrator for vibration, which are generally included in smartphones.

[0063] The present invention relates to a technology for providing a game to a user terminal within a vehicle based on a vehicle infotainment system (devices and software installed in the vehicle). Specifically, the present invention can provide an environment in which a user can play a game by applying the driver's operation of the vehicle's driver device as user operation for the game.

[0064] FIG. 3 is a diagram showing the relationship between a vehicle, a server, and a user terminal according to an embodiment of the present specification. As shown in FIG. 3, the vehicle (300), the platform server (30), and the user terminal (400) can be connected to communicate with each other through a network. Additionally, the user terminal (40) and the vehicle (300) may be connected separately from the platform server through short-range communication.

[0065] The vehicle, platform server, and user terminal described above in FIG. 3 may be implemented by including at least a part of the configuration of the server or user device and computing device described in FIG. 1 and 2. In addition, the method of providing a game based on a driver device by an infotainment system of a vehicle, described below, may be implemented by the infotainment system of the vehicle or at least partially by a user terminal. This method may be performed by a device (infotainment system or user terminal) including memory and a processor. A processor may read instructions stored in memory to execute the method of providing a game based on a driver device by an infotainment system of a vehicle, described below.

[0066] In one embodiment, the platform server (30) may provide a game controller application to the infotainment system of a vehicle. For example, a user may install the game controller application provided by the platform server through an app store or app market using the infotainment system of the vehicle. In another example, the manufacturer of the vehicle may pre-install the game controller application. Additionally, the platform server may provide a game program to the user terminal or provide a web page for the game so that the game can be executed on the user terminal via the web. In one example, the platform server (30) may be connected to communicate with the infotainment system of the vehicle and the user terminal, respectively, to receive and process information regarding user operations (driver device operation information, input content on the user terminal, etc.). For example, the platform server (30) may receive user input values ​​on the game controller application running on the infotainment system of the vehicle via data communication and provide them to the user terminal via data communication. However, this is merely an example, and as will be described later, information may be exchanged between the infotainment system of the vehicle and the user terminal via short-range communication (e.g., Bluetooth).

[0067] A game controller application may be a program that controls input and output for any game performed on a vehicle's infotainment system. For example, the game controller application may receive touchscreen input, voice input, or driver device operation information on a display device that displays the vehicle's infotainment, and apply it to a game running in the vehicle.

[0068] In FIG. 3, the user terminal (400) can be any device capable of communicating and equipped with a display device, such as a smartphone, tablet, or laptop.

[0069] FIG. 4 is a flowchart of a method for an infotainment system of a vehicle to provide a game based on a driver device according to an embodiment of the present specification. Referring to FIG. 4, the method for an infotainment system of a vehicle to provide a game based on a driver device includes the step of receiving a vehicle operation signal from the driver device of the vehicle through a vehicle game controller application installed in the infotainment system of the vehicle (S100), and the step of transmitting the vehicle operation signal through the vehicle game controller application to a user terminal located inside the vehicle (S200).

[0070] The driver device of the vehicle described above may include one or more of a steering wheel, an accelerator pedal, a brake, and a gear, but the present invention is not limited thereto. A key feature of the present invention is that the act of a user operating the driver device is provided as input for a game. Specifically, the vehicle's infotainment system may receive operation signals from the vehicle's driver device and provide them to a vehicle game controller application. The operation signals from the driver device may be transmitted via a CAN (Controller Area Network) bus within the vehicle, or transmitted to the vehicle's infotainment system via an OBD-II (On-Board Diagnostics) port or an API of the vehicle's infotainment system. The vehicle's infotainment system may provide the vehicle's operation signals to a user terminal within the vehicle through a vehicle game controller application installed on the system (or without a game controller application). The operation signals may be provided directly to the user terminal via short-range communication from the vehicle's infotainment system, or provided to the user terminal via a platform server.

[0071] That is, in the present specification, the operation signal of the vehicle may be related to one or more of steering wheel steering, accelerator pedal position, brake state, and gear state. Depending on the angle at which the user rotates the steering wheel, the game controller application may generate a command to move the game character or user viewpoint provided to the user terminal. Similarly, the game character or user viewpoint may be changed to correspond to the position (or intensity, etc.) of the accelerator pedal, the brake state, and the gear state. Here, the character may be an anthropomorphic robot, a person, or a vehicle, and the user viewpoint may be an arbitrary viewpoint inside the vehicle or of an anthropomorphic object. For example, when playing a racing game, the user may play the racing game while operating the actual driver device of the vehicle.

[0072] FIG. 5 is a flowchart of a method for a vehicle infotainment system to provide a game based on a driver device according to an embodiment of the present specification. Referring to FIG. 4, the method for a vehicle infotainment system to provide a game based on a driver device may include the steps of: receiving a vehicle operation signal from the vehicle driver device through a vehicle game controller application installed in the vehicle infotainment system (S100); transmitting the vehicle operation signal through the vehicle game controller application to a user terminal located inside the vehicle (S200); the user terminal executing the game (S300); and playing the game based on the operation signal (S400). That is, a game installed on a user terminal or executed through the web of a user terminal can be controlled based on a vehicle operation signal received from the vehicle infotainment system.

[0073] Execution of a game according to one embodiment of the present specification may include, first, a step of a user installing a game program on a user terminal or accessing a URL related to the game to execute a game (regardless of type, such as a racing game, a racing game, etc.) on the user terminal; a step of setting up input means for the executed game to be received from the infotainment system of a vehicle; and a step of playing the game based on a vehicle control signal received directly or indirectly from the infotainment system of a vehicle according to the setting. These steps may be implemented on the user terminal.

[0074] The function of the vehicle's infotainment system sending vehicle operation signals to a user terminal can be performed by the vehicle's game controller application. In one example, the vehicle game controller application is executed when the vehicle is in a stationary state and may be automatically terminated when the vehicle moves or is in a state of being ready to move. Here, the state of being ready to move may include cases where the vehicle's gear is in the D or R state, or when the movement of a vehicle ahead is detected.

[0075] A vehicle infotainment system according to one embodiment of the present specification provides a function of using a vehicle's driver device (e.g., steering wheel, brake, accelerator pedal, gear) as a game controller so as to enjoy a game in the vehicle. However, when using such a driver device as a game controller, it is necessary to prevent the risk of the actual vehicle moving or being manipulated unintentionally.

[0076] To this end, the vehicle infotainment system of the present embodiment blocks the transmission of operation signals from the driver's devices (steering wheel, brake pedal, accelerator pedal, gear lever, etc.) to the actual vehicle's drive systems (e.g., front wheel steering device, brake pad actuation device, wheel rotation speed control device, gear change device, etc.) when a vehicle game controller application is executed within the vehicle or when a game is started from said application. In other words, even if the driver turns the steering wheel or presses the pedals, such operation is ensured not to affect the actual vehicle's movement or changes in state.

[0077] To technically implement this, the vehicle infotainment system transmits a "request to block driver device operation signals" to the vehicle's main control unit (MCU: Microcontroller Unit) or the vehicle control unit. This request serves to change the settings so that the vehicle's MCU does not connect the driver device signals to the actual vehicle drive system. In other words, when the vehicle's infotainment system enters "game mode," the vehicle's MCU switches the vehicle to "game control mode," and thereafter, all driver operations are reflected only in the game and do not affect the actual vehicle's operation.

[0078] Meanwhile, for safety reasons, gameplay is not permitted even if the vehicle game controller application is launched when the vehicle is in actual operation or when the transmission is in forward (D) or reverse (R) gear. In this case, the infotainment system provides the user with a notification message such as "Game play is not possible while driving," thereby preventing safety accidents in advance.

[0079] FIG. 6 is a diagram illustrating the operation of an in-vehicle infotainment system (310) according to an embodiment of the present specification. Referring to FIG. 6, operation signals (c11-c14) from various driver devices are input to the infotainment system (310) of the vehicle. Here, the operation signals may include one or more of a steering wheel steering angle, a brake pad position, an accelerator pedal position, and a gear position. The infotainment system (310) may provide various content including vehicle information through its own display (320). In the present specification, the infotainment system (310) of the vehicle may provide one or more of the received operation signals (c11-c14) to a user terminal (400).

[0080] In one embodiment, a user terminal may have a user game controller application installed that links with the vehicle game controller application. Here, the vehicle or user game controller application may refer to any service application that manages the input and output (game result value) of a game implemented on a device, such as Xbox Cloud or Google Games. Such a game controller application may link with the OS of the device on which each application is installed to receive and process input signals from an external device. In one embodiment, the user game controller application may control operation signals for an application belonging to the game category among the applications running on the user terminal. Additionally, the user game controller application may perform the function of applying vehicle operation signals received from the vehicle's infotainment system to the game.

[0081] Meanwhile, in another embodiment, the user game controller application described above may not be installed on the user terminal, and in this case, control signals may be provided directly to the game on the user terminal through the OS of the user terminal. For example, the user terminal may apply the vehicle control signals received from the infotainment system of the vehicle to the game through the operating system of the user terminal without passing through a separate game controller application. As an example, the vehicle infotainment system may be recognized as a type of Bluetooth game controller, and the received control signals may be applied to the game running on the user terminal.

[0082] Thus, control signals applied to the game on the user terminal can cause changes in the in-game character or the user view. For example, the movement or action of the in-game character may be controlled based on the control signals of the vehicle.

[0083] FIG. 7 is a block diagram schematically illustrating the data flow between a vehicle infotainment system and a user terminal according to an embodiment of the present invention. According to FIG. 7, an operation signal in which a driver operates a driver device within the vehicle's infotainment system is processed through a game controller application of the vehicle, and this operation signal can be transmitted to a user terminal via short-range communication or data communication. The user can play a game using the operation signal on a user terminal such as a smartphone, tablet, or laptop, and various driver input devices inside the vehicle function as game controllers.

[0084] Referring further to FIG. 7, the main components of a vehicle infotainment system may include a Board Support Package (BSP), an Operating System (OS), In-Vehicle Infotainment (IVI), and a vehicle game controller application. The BSP acts as an interface between hardware and software, and the OS can provide an environment that enables applications within the vehicle to run. The IVI is a system that provides various content through an in-vehicle display device, and in the present invention, it is utilized as a platform for receiving game operation inputs. The vehicle game controller application can perform the core function of analyzing the driver's operation signals in real time and converting them into game inputs.

[0085] The structure of a user terminal is illustrated on the left side of Fig. 7, and the user terminal also includes a BSP, an OS, and a user game controller application. The user can run the game through a device such as a smartphone or tablet and move a character or object within the game based on control signals received from the vehicle. The game execution environment can be implemented as a local application or a web-based environment, and is designed so that the user can enjoy the game by utilizing the vehicle's control devices without connecting a separate game controller. Additionally, even in the absence of a vehicle game controller application, control signals can be transmitted directly to the game through the operating system.

[0086] Referring to FIG. 7, in-vehicle operation signals (c11–c14) are processed by the infotainment system and then transmitted to a user terminal via short-range communication (e.g., Bluetooth) or data communication (e.g., Wi-Fi, Internet). These operation signals may include input values ​​such as steering wheel steering, accelerator pedal input, brake operation, and gear change, and are converted into input values ​​for a game running on the user terminal. Through this method, the user can experience a new interface for operating the game from the driver's seat and can enhance the immersion of the game.

[0087] One characteristic element of the present invention is that the vehicle's control signals can be utilized like a conventional game controller, which allows for the expansion of entertainment functions within the vehicle. In particular, through the structure presented in FIG. 7, organic interoperability between the vehicle's infotainment system and the user terminal is possible, and it also provides expandability to utilize various sensor data within the vehicle for game control. For example, applications such as utilizing the vehicle's gear shift signals for switching game modes or converting steering wheel operation into a racing game control method are possible. This enhances the in-vehicle entertainment experience and allows the user to control the game more intuitively.

[0088] FIG. 8 illustrates another embodiment of the present invention, describing a method of controlling a game on a user terminal using a game controller application of a vehicle infotainment system. The difference from FIG. 7 is that a separate game controller application is not installed on the user terminal, and the vehicle infotainment system itself performs the role of a game controller. When the driver of the vehicle operates the steering wheel, accelerator pedal, brake, etc., the corresponding signal is analyzed through the API of the vehicle infotainment system. The analyzed operation signal is converted so that it can be recognized as a single controller (joystick), and this conversion process is performed by the vehicle infotainment game controller application. The converted signal is transmitted to the user terminal via Bluetooth, allowing the game to be played through the vehicle's driving device without a separate game controller. During game execution, the user terminal can receive the vehicle's operation signal as an input value via a Bluetooth connection.

[0089] In one embodiment, a game controller application of a vehicle infotainment system may provide a function to connect with a user terminal via Bluetooth. Through this, vehicle control signals can be converted into standard game controller input values ​​and transmitted to the user terminal. Vehicle steering wheel operation is converted into left and right movement signals for a joystick, and the accelerator pedal and brake can be mapped to forward and reverse signals for the joystick, respectively. While the vehicle is being operated, the corresponding control values ​​are transmitted in real time and utilized as inputs responsible for character movement or vehicle operation within the game. The vehicle infotainment system is designed to maintain a Bluetooth connection and enable stable data transmission. The game controller application can be downloaded and installed through the vehicle's app store, and the user can easily configure it within the vehicle.

[0090] A characteristic feature of this embodiment is that it includes a function for the vehicle to switch to game mode. When the vehicle game controller application is executed, the vehicle automatically maintains a park (P) state, and the game is executed only when the vehicle is stationary. If the vehicle moves or the gear is released from the park state, the game controller application can be terminated immediately. This prevents the risk of the user playing a game while operating the vehicle for actual driving, and ensures that the in-vehicle game function is provided safely. The safety of the present invention is ensured through a structure that activates the game controller function only when the vehicle is completely stopped. All signals operated by the driver inside the vehicle are converted into game controller input values, and unnecessary accidents can be prevented by deactivating the corresponding function while driving.

[0091] From the perspective of the user terminal, a feature of the present invention is that games can be controlled directly through the vehicle's infotainment system without the need to install a separate game controller application. The user terminal connects to the vehicle's controller function via Bluetooth, and the game app running internally recognizes the vehicle controller as an input device. Therefore, games can be controlled using only the vehicle's internal devices without the need for a separate external controller. The method of inputting control signals via Bluetooth connection is simpler than existing wired or separate controller methods and can enhance the user experience. Users can proceed with the game using the vehicle's control devices, and safety can be guaranteed as the game is executed only under specific conditions. Through this structure, the vehicle's infotainment system acts as a game controller, enabling close integration between the vehicle and the user terminal.

[0092] FIG. 9 is a diagram illustrating a method of providing a game in a vehicle infotainment system according to another embodiment of the present specification. Referring to FIG. 9, the user terminal does not directly execute the game but simply performs the role of displaying a game screen generated by a vehicle game controller application. That is, the game is executed in the infotainment system inside the vehicle, and the user terminal receives it via streaming and displays it on the screen. This method can be designed to allow the use of a larger screen or an auxiliary screen while enjoying the game inside the vehicle.

[0093] For example, the connection between the vehicle infotainment system and the user terminal can be established via Bluetooth, Wi-Fi, or data communication. Since the user terminal acts as a simple display, it does not perform additional computations or control signal processing related to game execution. This allows the system for running games within the vehicle to be configured more simply.

[0094] In addition, according to the embodiment described in FIG. 9, the user terminal is characterized by not performing any role related to game operation. Unlike a general game system, in this embodiment, a vehicle game controller application executes the game, and the user terminal is utilized merely as an auxiliary device to display the screen. This allows for a more stable gaming environment to be provided inside the vehicle, and all operations and computational processing are performed by the vehicle's infotainment system. The mirroring function transmits the game screen in real time, allowing the user to view or enjoy the game more conveniently. For example, a passenger can view the game screen on the user terminal, thereby providing a better viewing experience. Furthermore, since the user terminal performs only the role of displaying the game screen, battery consumption is low, and the game screen inside the vehicle can be easily shared without the installation of additional applications. Through this, the present invention provides a more flexible gaming environment inside the vehicle and enables more efficient implementation of the connection between the in-vehicle display and the user terminal.

[0095] FIG. 10 illustrates an example in which an infotainment system of a vehicle according to an embodiment of the present specification further utilizes environmental information of the vehicle to provide a game. Referring to FIG. 10, the infotainment system of the vehicle receives a driving environment signal from a driving environment device within the vehicle and can apply this to a game running on a user terminal. Various sensors are arranged inside the vehicle and may include a rain detector, a seat angle adjustment sensor, a temperature and humidity detection sensor, a light detection sensor, etc. These sensors are connected to the vehicle's infotainment system to provide real-time information on the vehicle's current driving and environment. A vehicle game controller application receives this sensor data and transmits it to the user terminal, enabling dynamic operation in the game in response to environmental changes. For example, if rain is detected, the environment within the game changes to rain, or the brightness of the game screen (not the brightness of the user terminal's display, but the brightness of the virtual space within the game; for example, if the interior of the vehicle becomes dark, the virtual space within the game becomes night) can be automatically adjusted according to the brightness of the vehicle's interior lighting. Through this, the actual environment of the vehicle is reflected in the game, enabling more immersive gameplay. In addition, the vehicle's infotainment system can process input values ​​such as the steering wheel, brake, and accelerator pedal operated by the driver, along with data measured through internal vehicle sensors. As illustrated in FIG. 10, the infotainment system (310) receives driving environment signals (c11–c14) of the vehicle and transmits them to a user terminal (400) via a game controller application. These driving environment signals are information reflecting the state inside the vehicle and can be utilized to perform various functions in a game running on the user terminal. For example, a seat angle sensor can detect the user's seating position and apply it to changes in the game character's posture. Additionally, if an internal humidity sensor detects high humidity, it can provide an effect that blurs the environment within the game.By utilizing vehicle driving environment data in this way, it is possible to move away from existing simple game control methods and provide more realistic interactions.

[0096] According to the embodiment described in FIG. 10, external environmental data of the vehicle can have a direct impact on gameplay. Referring to FIG. 10, a rain detection sensor detects rainfall, allowing the detected data to be applied as weather changes within the game. That is, if the actual vehicle detects rain, the environment within the game can change to one where it is raining, and accordingly, the character's movement or road conditions may change. Additionally, if an external light sensor detects a dark environment, the field of view within the game may be reduced, or graphic settings may be automatically adjusted to match the lighting conditions inside the vehicle. By reflecting the external environment of the vehicle in the game in this way, the user can play in a more realistic game environment.

[0097] In this specification, the vehicle infotainment system performs the function of not merely collecting driving environment signals, but processing them to suit the game and transmitting them to the user terminal. The vehicle game controller application can analyze sensor data, convert it into in-game variables, and synchronize it with the user terminal. For example, if the vehicle interior temperature sensor detects that the interior temperature is high, the environment can be set so that the in-game character experiences hot weather. Conversely, if the interior of the vehicle is too cold, an effect can be added where the in-game character feels the cold and becomes sluggish. This integration can provide a new experience that goes beyond simple physical manipulation, allowing the environment inside and outside the vehicle to naturally fuse into the game.

[0098] According to another embodiment of this specification, the method is preferably implemented based on an infotainment system of an electric vehicle, but it may also be applied to hybrid vehicles or internal combustion engine vehicles. Even if the vehicle's power source differs, the method of providing a game utilizing the driver device, control signals, and infotainment system inside the vehicle can be applied in the same way. For example, in an internal combustion engine vehicle, accelerator pedal operation signals or gear shift signals can be utilized as input values ​​for the game. Furthermore, in the case of a hybrid vehicle, the switching state between the engine and the electric motor can be detected and reflected as a special event within the game. Although the characteristics of driver control signals may differ depending on the specific vehicle type, the system of the present invention is designed to provide the same user experience in various vehicle environments by taking this into account. This structure enables the vehicle's infotainment system to be used universally regardless of the vehicle type.

[0099] In another embodiment of the present invention, not only signals operated by the driver but also the current setting status of the driver device can be reflected in the game environment. For example, the angle of the vehicle's seat backrest and the distance to the steering wheel can be utilized to adjust the game character's viewpoint or set the seat position. Through this, the user can experience more intuitive gameplay while reflecting the driver device settings in reality. Conversely, the state of the vehicle's driver device can also be automatically adjusted based on the game settings. For example, in a specific game mode, the seat can be automatically adjusted to allow the user to enjoy the game in a more comfortable posture. By interconnecting the physical environment inside the vehicle with the game environment in this way, a more realistic gaming experience can be provided.

[0100] If the vehicle's gear status changes during gameplay, the vehicle game controller application can be configured not to terminate by default. In other words, even if the vehicle's gear shifts to D (Drive) or R (Reverse), the game controller application continues to run and process control signals. However, if the vehicle is impacted during gameplay, the game controller application may automatically terminate or the processing of control signals may be suspended for safety reasons. Impact detection can be performed via the vehicle's acceleration sensor or collision detection sensor, and game input may be automatically blocked if an impact exceeding a certain level is detected. This prevents risks associated with running the game while driving, while still providing a smooth gaming experience when the vehicle is stationary.

[0101]

[0102] When gameplay ends or is interrupted, the vehicle's door locking function may be activated one or more times. This feature helps users clearly distinguish between the actual driving state of the vehicle and the gameplay state. For example, when the game ends, the vehicle doors automatically lock and then unlock, allowing the driver to intuitively recognize that the vehicle has switched to actual driving mode. This function can be performed by linking the vehicle's infotainment system with the vehicle's door lock control system, serving to prevent the driver from confusing the game with the actual operation of the vehicle. Additionally, if specific security settings are applied, the doors may remain locked after the game ends to prevent unauthorized entry or malfunctions. Through these features, the vehicle's gaming environment and actual driving environment are separated, enabling the implementation of a safer system.

[0103] According to another embodiment of the present specification, when the vehicle is an electric vehicle, the vehicle's infotainment system may receive energy state information from the vehicle's battery management system (BMS) and reflect it in a game environment. Here, the energy state information may include one or more of the battery state of charge (SoC), current charging power (kW), and estimated time to complete charging. This energy state information may be provided to a vehicle game controller application via the vehicle's CAN bus or an API of the infotainment system.

[0104] The vehicle game controller application can dynamically adjust game balancing parameters based on received energy status information. Specifically, the game balancing parameters may include one or more of the game difficulty, item drop rate, and session progression speed. For example, during the initial charging phase when the battery SoC is low (e.g., SoC 20% or less), the game difficulty can be relatively lowered and the item drop rate increased to allow the user to easily enter the game. As charging progresses and the SoC increases, the game difficulty can be gradually increased to maintain the user's immersion.

[0105] In particular, the vehicle game controller application can dynamically adjust the length of the remaining stage of the game based on the estimated time to complete charging. For example, if the time remaining until charging is less than 10 minutes, the length of the currently ongoing game stage can be shortened or the probability of obtaining rewards (e.g., the probability of acquiring a bonus item or the probability of winning a reward) can be increased, thereby encouraging the user to naturally end the game session when charging is complete. Through this, the physical constraint of charging waiting time is naturally integrated as part of the game, and the user can smoothly transition to driving mode after charging is complete.

[0106] In one embodiment, the adjustment of game balancing parameters may be performed within the vehicle's infotainment system or on the user terminal side based on energy status information transmitted to the user terminal. Additionally, an implementation is possible in which a platform server receives energy status information, calculates game balancing parameters, and provides the result to the user terminal.

[0107] The energy state-linked game balancing according to the present embodiment can transform the user experience constraint of waiting time for electric vehicle charging into a positive factor that induces participation in the game. In addition, by inducing the game session to end at the time of charging completion, it enables the user to naturally transition from gameplay to driving the vehicle. This provides an in-vehicle entertainment experience specialized for the charging environment of an electric vehicle.

[0108] According to another embodiment of the present specification, when entering game mode, the infotainment system of a vehicle receives attitude information of the vehicle using an inertial measurement unit (IMU) or a gyroscope sensor equipped in the vehicle, and can utilize this information to correct the operation signals of the driver device. When the vehicle is stopped on an inclined road surface or an uneven surface, the pitch and roll of the vehicle may differ from the horizontal state. Such tilting may cause slight deviations in the physical neutral position of the steering wheel, the initial position of the accelerator pedal, and the brake.

[0109] To address this, the vehicle game controller application can receive pitch and roll values ​​from the vehicle's IMU or gyroscope sensor at the start of the game mode. Based on the received tilt information, the vehicle game controller application can reset the zero-point of the control signal by correcting the neutral angle of the steering wheel and the initial position of the accelerator pedal or brake. For example, if the vehicle is stopped while tilted 2 degrees to the left, the neutral position of the steering wheel can be compensated by 2 degrees to correct the in-game character or vehicle to move straight without the user operating the steering wheel.

[0110] Additionally, the vehicle game controller application can apply an adaptive dead-zone filter proportional to the vehicle's tilt angle. The dead-zone filter serves to eliminate input errors caused by vehicle vibration or mechanical noise by ignoring minute variations in the control signal below a certain range. Since greater tilt angles increase the vehicle's physical instability and can lead to increased vibration and noise, the dead-zone range can be expanded proportionally to the tilt. Conversely, when the vehicle is near a horizontal position, the dead-zone range is reduced to allow the user's fine control inputs to be reflected in the game.

[0111] In one embodiment, the application of zero point correction and dead zone filter may be performed once upon entering game mode, or may be updated periodically during gameplay. For example, since the tilt of the vehicle may change due to changes in the number of passengers in the vehicle or fluctuations in the external environment (e.g., wind), the vehicle game controller application may receive tilt information at regular intervals (e.g., 1 to 5 seconds) to update the zero point and dead zone.

[0112] The zero-point correction and adaptive dead zone filter according to the present embodiment enable the provision of a precise control environment comparable to that of a console game controller, regardless of the terrain on which the vehicle is stopped. In the configuration of the present invention, which utilizes the vehicle's actual driver device as a game controller, by correcting control deviations and noise caused by the vehicle's stopping posture, the user can obtain a consistent gameplay experience regardless of the parking environment.

[0113]

[0114] A computer program according to one embodiment of the present specification includes instructions for executing the above-described method on a computer and may be stored on a computer-readable recording medium.

[0115] In addition, an infotainment system of a vehicle according to one embodiment of the present specification can implement the methods described above at least partially.

[0116] The embodiments described above may be implemented at least partially as computer programs and recorded on computer-readable recording media. Computer-readable recording media on which programs for implementing the embodiments are recorded include all types of recording devices in which data readable by a computer is stored. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, optical data storage devices, etc. Additionally, computer-readable recording media may be distributed across networked computer systems, so that computer-readable code is stored and executed in a distributed manner. Furthermore, functional programs, codes, and code segments for implementing the embodiments will be readily understood by a person skilled in the art to which the embodiments pertain.

[0117] Although the present specification described above has been explained with reference to the embodiments illustrated in the drawings, this is merely illustrative and those skilled in the art will understand that various modifications and variations of the embodiments are possible therefrom. However, such modifications should be considered to be within the technical scope of protection of the present specification. Accordingly, the true technical scope of protection of the present specification should be determined to include other implementations, other embodiments, and equivalents to the claims based on the technical spirit of the appended claims.

[0118]

[0119]

[0120] According to the present invention, by utilizing the vehicle's driver device as a game input device, intuitive operation is possible without a separate controller, and by reflecting the vehicle's driving environment signals into the game environment, more immersive interaction can be provided.

Claims

1. A method for a vehicle infotainment system to provide a game based on a driver device, wherein the method comprises: A step of receiving a vehicle operation signal from the driver device of the vehicle through a vehicle game controller application installed in the infotainment system of the vehicle; and A method for a vehicle infotainment system to provide a game based on a driver device, comprising the step of transmitting a vehicle operation signal to a user terminal located inside the vehicle through the vehicle game controller application.

2. In Paragraph 1, A method for a vehicle infotainment system to provide a game based on a driver device, characterized in that the vehicle game controller application is executed when the vehicle is in a stationary state and automatically terminates when the vehicle is moving or ready to move.

3. In Paragraph 1, A method for an infotainment system of a vehicle to provide a game based on a driver device, characterized in that the operation signal of the vehicle is related to one or more of steering wheel steering, accelerator pedal position, brake state, and gear state.

4. In Paragraph 1, The above user terminal executes the above game, and A method for a vehicle infotainment system to provide a game based on a driver device, characterized in that the above game is controlled based on a vehicle operation signal received from the vehicle infotainment system.

5. In Paragraph 4, The above user terminal has a user game controller application installed that links with the above vehicle game controller application, and The above user game controller application controls operation signals for applications belonging to the game category among applications running on the user terminal, and A method for a vehicle infotainment system to provide a game based on a driver device, characterized in that the above user game controller application applies a vehicle operation signal received from the vehicle infotainment system to the game.

6. In Paragraph 4, A method for a vehicle infotainment system to provide a game based on a driver device, characterized in that the user terminal applies a vehicle operation signal received from the vehicle infotainment system to the game through the operating system of the user terminal without passing through a separate game controller application.

7. In Paragraph 4, A method for a vehicle infotainment system to provide a game based on a driver device, characterized in that the movement or action of a character within the game is controlled based on a control signal of the vehicle.

8. In Paragraph 1, A step of receiving a vehicle driving environment signal from a vehicle driving environment device through a vehicle game controller application installed in the vehicle's infotainment system; and The method further includes the step of transmitting a driving environment signal of the vehicle to a user terminal located inside the vehicle through the vehicle game controller application, The above driving environment device includes one or more of a rain detector, a seat angle, an interior / exterior vehicle thermometer, an interior / exterior vehicle hygrometer, and an interior vehicle light detection sensor, and The above user terminal executes the above game, and A method for a vehicle infotainment system to provide a game based on a driver device, characterized in that the above game is controlled based on vehicle operation signals and driving environment signals received from the vehicle infotainment system.

9. In Paragraph 1, The above game runs on the infotainment system of the above vehicle, and A method for a vehicle infotainment system to provide a game based on a driver device, characterized in that the game being executed is displayed on the user terminal through mirroring.

10. In Paragraph 1, A method for a vehicle infotainment system to provide a game based on a driver device, characterized in that the above game is installed on the user terminal or provided through a web accessed by the user terminal.

11. In Paragraph 1, The above vehicle is an electric vehicle, and The above method is, A step of receiving energy status information including one or more of the battery charge status, charge power amount, and estimated time of completion of charging of the vehicle through the infotainment system of the vehicle; A step of dynamically adjusting game balancing parameters including one or more of the game difficulty, item drop rate, or session progress speed based on the energy state information; and A method for a vehicle infotainment system to provide a game based on a driver device, characterized by further including a step of shortening the remaining stage length of the game or increasing the reward probability based on the estimated time of charging completion, so that the game session naturally ends at the time of charging completion.

12. In Paragraph 1, The above method is, When entering a game mode in which the above game is executed, a step of receiving tilt information including pitch and roll of the vehicle from an inertial measurement unit (IMU) or gyroscope sensor equipped in the vehicle; A step of correcting the zero-point of an operation signal, including the neutral angle of the steering wheel and the initial position of the accelerator pedal or brake, based on the above-mentioned inclination information; and A method for a vehicle infotainment system to provide a game based on a driver device, characterized by further including the step of removing vibration or mechanical noise included in the operation signal by applying an adaptive dead zone filter in proportion to the magnitude of the slope.

13. A computer program stored on a computer-readable recording medium for executing a method described in any one of paragraphs 1 through 12 on a computer.

14. An infotainment system of a vehicle that implements a method according to any one of paragraphs 1 through 12.

Images