Method and device for generating a personalized image of a vehicle interior for videoconferencing
The method generates a personalized virtual background for vehicle interiors during videoconferencing by using three-dimensional modeling and customizable virtual objects, addressing privacy concerns and enhancing user experience.
Patent Information
- Application Number
- FR2023015014
- Authority / Receiving Office
- FR · FR
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-12-22
- Publication Date
- 2025-06-27
- Estimated Expiration
- 2043-12-22
AI Technical Summary
Existing videoconferencing technologies struggle to provide personalized and interactive virtual backgrounds for vehicle interiors, leading to privacy concerns when third parties or personal objects are visible in the camera's field of view.
A method and device for generating a personalized image of a vehicle interior by receiving data from a camera, determining a background mask, and using three-dimensional modeling with customizable virtual objects to create a virtual interior image that can replace the actual background in real-time.
This solution allows for the creation of a personalized and interactive virtual background for videoconferencing, ensuring privacy by removing unwanted elements from the vehicle interior and providing a customizable environment that enhances user experience.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Title of the invention: Method and device for generating a personalized image of a vehicle interior for videoconferencing Technical field
[0001] The present invention relates to methods and devices for generating a personalized image of a vehicle interior, in particular a motor vehicle. The present invention also relates to a method and a device for creating a personalized virtual background embedded in an image acquired by a camera. Technological background
[0002] The practice of videoconferencing or video calling is becoming increasingly common, both in private life and in professional settings. It is increasingly common for a person to conduct a videoconference from their vehicle. Indeed, a vehicle interior forms an ideal environment for this practice because many pieces of equipment necessary to establish a videoconference are available in a vehicle, for example a camera and a microphone to acquire images and sounds from the user and a screen and speakers to reproduce an image and sounds from interlocutors. In addition, a passenger compartment allows for a certain soundproofing and isolation of the user.
[0003] The camera mounted in a vehicle in particular acquires images including both the interlocutor and the passenger compartment of the vehicle. However, it happens that other people are present in the passenger compartment of the vehicle and / or that the passenger compartment of the vehicle contains personal objects of the user or other users of the vehicle. In order to respect the privacy of the user, it is then appropriate to remove a background from the image acquired by the on-board camera so as not to transmit images containing these third parties or these personal objects.
[0004] Many software programs or applications then offer to apply a virtual background generated from images in a background library. However, these images are not sufficiently representative of the user's environment, i.e. the interior of the vehicle's passenger compartment. Summary of the present invention
[0005] An object of the present invention is to solve at least one of the drawbacks of the technological background.
[0006] Another object of the present invention is to offer a user the possibility of creating a personalized and interactive background usable for video conferences.
[0007] According to a first aspect, the present invention relates to a method for generating a personalized image of a vehicle interior for videoconferencing, the method comprising the following steps: - reception of first data representative of a first image acquired by a camera of the passenger compartment, the first image representing a part of the passenger compartment and an occupant participating in the videoconference; - determination, from the first data, of second data representative of a background mask associated with the part of the first image representing the passenger compartment; - reception of third data representative of a model of a virtual cabin in three dimensions; - receipt of fourth data representative of personalized parameters applicable to the modeling; - generation of fifth data representative of a second image of the virtual interior from a point of view corresponding to a point of view of the camera from the third and fourth data; - generation of sixth data representative of a third image from the first, second and fifth data.
[0008] According to a variant of the method, a pixel of the third image has the value: - a value associated with a pixel of the first image when the pixel of the third image is not included in the background mask, or - a value associated with a pixel of the second image when the pixel of the third image is included in the background mask.
[0009] According to another variant of the method, the virtual cabin comprises virtual objects from a library of virtual objects.
[0010] According to an additional variant of the method, the virtual objects belong to a set of virtual objects comprising: - a window, - a roof sky, - a seat or bench, - seat belts, - light sources, and - accessories.
[0011] According to another variant of the method, the fourth data are received from a human-machine interface.
[0012] According to another variant of the method, the fourth data belong to a set of data comprising: - a visibility index, - a transparency index, - a color, - a texture, - a size, - an orientation, and - a three-dimensional position.
[0013] According to yet another variant, the method further comprises receiving lighting data, the generation of the fifth data furthermore being a function of the lighting data.
[0014] According to a second aspect, the present invention relates to a method device for generating a personalized image of a vehicle interior, the device comprising a memory associated with a processor configured for implementing the steps of the method according to the first aspect of the present invention.
[0015] According to a third aspect, the present invention relates to a vehicle, for example of the automobile type, comprising a device as described above according to the second aspect of the present invention.
[0016] According to a fourth aspect, the present invention relates to a computer program which comprises instructions adapted for executing the steps of the method according to the first aspect of the present invention, in particular when the computer program is executed by at least one processor.
[0017] Such a computer program may use any programming language, and be in the form of source code, object code, or intermediate code between source code and object code, such as in a partially compiled form, or in any other desirable form.
[0018] According to a fifth aspect, the present invention relates to a computer-readable recording medium on which is recorded a computer program comprising instructions for carrying out the steps of the method according to the first aspect of the present invention.
[0019] On the one hand, the recording medium may be any entity or device capable of storing the program. For example, the medium may comprise a storage means, such as a ROM memory, a CD-ROM or a microelectronic circuit type ROM memory, or a magnetic recording means or a hard disk.
[0020] Furthermore, this recording medium may also be a transmissible medium such as an electrical or optical signal, such a signal being able to be conveyed via an electrical or optical cable, by conventional or hertzian radio or by self-directed laser beam or by other means. The computer program according to the present invention may in particular be downloaded from an Internet-type network.
[0021] Alternatively, the recording medium may be an integrated circuit in which the computer program is incorporated, the integrated circuit being adapted to execute or for use in carrying out the process in question. Brief description of the figures
[0022] Other characteristics and advantages of the present invention will emerge from the description of the particular and non-limiting exemplary embodiments of the present invention below, with reference to the appended figures 1 to 4, in which:
[0023] [Fig-1] schematically illustrates a passenger compartment of a vehicle, according to an example of particular and non-limiting embodiment of the present invention;
[0024] [Fig.2] illustrates a flowchart of the different stages of a generation process of a personalized image of a passenger compartment of the vehicle of [Fig.l] for videoconferencing, according to a particular and non-limiting exemplary embodiment of the present invention; and
[0025] [Fig.3] schematically illustrates a device configured to generate an image per sonalized from a passenger compartment of the vehicle of [Fig.l] for videoconferencing, according to a particular and non-limiting exemplary embodiment of the present invention. Description of the exemplary embodiments
[0026] A method and a device for generating a personalized image of a vehicle interior for videoconferencing will now be described in the following with joint reference to Figures 1 to 3. The same elements are identified with the same reference signs throughout the description which follows.
[0027] The terms "first(s)", "second(s)" (or "first(s)", "second(s)"), etc. are used in this document by arbitrary convention to enable different elements (such as operations, means, etc.) implemented in the embodiments described below to be identified and distinguished. Such elements may be distinct or correspond to a single element, depending on the embodiment.
[0028] According to a particular and non-limiting example of embodiment of the present invention, a method and a device for generating a personalized image of a vehicle interior for videoconferencing
[0029] Indeed, the method comprises receiving first data representative of a first image acquired by a camera of the passenger compartment of the vehicle, the first image representing a part of the passenger compartment and an occupant participating in the videoconference, and determining second data representative of a background mask associated with the part of the first image representing the passenger compartment.
[0030] The method also comprises receiving third data representative of a modeling of a virtual passenger compartment in three dimensions, receiving fourth data representative of personalized parameters applicable to the modeling and generating fifth data representative of a second image of the virtual passenger compartment from a point of view corresponding to that of the camera.
[0031] Sixth data representative of a third image are then generated from the first, second and fifth data.
[0032] Such a method or device makes it possible to replace the background of an image acquired by the camera of the vehicle interior with a customizable three-dimensional virtual background. Thus, only the occupant of the vehicle is actually visible in the third image, his environment in this third image being generated virtually and according to his preferences.
[0033] [Fig. 1] schematically illustrates a passenger compartment of a vehicle 10, according to a particular and non-limiting exemplary embodiment of the present invention.
[0034] The vehicle corresponds for example to a vehicle with a thermal engine, with electric motor(s) or even a hybrid vehicle with a thermal engine and one or more electric motors. The vehicle thus corresponds for example to a land vehicle, for example a car, a truck, a bus.
[0035] The passenger compartment 10 of the vehicle comprises one or more rows of seats or benches on which one or more occupants 100 are installed. According to a particular exemplary embodiment, an occupant 100 is installed on a seat in the first row of seats, for example on the driver's seat. The invention is however not limited to an occupant placed on a driver's seat; in fact, according to other particular exemplary embodiments, an occupant 100 is placed on a passenger seat or on a seat in another row.
[0036] The vehicle advantageously incorporates in its passenger compartment 10 a display system comprising a screen 13 and a computer configured to control the display of content(s) of a human-machine interface, called HMI, graphic on the screen 13. The computer corresponds for example to the computer of the infotainment system, called IVI computer (from the English “In-Vehicle Infotainment” or in French “Infodivertissement embarké”) of the vehicle.
[0037] The screen 13 is for example touch-sensitive and corresponds for example to a screen of the LCD type (from the English "Liquid Crystal Display" or in French "Display à cristals liquide"), for example of the TFT type (from the English "Thin-Film Transistor" or in French "Transistor en film mince"), or OLED (from the English "Organic Light-Emitting Diode" or in French "Diode électroluminescente biologique"). The screen 13 is for example arranged in the center of the dashboard, for example above a central facade. Of course, the position of the screen 13 is not limited to this example, the screen 13 being able to be arranged in any position, for example on the central facade.
[0038] The screen 13 makes it possible to display content intended for an occupant 100 of the passenger compartment 10 of the vehicle, for example the driver and / or a passenger of the vehicle. The screen 13 is also configured to allow the driver and / or passengers of the vehicle to interact with one or more systems embedded in the vehicle via a human machine interface (HMI) displayed on the screen 13. For example, the screen 13 makes it possible to control the infotainment system, also called IVI (In-Vehicle Infotainment) system of the vehicle, as well as for example the system responsible for generating a personalized image of the passenger compartment 10 of the vehicle, in particular in order to use this type of image during a videoconference attended by an occupant 100 of the passenger compartment 10 of the vehicle, as described below.
[0039] According to another example, not illustrated here, the screen is not integrated into the passenger compartment but corresponds to a screen of a second mobile communication device 101, such as a smartphone or a tablet, connected in communication, for example wirelessly, with the on-board system of the vehicle.
[0040] According to a first particular embodiment, the vehicle further comprises a communication unit comprising at least one antenna, configured in particular to establish a wireless connection with one or more mobile communication devices 101.
[0041] According to a second particular embodiment, the vehicle further comprises a communication unit comprising at least one connection device such as a universal serial bus (USB) type socket, high definition multimedia interface (HDMI) or another standardized interface, configured in particular to establish a wired connection with one or more mobile communication devices 101.
[0042] The vehicle carries, for example, a communication unit corresponding for example to a communication box of the telematic control unit type TCU (from the English "Telematic Control Unit"), BTA box ("Autonomous Telematics Box") or BSRF box ("Radio Frequency Servitude Box"). Such a unit is advantageously connected to one or more antennas for example to transmit and / or receive data to and / or from a remote device, for example a remote server in the "cloud" (or "cloud" in French), or a mobile communication device, via a wireless link, according to OTA technology (from the English "Over The Air" or in French "by air") for example.The wireless communication between the vehicle and the remote device is established, for example, using a direct communication mode (for example, when the mobile communication device is in the vehicle or at a distance from the vehicle that allows such a communication mode, for example, at a distance of less than 10, 20 or 50 m). The wireless connection is based, for example, on one or more wireless communication protocols such as Bluetooth®, Wi-Fi® (based on IEEE 802.11), LTE (Long-Term Evolution), LTE-Advanced. (or in French LTE-advanced), 3GPP (from the English "3rd Generation Partnership Project" or in French "3rd generation partnership project") of fourth generation or fifth generation, called 3GPP 4G or 5G.
[0043] As examples, the mobile communication device 101 corresponds to a portable or mobile telephone, for example a smartphone, a tablet, a connected object such as a connected watch (or a so-called smart watch), a key or a key locator.
[0044] The TCU unit is for example connected to one or more computers of the vehicle. The TCU unit and the computers advantageously form the on-board system of the vehicle, these computers forming with the TCU unit a multiplexed architecture for the realization of different services useful for the proper functioning of the vehicle, for the display of images or graphic contents on an on-board screen 13 in the passenger compartment 10 of the vehicle.The computers, the TCU and any devices (e.g. one or more headlights) communicate and exchange data with each other via one or more computer buses, for example a communication bus of the data bus type CAN (from the English "Controller Area Network" or in French "Réseau de contrôles"), CAN FD (from the English "Controller Area Network Flexible Data-Rate" or in French "Réseau de contrôles à débit de données flexible"), FlexRay (according to the ISO 17458 standard), LIN (from the English "Local Interconnect Network" or in French "Réseau interconnecté local") or Ethernet (according to the ISO / IEC 802-3 standard).
[0045] During a videoconference, the devices used to acquire images and / or sounds and the devices used to restore images and / or sounds are for example connected to a server transmitting communication data linked to the videoconference via the on-board system of the vehicle and via the communication unit.
[0046] The IVI system also interacts, for example, with a microphone 12 making it possible to acquire sounds from the passenger compartment 10, in particular the voice of the occupant 100. Such a microphone 12 is for example positioned close to the screen 13, on a steering wheel or in a central rearview mirror present in the passenger compartment 10.
[0047] The IVI system also interacts, for example, with loudspeakers 14 present in the passenger compartment 10, for example located in the doors of the vehicle or on the dashboard. These loudspeakers 14 then make it possible to broadcast the sounds relating to the videoconference, for example coming from one or more interlocutors.
[0048] The vehicle also has one or more cameras 11 in its passenger compartment 10. Such a camera 11 is arranged in the passenger compartment 10 of the vehicle, for example in the dashboard or in the central rearview mirror and is oriented, for example, towards an occupant 100, for example towards the face of the driver of the vehicle. Thus, an occupant 100 is placed in the field of vision 111 of the camera 11. Such a camera 11 is thus configured for the acquisition of image data representative of the real scene located in the passenger compartment 10 of the vehicle and comprising an occupant 100.
[0049] The camera 11 comprises for example the following elements: - a photosensitive sensor corresponding for example to a matrix of photoreceptors associated for example with a Bayer filter; - an optical assembly arranged in front of the sensor with respect to the scene to be acquired by the sensor, the optical assembly comprising for example an arrangement of one or more lenses; and - optionally one or more calculators associated with memory and configured for processing images acquired by the sensor.
[0050] According to an alternative embodiment, the camera corresponds to a camera of the mobile communication device 101 on board the vehicle 10, if applicable. The camera of the mobile communication device is also configured for the acquisition of image data representative of the real scene located in the passenger compartment 10, depending on where the mobile communication device 101 is arranged in the passenger compartment of the vehicle 10. The mobile communication device 101 is for example placed in a base or a receptacle arranged on the central console and is oriented towards the passenger compartment 10 and an occupant 100.
[0051] The various devices such as the camera 11, the microphone 12, the screen 13 and the speakers 14 are for example all connected to the IVI system and make it possible to interact with the IVI system via an HMI capable of receiving input data from the camera 11, the screen 13 and the microphone 12 and emitting output data via the screen 13 and the speakers 14.
[0052] Thus, when the occupant 100 wishes to make a video call or carry out a videoconference, he activates the videoconference via the HMI, for example.
[0053] A process for generating a personalized image of the passenger compartment 10 of the vehicle is advantageously implemented by one or more devices embedded in the vehicle 10 for videoconferencing, for example by one or more computers of an on-board IVI system of the vehicle.
[0054] In a first operation, first data representative of a first image acquired by the camera 11 of the passenger compartment 10 are received. The first image then represents a part of the passenger compartment 10, for example a part of the seat on which the occupant 100 is installed, a bench seat, a roof lining, doors with windows and a landscape visible through these windows or even objects present in the passenger compartment 10, for example a bag placed on a rear bench seat.
[0055] The first image also represents an occupant 100, for example the occupant's face and part of his bust.
[0056] It should be noted that it is possible to have a second occupant represented in the second image, for example installed on the seat next to that of the occupant 100. This second occupant is then, according to a first embodiment, a member participating in the videoconference, he is then also an occupant 100 who must be visible during the videoconference. This second occupant is, according to a second embodiment, a passenger who is not participating in the videoconference, he must then not be visible during the videoconference. In the first case, the second occupant is treated in the same way as the occupant 100 in the rest of the process. In the second case, the second occupant is treated in the same way as the passenger compartment in the rest of the process. Thus, in the rest of the process, the term occupant 100 refers to one or more occupants of the vehicle, each of these occupants participating in the videoconference.
[0057] In a second operation, second data representative of a background mask associated with the part of the first image representing the passenger compartment 10 are determined from the second data. The determination of this background mask is notably implemented according to any method known to those skilled in the art, for example by a method cited in the document “Pixel approach to background subtraction in video, based on a mixture of imprecise Gaussians” by Ali DARWICH published in March 2018.
[0058] Thus, the second operation makes it possible to assign to any pixel of the first image a value representative of its belonging to the background, that is to say to the passenger compartment 10, or of its belonging to the representation of the occupant 100. The background mask comprises for example a set of values equal to 0 or 1 assigned to each pixel of the first image, the background mask being for example recorded in a correspondence table comprising the value representative of the belonging of a pixel to the background and the position in pixel coordinates of the pixel in the first image.
[0059] In a third operation, third data representative of a modeling of a virtual passenger compartment in three dimensions are received. The modeling of the virtual passenger compartment is for example obtained from three-dimensional models of different elements of this virtual passenger compartment, for example the virtual passenger compartment corresponds to a passenger compartment of a vehicle of the same type as the vehicle in which this process is implemented. Thus, the virtual passenger compartment comprises virtual objects such as: - a door, including trim and glazing, - a window, - a roof covered with a roof lining or a hood, - an item of upholstery such as a seat or a bench, - a seat belt, - a trunk with a tailgate and its glazing, - a light source such as a ceiling light or a light strip, and - an accessory, for example a bag or a teddy bear.
[0060] A part of an exterior environment is notably visible through openings or glazing and is also integrated into this interior modeling, this exterior environment corresponding for example to an urban environment, a rural environment, a forest, a parking lot or even a garage.
[0061] The various virtual objects and environments belong, for example, to a virtual object library. Such a virtual object library is, for example, stored on a remote server accessible to the computer in charge of the process.
[0062] According to a particular exemplary embodiment, these virtual objects are customizable. Fourth data are representative of personalized parameters applicable to the modeling and belong to a data set comprising: - a visibility index, - a transparency index, - a color, - a texture, - a size, - an orientation, and - a three-dimensional position.
[0063] In a fourth operation, these fourth data are received by the computer in charge of the process, for example received from the HMI on board the vehicle.
[0064] According to a particular exemplary embodiment, the occupant 100 selects and adjusts parameters associated with the virtual objects via the HMI accessible from the passenger compartment 10, for example through an interactive interface displayed on the touch screen 13. The occupant 100 accesses different menus and different options, allowing for example to select virtual objects present in the virtual passenger compartment and to define their appearance. For example, the occupant 100 defines the type of upholstery, the color of the fabric of the seats associated with this upholstery and the color of the seat belts. The occupant also defines the type of environment visible through the windows of the virtual objects, thus through the windows of the doors and the trunk an urban landscape will appear for example. The occupant 100 also places accessories in the virtual passenger compartment to make it less austere, for example a pink teddy bear placed on the back seat.Thus, the virtual cabin resembles the real cabin 10 or, on the contrary, incorporates fantasy according to the wishes of the occupant 100. .
[0065] In a fifth operation, fifth data representative of a second image of the virtual cabin seen from a point of view corresponding to a point of view of the camera 11 are generated from the third and fourth data. The second image thus corresponds to a synthetic image of the virtual passenger compartment as seen by a camera positioned at the same location as the camera 11 looking at the passenger compartment 10. This second image is obtained by any technique known to those skilled in the art aimed at obtaining a synthetic image from a three-dimensional model. Such an operation is for example presented in the article “Image synthesis” written by Pascal GUITTON and published in October 2008.
[0066] According to a particular embodiment, in a sixth operation, lighting data are received, the generation of the fifth data being furthermore a function of the lighting data. This lighting data makes it possible to generate shadows and to modify the renderings associated with the textures of the virtual objects. The lighting data are for example defined by the occupant 100 via the HMI, or are for example determined by analysis of the first image or by a twilight sensor embedded in the vehicle. Thus, the lighting data make it possible to generate the second image with lighting similar to that present in the passenger compartment 10, giving the impression that the virtual passenger compartment is seen in the same lighting conditions as the passenger compartment 10 at the same time instant.
[0067] According to a particular embodiment, the second image has the same definition as the first image as well as the same proportions. Thus, the first and second images have the same number of pixels, each pixel of the first image corresponds to a pixel of the second image having the same coordinates and each pixel of the second image corresponds to a pixel of the first image having the same coordinates.
[0068] In a seventh operation, sixth data representative of a third image are generated from the first, second and fifth data.
[0069] According to a particular exemplary embodiment, a pixel of the third image has the value: - a value associated with a pixel of the first image when the pixel of the third image is not included in the background mask, or - a value associated with a pixel of the second image when the pixel of the third image is included in the background mask.
[0070] More generally, the third image is the result of the embedding of the second image in the first image. Such a method is known to those skilled in the art and presented in particular in the article “Effective methods for embedding virtual objects in image sequences”, written by Gilles SIMON and Marie-Odile BERGER and published in 1999.
[0071] Thus, the occupant of the passenger compartment has a tool allowing them to generate images representing them in a virtual passenger compartment, thus guaranteeing the confidentiality of data relating to its environment during a videoconference. Indeed, a speaker will see through his own screen an image of the occupant, the latter being installed in a vehicle interior which may be similar to the real interior but in which certain elements have disappeared, replaced by virtual objects. The speaker is therefore not able to see the interior but instead perceives a virtual interior personalized by the occupant.
[0072] [Fig. 3] schematically illustrates a device 3 configured for generating a personalized image of a vehicle interior for videoconferencing, for example of the interior 10, according to a particular and non-limiting exemplary embodiment of the present invention. The device 3 corresponds for example to a device embedded in a vehicle, for example a computer.
[0073] The device 3 is for example configured for the implementation of the operations described with regard to [Fig.l] or the steps of the method described with regard to [Fig.2]. Examples of such a device 3 include, but are not limited to, on-board electronic equipment such as an on-board computer of a vehicle, an electronic calculator such as an ECU (“Electronic Control Unit”), a smartphone, a tablet, a computer, a laptop, a server. The elements of the device 3, individually or in combination, can be integrated into a single integrated circuit, into several integrated circuits, and / or into discrete components. The device 3 can be produced in the form of electronic circuits or software (or computer) modules or even a combination of electronic circuits and software modules.
[0074] The device 3 comprises one (or more) processor(s) 30 configured to execute instructions for carrying out the steps of the method and / or for executing the instructions of the software(s) embedded in the device 3. The processor 30 may include integrated memory, an input / output interface, and various circuits known to those skilled in the art. The device 3 further comprises at least one memory 31 corresponding for example to a volatile and / or non-volatile memory and / or comprises a memory storage device which may comprise volatile and / or non-volatile memory, such as EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash, magnetic or optical disk.
[0075] The computer code of the embedded software(s) comprising the instructions to be loaded and executed by the processor is for example stored in the memory 31.
[0076] According to various particular and non-limiting embodiments, the device 3 is coupled in communication with other similar devices or systems and / or with communication devices, for example a TCU (from the English “Telematic Control Unit” or in French “Telematic Control Unit”), for example via a communication bus or through input ports. / dedicated output.
[0077] According to a particular and non-limiting exemplary embodiment, the device 3 comprises a block 32 of interface elements for communicating with external devices. The interface elements of the block 32 comprise one or more of the following interfaces: - RF radio frequency interface, for example Wi-Fi® type (according to IEEE 802.11), for example in the 2.4 or 5 GHz frequency bands, or Bluetooth® type (according to IEEE 802.15.1), in the 2.4 GHz frequency band, or Sigfox type using UBN (Ultra Narrow Band) radio technology, or LoRa in the 868 MHz frequency band, LTE (Long-Term Evolution), LTE-Advanced; - USB interface (from the English “Universal Serial Bus” or “Universal Serial Bus” in French); - HDMI interface (from the English “High Definition Multimedia Interface” or “High Definition Multimedia Interface” in French); - LIN interface (from the English “Local Interconnect Network”).
[0078] According to another particular and non-limiting exemplary embodiment, the device 3 comprises a communication interface 33 which makes it possible to establish communication with other devices (such as other computers of the on-board system) via a communication channel 330. The communication interface 33 corresponds for example to a transmitter configured to transmit and receive information and / or data via the communication channel 330. The communication interface 33 corresponds for example to a wired network of the CAN (from the English "Controller Area Network" or in French "Réseau de contrôles") type, CAN FD (from the English "Controller Area Network Flexible Data-Rate" or in French "Réseau de contrôles à débit de données flexible"), FlexRay (standardized by the ISO 17458 standard) or Ethernet (standardized by the ISO / IEC 802-3 standard).
[0079] According to a particular and non-limiting exemplary embodiment, the device 3 can provide output signals to one or more external devices, such as a display screen 340, touch-sensitive or not, one or more speakers 350 and / or other peripherals 360 (projection system) via output interfaces 34, 35 and 36 respectively. According to a variant, one or other of the external devices is integrated into the device 4.
[0080] [Fig.2] illustrates a flowchart of the different steps of a method for generating a personalized image of a vehicle interior for videoconferencing, for example of the interior 10, according to a particular exemplary embodiment and not limiting of the present invention. The method is for example implemented by a computer on board the vehicle comprising the passenger compartment 10.
[0081] In a step 21, first data representative of a first image acquired by a camera 11 of the passenger compartment 10 are received. The first image represents a part of the passenger compartment 10 and an occupant 100 participating in the videoconference.
[0082] In a step 22, second data representative of a background mask are determined from the first data, the background being associated with the part of the first image representing the passenger compartment.
[0083] In a step 23, third data representative of a modeling of a virtual cabin in three dimensions are received.
[0084] In a step 24, fourth data representative of personalized parameters applicable to the modeling are received.
[0085] In a step 25, fifth data representative of a second image of the virtual passenger compartment are generated from the third and fourth data. The virtual passenger compartment being seen from a point of view corresponding to a point of view of the camera 11.
[0086] In a step 26, sixth data representative of a third image are generated from the first, second and fifth data.
[0087] According to a variant, the variants and examples of the operations described in relation to [Fig.l] apply to the steps of the method of [Fig.2].
Claims
Claims
1. Method for generating a personalized image of a passenger compartment (10) of a vehicle for videoconferencing, said method comprising the following steps: - reception (21) of first data representative of a first image acquired by a camera (11) of said passenger compartment (10), said first image representing a part of said passenger compartment (10) and an occupant (100) participating in said videoconference; - determination (22), from the first data, of second data representative of a background mask associated with said part of the first image representing said passenger compartment; - reception (23) of third data representative of a modeling of a virtual passenger compartment in three dimensions; - reception (24) of fourth data representative of personalized parameters applicable to said modeling;- generation (25) of fifth data representative of a second image of said virtual cabin seen from a point of view corresponding to a point of view of the camera (11) from the third and fourth data; - generation (26) of sixth data representative of a third image from the first, second and fifth data.;
2. Method according to claim 1, for which a pixel of the third image has the value: - a value associated with a pixel of the first image when the pixel of the third image is not included in the background mask, or - a value associated with a pixel of the second image when the pixel of the third image is included in the background mask.
3. A method according to claim 1 or 2, wherein said virtual cabin comprises virtual objects from a virtual object library.
4. Method according to claim 3, for which said virtual objects belong to a set of virtual objects comprising: - a window, - a roof lining, - a seat or bench, - a seat belt, - a light source, and - an accessory.
5. Method according to one of claims 1 to 4, for which said fourth data are received from a human-machine interface.
6. Method according to one of claims 1 to 5, for which the fourth data belong to a set of data comprising: - a visibility index, - a transparency index, - a color, - a texture, - a size, - an orientation, and - a three-dimensional position.
7. A method according to one of claims 1 to 6, further comprising receiving lighting data, said generation of the fifth data being further dependent on said lighting data.
8. Computer program comprising instructions for implementing the method according to any one of the preceding claims, when these instructions are executed by a processor.
9. Device (3) for generating a personalized image of a passenger compartment (10) of a vehicle for videoconferencing, said device (3) comprising a memory (31) associated with at least one processor (30) configured for implementing the steps of the method according to any one of claims 1 to 7.
10. Vehicle comprising the device according to claim 9.
Citation Information
Patent Citations
Lighting parameter matching webcam videos to enhance virtual backgrounds in video conferencing and game streaming
US20230063678A1
Dynamic virtual background for video conference
US20230308603A1
Virtual Background Rendering Based On Target Participant View
US20230353612A1