Method and device for broadcasting and displaying video streams
The method and device address OTT video distribution challenges by adapting content to diverse devices and networks, ensuring high-quality streaming with minimal bandwidth impact and personalized display, enhancing user experience.
Patent Information
- Application Number
- FR2024007876
- Authority / Receiving Office
- FR · FR
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-18
- Publication Date
- 2026-01-23
AI Technical Summary
Existing OTT video distribution technologies face challenges in adapting audiovisual content to varying screen sizes, ensuring high-quality user experience across different devices, managing network resources efficiently, and maintaining interoperability between diverse platforms and formats.
A method and device for broadcasting and displaying video streams that adapt the content by detecting regions of interest, defining spatial positions, and transmitting data to create target audiovisual compositions tailored to device characteristics, while optimizing bandwidth and ensuring synchronization across multiple communication channels.
Enables high-quality video streaming with minimal bandwidth increase, allowing for personalized display experiences and seamless adaptation to changing network conditions and device orientations, thus enhancing user experience.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Title of the invention: Method and device for broadcasting and displaying video streams. Technical field
[0001] The present invention relates to the distribution and display of video streams and more particularly to an OTT service enabling the display of video streams on different types of devices. Technological background
[0002] The technical field of the present invention relates to OTT services (Over-The-Top service, or services bypassing the Internet service provider's standard offering). OTT services enable the distribution of digital media, such as audiovisual content, via the Internet, independently of traditional cable or satellite television operators.
[0003] The current context of video distribution on OTT platforms is characterized by an increasing diversity of devices used by users to view audiovisual content, such as televisions, smartphones, tablets, and computers. Each device has its own specific characteristics in terms of screen size, image resolution, processing capabilities, and network access. This heterogeneity presents significant challenges for content providers, who must guarantee a high-quality user experience regardless of the viewing platform used and the network access conditions.
[0004] One of the technical problems to be solved is adapting audiovisual content to screens of varying sizes without compromising the user experience. High-definition televisions, computer monitors, tablets, and smartphones have different screen resolutions and aspect ratios (the ratio between the screen's width and height), requiring sophisticated transcoding and resizing techniques.
[0005] Current transcoding and resizing solutions can lead to video quality degradation, image distortion or prolonged loading times, negatively affecting the user experience.
[0006] Network resource management presents another challenge. Indeed, the distribution of audiovisual content requires significant bandwidth, and variations in network conditions can affect the quality of the received video stream. Stream interruptions, resolution drops, and high latency are examples. Common problems arise when audiovisual content is streamed over unstable or overloaded networks. Existing technologies need to be improved to optimize bandwidth usage and ensure smooth streaming, even under fluctuating network conditions.
[0007] Another critical aspect is interoperability between different platforms and video formats. Content providers must ensure that their audiovisual content is compatible with a multitude of operating systems, browsers, and applications, each with its own specifications and constraints.
[0008] In summary, the distribution of audiovisual content on OTT platforms faces significant technical challenges related to adapting content to a variety of screens, efficient management of network resources and personalization of the user experience. Summary of the present invention
[0009] One object of the present invention is to solve at least one of the problems of the technological background described above.
[0010] According to a first aspect, the present invention relates to a method for broadcasting a video stream. The method obtains a source audiovisual composition from the video stream. The method further obtains at least one audiovisual composition model based on the source audiovisual composition obtained. In addition, the method detects at least one region of interest in an image of the video stream based on the source audiovisual composition. Moreover, the method determines first data representing the spatial position of each detected region of interest in the image of the video stream and, for each audiovisual composition model, second data defining a display area of a target audiovisual composition and a spatial position within the display area of each detected region of interest.Furthermore, the process disseminates the first data, the second data determined for each audiovisual communication model, and the third data representative of the video stream.
[0011] The method allows for the transmission of a video stream that can be displayed (viewed) in the form of audiovisual compositions formed from at least a portion of the transmitted video stream. Each portion of the video stream is obtained from a region of interest that is automatically detected in an image of the video stream and positioned in the display area according to the spatial position of this region of interest within the display area.
[0012] The method is advantageous because it allows for the definition of a target audiovisual composition that can be adapted to the characteristics of a target device, such as the screen dimensions of a device on which the target audiovisual composition is displayed, or the orientation of that display screen. The adaptation can relate to on the resolution of the parts of the video stream that will be displayed in the target audiovisual composition, on their number or on their arrangement in the display area defined by each audiovisual composition template.
[0013] The method is a solution to the problem of heterogeneity of devices intended to display a target audiovisual composition formed from the video stream.
[0014] The method is advantageous because it does not significantly increase the bandwidth required for the video stream broadcasting, since the first and second additional data represent only a small percentage of the third data broadcast, which represents the video stream.
[0015] According to a particular and non-limiting embodiment of the present invention, the method may further include a step of disseminating fourth data representing at least one graphic element associated with the video stream.
[0016] This embodiment is advantageous because each audiovisual composition model can then define a target audiovisual composition combining both parts of the video stream and one or more graphic elements such as logos or banner ads, for example. The resolution and dimensions of these graphic elements are adapted to each audiovisual composition model; that is, the graphic elements specific to each audiovisual composition model are defined in resolution and dimensions from the moment of their generation.
[0017] According to a particular and non-limiting embodiment of the present invention, the first, second and third data are disseminated through a first communication channel and the fourth data are disseminated through a second communication channel distinct from the first communication channel.
[0018] This embodiment is advantageous because it allows the fourth data to be transmitted without disrupting the transmission of the first, second, and third data. Thus, some target audiovisual compositions may be formed solely from the first, second, and third data, while others may also be formed using fourth data. Whether or not the fourth data is used to form a target audiovisual composition may depend on the communication capabilities of a target device or its access permissions to the content represented by this fourth data.
[0019] According to a particular and non-limiting embodiment of the present invention, the method may further include a step of disseminating synchronization data from a clock signal through the first communication channel in relation to the first, second and third data and the same synchronization data through the second communication channel in relation to the fourth data.
[0020] This embodiment is advantageous because it allows the display of audiovisual content from different parts of the target audiovisual composition to be synchronized.
[0021] According to a particular and non-limiting embodiment of the present invention, the method may further include a scene change detection step in the video stream, and wherein the steps of obtaining a source audiovisual composition, obtaining at least one audiovisual composition model, detecting at least one area of interest, determining first, third and fourth data and broadcasting are executed following the detection of each scene change.
[0022] This embodiment is advantageous because it allows the audiovisual composition model and regions of interest to be adapted to a new scene in the video stream whose source audiovisual composition and / or regions of interest may be different from that of the previous scene.
[0023] According to a second aspect, the present invention relates to a method for displaying a video stream on a display screen. The method receives first data representing the spatial position of at least one area of interest in an image of the video stream and, for at least one audiovisual composition model, receives second data defining a display area of a target audiovisual composition and a spatial position of each area of interest within the display area. Furthermore, the method receives third data representing the video stream. In addition, the method selects an audiovisual composition model from among the at least one audiovisual composition model defined by the second data received and obtains a display area of the selected audiovisual composition model defined by the second data received.Furthermore, for each region of interest spatially defined by the first data received, the process obtains a portion of the video stream delimited by the region of interest and adds this portion of the video stream to a portion of the display area based on the spatial position of the region of interest within the display area determined by the second data set. Then, the process controls the display, on the display screen, of the audiovisual content from the display area of the target audiovisual composition corresponding to the selected audiovisual composition model.
[0024] The method offers a solution to a user to personalize their display experience by giving them the ability to select a target audiovisual composition from among several target audiovisual compositions.
[0025] According to a particular and non-limiting embodiment of the present invention, the method may further comprise a step of receiving fourth data representing at least one graphic element associated with the video stream and a step adding said at least one graphic element to a part of the display area of the selected audiovisual composition template.
[0026] According to a particular and non-limiting embodiment of the present invention, the first, second and third data are received through a first communication channel and the fourth data are received through a second communication channel distinct from the first communication channel.
[0027] According to a particular and non-limiting embodiment of the present invention, the method further comprises a step of receiving synchronization data from a clock signal through the first communication channel in relation to the first, second and third data and the same synchronization data through the second communication channel in relation to the fourth data.
[0028] This embodiment makes it possible to maintain synchronization of the audiovisual data of the broadcast video stream when two communication channels are used for the broadcast of the video stream.
[0029] According to a particular and non-limiting embodiment of the present invention, the audiovisual composition model is selected from said at least one audiovisual composition model from a graphical interface or according to a display screen orientation or a preferred display format.
[0030] This embodiment allows either a manual mode for selecting a target audiovisual composition or an automatic mode depending on the orientation of the target device. This embodiment is particularly advantageous for mobile communication devices such as smartphones or tablets because it allows for an automatic change of the target audiovisual composition depending on the device's orientation. For example, when the device is horizontal, a first target audiovisual composition can be viewed. This first target audiovisual composition can consist of a large horizontal portion of the display area in which the wide-angle video stream is viewed.When the device is vertical, a second target audiovisual composition can be viewed. This second target audiovisual composition can be formed from one or more narrower parts of the display area in which one or more parts of the video stream corresponding to one or more regions of interest are viewed.
[0031] This embodiment is advantageous because it allows a user to save a preferred video stream display format when their device allows them to choose from several display formats. For example, a display area dimension ratio can be saved in the user preferences of a smartphone, and the selected target audiovisual composition corresponds to that area. display whose dimension ratio is equal to (or as close as possible to) that recorded.
[0032] According to a particular and non-limiting embodiment of the present invention, the audiovisual composition model is selected from said at least one audiovisual composition model based on video stream display capacity and / or based on data reception capabilities.
[0033] This embodiment is advantageous because it allows for latency-free and jerk-free display of the target audiovisual composition, optimizing the user experience.
[0034] According to a particular and non-limiting embodiment of the present invention, the addition of a portion of the video stream obtained in a portion of the display area of the target audiovisual composition further includes cropping, depending on the dimensions of the portion of the display area and the dimensions of the portion of the video stream to be displayed in said portion.
[0035] This embodiment is advantageous because it allows the dimensions of a portion of the video stream corresponding to a region of interest defined in the video stream to be adapted to the dimensions of a portion of the display area of a target audiovisual composition.
[0036] According to a third aspect, the present invention relates to a device for broadcasting a video stream, the device comprising a memory associated with a processor configured for the implementation of the steps of the process according to the first aspect of the present invention.
[0037] According to a fourth aspect, the present invention relates to a device for displaying a video stream, the device comprising a memory associated with a processor configured for the implementation of the steps of the process according to the second aspect of the present invention.
[0038] According to a fifth aspect, the present invention relates to a video stream broadcasting and display system comprising a device according to the third aspect of the present invention and at least one device according to the fourth aspect of the present invention.
[0039] According to a sixth aspect, the present invention relates to a computer program which includes instructions adapted for carrying out the steps of the process according to the first and / or the second aspect of the present invention, in particular when the computer program is executed by at least one processor.
[0040] Such a computer program may use any programming language, and be in the form of source code, object code, or an intermediate code between source code and object code, such as in a partially compiled form, or in any other desirable form.
[0041] According to a seventh aspect, the present invention relates to a computer-readable recording medium on which is recorded a computer program comprising instructions for carrying out the steps of the process according to the first and / or the second aspect of the present invention.
[0042] On the one hand, the recording medium can be any entity or device capable of storing the program. For example, the medium can include a storage means, such as a ROM, RAM, CD-ROM or a microelectronic circuit-type ROM, or a magnetic recording means or a hard disk drive.
[0043] On the other hand, this recording medium can also be a transmissible medium such as an electrical or optical signal, such a signal being able to be transmitted via an electrical or optical cable, by conventional or radio frequency, by self-directing laser beam, or by other means. The computer program according to the present invention can, in particular, be downloaded from an Internet-type network.
[0044] Alternatively, the recording medium may be an integrated circuit in which the computer program is incorporated, the integrated circuit being adapted to execute or to be used in the execution of the process in question. Brief description of the figures
[0045] Other features and advantages of the present invention will become apparent from the description of the particular and non-limiting embodiments of the present invention below, with reference to the attached Figures 1 to 9, in which:
[0046] [Fig-1] schematically illustrates an example of a video streaming system according to a particular and non-limiting example of the present invention.
[0047] [Fig.2] schematically illustrates a device configured for the implementation of an OTT service for broadcasting a video stream according to a particular and non-limiting embodiment of the present invention.
[0048] [Fig.3] illustrates a flowchart of the different stages of the video stream broadcasting process according to a particular embodiment of the present invention.
[0049] [Fig.4A] illustrates an example of an audiovisual composition model corresponding to a source audiovisual composition, according to a particular and non-limiting embodiment of the present invention.
[0050] [Fig.4B] illustrates an example of an audiovisual composition model corresponding to a source audiovisual composition, according to a particular and non-limiting embodiment of the present invention.
[0051] [Fig.4C] illustrates an example of an audiovisual composition model corresponding to a source audiovisual composition, according to a particular and non-limiting embodiment of the present invention.
[0052] [Fig.4D] illustrates an example of an audiovisual composition model corresponding to a source audiovisual composition, according to a particular and non-limiting embodiment of the present invention.
[0053] [Fig.4E] illustrates an example of an audiovisual composition model corresponding to a source audiovisual composition, according to a particular and non-limiting embodiment of the present invention.
[0054] [Fig.4F] illustrates an example of an audiovisual composition model corresponding to a source audiovisual composition, according to a particular and non-limiting embodiment of the present invention.
[0055] [Fig.4G] illustrates an example of an audiovisual composition model corresponding to a source audiovisual composition, according to a particular and non-limiting embodiment of the present invention.
[0056] [Fig.4H] illustrates an example of an audiovisual composition model corresponding to a source audiovisual composition, according to a particular and non-limiting embodiment of the present invention.
[0057] [Fig.5] illustrates an example of encapsulation of the first, second and third data according to the MPEG2-TS protocol, according to a particular and non-limiting embodiment of the present invention.
[0058] [Fig.6] schematically illustrates a device configured to display a video stream broadcast by an OTT service according to a particular and non-limiting embodiment of the present invention.
[0059] [Fig.7] schematically illustrates a diagram of the steps of a method for displaying a video stream according to a particular and non-limiting embodiment of the present invention.
[0060] [Fig.8A] illustrates an example of a target audiovisual composition of a video stream requested, according to a particular and non-limiting example of the present invention.
[0061] [Fig.8B] illustrates an example of target audiovisual composition of a requested video stream, according to a particular and non-limiting embodiment of the present invention.
[0062] [Fig.8C] illustrates an example of target audiovisual composition of a requested video stream, according to a particular and non-limiting embodiment of the present invention.
[0063] [Fig.8D] illustrates an example of target audiovisual composition of a requested video stream, according to a particular and non-limiting embodiment of the present invention.
[0064] [Fig.9] schematically illustrates an information system implementing the present invention, according to a particular and non-limiting example of the present invention. Description of examples of achievements
[0065] A method and device for broadcasting and displaying video streams will now be described in what follows with joint reference to Figures 1 to 9. The same elements are identified with the same reference signs throughout the description that follows.
[0066] In the following description, numerous specific details are set forth to provide a thorough understanding of the present invention. However, it will be evident to those skilled in the art that the present invention, including structures, devices, systems, and methods, can be implemented without all of these specific details. The description and drawings below are means commonly used by persons experienced or qualified in the technical field related to the present invention to convey the substance of the present invention as effectively as possible to other persons experienced or qualified in the prior art. In other cases, well-known methods, components, and circuits have not been described in detail so as not to unnecessarily obscure certain aspects of the present invention.
[0067] In the description, references to "an embodiment," "an example of an embodiment," etc., indicate that the embodiment or example described may include a particular feature, structure, or element, but that not every embodiment or example necessarily includes that particular feature, structure, or element. Furthermore, these expressions do not necessarily refer to the same embodiment. Moreover, when a feature, structure, or characteristic is described in relation to an embodiment or example, it is assumed that a person skilled in the art knows how to apply that feature, structure, or characteristic to other embodiments or examples, whether or not they are explicitly described.
[0068] The terms "first(s)", "second(s)" (or "first(s)", "second(s)"), etc. are used in the by arbitrary convention to allow identification and distinction of different elements (such as operations, means, frequency pairs, etc.) implemented in the modes or embodiments described below.
[0069] It should also be noted that the various modes or embodiments can be described as a process or procedure represented in the form of a flowchart, data flow diagram, structure diagram, or block diagram. Although a flowchart can describe the operations as In a sequential process, many operations can be performed in parallel or simultaneously. Furthermore, the order of operations can be changed. A process ends when its operations are completed, but it may include additional steps not shown in a diagram. A process can be a method, a function, a procedure, a subroutine, a subprogram, etc. When a process is a function, its end can be a return call from the function to the calling function or the main function.
[0070] The term "computer-readable medium" includes, but is not limited to, portable or non-portable storage devices, optical storage devices, and various other media capable of storing, containing, or transporting instructions and / or data. A computer-readable medium may include a non-transient medium in which data can be stored and which does not include carrier waves and / or transient electronic signals propagating wirelessly or over wired connections. Examples of non-transient media include, but are not limited to, a magnetic disk or tape, an optical storage medium such as a compact disc (CD) or a digital multipurpose disc (DVD), flash memory, memory, or memory devices.A computer-readable medium can contain machine-executable code and / or instructions that may represent a procedure, function, subroutine, program, routine, module, software package, class, or any combination of instructions, data structures, or program statements. A code segment can be coupled to another code segment or to a hardware circuit by transmitting and / or receiving information, data, arguments, parameters, or memory contents. Information, arguments, parameters, data, etc., can be transmitted by any appropriate means, including memory sharing, message transmission, token transmission, network transmission, etc.
[0071] Furthermore, the embodiments or examples may be implemented by hardware, software, firmware, middleware, microcode, hardware description languages, or any combination thereof. When implemented in software, firmware, middleware, or microcode, the program code or code segments enabling the execution of the necessary tasks (e.g., a computer program product) may be stored on a computer-readable or machine-readable medium. One or more processors may perform the necessary tasks.
[0072] Fig. 1 schematically illustrates an example of a video stream distribution system 1 according to a particular and non-limiting embodiment of the present invention.
[0073] The broadcasting system 1 includes a video stream capture device 110, a captured video stream processing and broadcasting device 120 and a broadcast video stream display device 130.
[0074] Devices 120 and 130 can be connected by a cloud information infrastructure 140 (cloud) which enables communication, data exchange, and management of devices 120 and 130 via the Internet. This infrastructure can use remote servers to provide data processing, storage, and management services, thereby facilitating connection and interaction between devices 120 and 130.
[0075] The device 110 may be a high-definition camera or a high-definition camera system that allows for the continuous capture of a high-quality, high-resolution video stream. For example, the captured video stream may be displayed in Full HD (1920 x 1080 pixels, 16:9), 4K UHD (3840 x 2160 pixels, 16:9), or 9K UHD (7680 x 4320 pixels, 16:9). The video stream may be captured at a frequency of 60 Hz or higher.
[0076] Device 120 is configured to implement one or more processing steps on the captured video stream and to broadcast the processed video stream according to the present invention, as will be seen in detail later.
[0077] As an example, devices 110 and 120 can be implemented on separate pieces of equipment. In this case, devices 110 and 120 are connected by a communication channel of a communication network. This communication channel can be dedicated to the transmission of the video stream between device 110 and device 120.
[0078] This example corresponds, for instance, to situations where one or more cameras are distributed in a space and a control room coordinates the production of the video stream from other video streams captured by these cameras. Typically, these situations occur for the live broadcast of events, for example, sporting events.
[0079] According to another example, devices 110 and 120 can be implemented in the same equipment such as a television, computer or mobile communication device such as a smartphone, tablet, laptop, etc.
[0080] According to a particular and non-limiting embodiment of the present invention, the broadcasting system 1 can implement an OTT service for broadcasting audiovisual content.
[0081] The OTT service is based on a series of operational modules enabling the implementation of a method for broadcasting the video stream 111 of [Fig.3].
[0082] Fig. 2 schematically illustrates a device 120 configured for the implementation of an OTT service for broadcasting a video stream 111 according to a particular and non-limiting embodiment of the present invention.
[0083] Device 110 is configured to implement the capture of the video stream 111 and device 120 is configured to implement the method of broadcasting the video stream of [Fig.3]
[0084] For this purpose, the device 120 includes a module 121 for processing the captured video stream 111 and a module 122 for data broadcasting.
[0085] Module 121 receives the video stream 111 as input and provides as output first data 121b second data 1212 and third data 1213.
[0086] According to one variant, the module 121 can also receive, as input, a clock signal 112 and data 113 and can also provide, as output, fourth data 1214 which are broadcast in particular to the device 130 via the infrastructure 140.
[0087] Module 122 receives the first data 121b, the second data 1212 and the third data 1213 as input and distributes data 122b, 1222 and 1223 to, in particular, device 130 via infrastructure 140.
[0088] Figure 3 illustrates a flowchart of the different stages of the video stream broadcasting process according to a particular embodiment of the present invention.
[0089] In a step 310, module 121 obtains a source audiovisual composition from video stream 111.
[0090] According to an example embodiment, the source audiovisual composition can be selected from a predefined set of source audiovisual compositions.
[0091] According to an example embodiment, the source audiovisual composition can be selected from a content type of video stream 111.
[0092] According to a particular and non-limiting embodiment, the audiovisual content type of the video stream 111 can be selected from a predefined set of audiovisual content types. For example, this predefined set may include a 'TV news' type, a 'TV debate' type, and another 'match' type.
[0093] According to a particular and non-limiting embodiment of the present invention, the type of audiovisual content of the video stream 111 can be obtained by manually selecting one of the types from the predefined set of types.
[0094] For example, a user can use a human-machine interface of the device 120 to select the source audiovisual composition and / or the type of audiovisual content of the video stream 111.
[0095] According to a particular and non-limiting embodiment of the present invention, the source audiovisual composition of the video stream 111 can be obtained from a memory in which it has been previously stored.
[0096] Each source audiovisual composition in the predefined set of source audiovisual compositions is associated with at least one audiovisual composition model.
[0097] An audiovisual composition model graphically defines a display area for audiovisual content associated with the video stream 111.
[0098] According to a particular and non-limiting embodiment of the present invention, the display area is defined by its dimensions.
[0099] According to an example, the display area can be defined by its height and width when the display area is a rectangle.
[0100] According to another example, the display area can be defined by spatial positions in the image of the video stream of two opposite vertices of a rectangle when the display area is a rectangle.
[0101] The present invention is not limited to a particular shape of the display area or to its representation by spatial positions of two of its opposite vertices. The display area can have any shape and be, for example, represented by the spatial positions of pixels of an image of the video stream 111.
[0102] When the video stream is encoded by a video codec, the display area can also be defined by references to syntax elements defined by that video codec, such as coding units (Coding Units, Coding-Tree Units) as defined in video codecs implementing an MPEG coding standard such as AVC (ISO / IEC 14496-10 Advanced Video Coding for generic audio-visual services, ITU-T Recommendation H.264, https: / / www.itu.int / rec / T-REC-H.264-202108-P / en), EVC (ISO / IEC 23094-1 Essential video coding), HEVC (ISO / IEC 23008-2 High Efficiency Video Coding, ITU-T Recommendation H.265, https: / / www.itu.int / rec / T-REC-H.265-202108-P / en) or VVC (ISO / IEC 23090-3 Versatile Video Coding, ITU-T Recommendation H.266, https: / / www.itu.int / rec / T-REC-H.266-202008-I / en).
[0103] An audiovisual composition model spatially defines at least a part of the display area. Each part is dedicated to the display of audiovisual content which can be either a part of an image from the video stream or a graphic element such as a logo, an image of a barcode or an advertisement banner for example.
[0104] Each audiovisual composition model can be represented by a set of at least one parameter.
[0105] According to a particular and non-limiting embodiment of the present invention, an audiovisual composition model can be represented by a set of parameters that defines a display area of a target audiovisual composition and a spatial position within the display area of at least one region of interest detected in an image of the video stream 111.
[0106] An audiovisual composition model can be defined for particular characteristics of a display screen of the device 130, such as its dimensions (for example, for a particular aspect ratio of the display screen). Typically, possible aspect ratios of the display area of a smartphone are 16:9, 1:1, 4:5, 2:3, and 9:16.
[0107] Audiovisual composition templates can also be defined to display the video stream 111 either in portrait mode or in landscape mode on the display screen of the device 130.
[0108] Figures 4A to 4H illustrate examples of audiovisual composition models according to different source audiovisual compositions, according to particular and non-limiting examples of embodiment of the present invention.
[0109] Fig. 4A illustrates an example of an audiovisual composition model corresponding to a source audiovisual composition associated with a 'TV news' type which corresponds to a landscape mode display on the display screen of the device 130. This example of an audiovisual composition model defines a first part 31 of a display area 30 located in the upper part and in the center of this display area 30 and a second display area 32 located in the lower part of the display area 30.
[0110] Fig. 4B illustrates an example of an audiovisual composition model corresponding to a source audiovisual composition associated with a 'TV news' type which corresponds to a display in portrait mode on the display screen of the device 130. This example of an audiovisual composition model defines a first part 35 of a display area 33 located partly in the center of the display area 33 and a second part 34 of the display area 33 located in the lower part of the display area 33.
[0111] Fig. 4C illustrates an example of an audiovisual composition model corresponding to a source audiovisual composition associated with a 'TV news' type which corresponds to a landscape mode display on the display screen of the device 130. This example of an audiovisual composition model defines the first part 31 of the display area 30 located in the upper part and in the center of the display area 30, the second part 32 of the display area 30 located in the lower part of the display area 30 and a third part 36 located in the upper left of the display area 30.
[0112] Figure 4D illustrates an example of an audiovisual composition model corresponding to a source audiovisual composition associated with a 'TV news' type, which corresponds to a portrait mode display on the device's display screen. 130. This example of an audiovisual composition model defines a first part 37 of the display area 33 located in the center of the display area 33, the second part 34 of the display area 33 located in the lower part of the display area 33 and a third part 38 located at the top and left of the display area 33.
[0113] Fig. 4E illustrates an example of an audiovisual composition model corresponding to a source audiovisual composition associated with a 'televised debate' type which corresponds to a landscape mode display on the display screen of the device 130. This example of an audiovisual composition model defines a first part 39 of the display area 30 located in the upper part and in the centre of the display area 30 and a set of several parts 401 to 404 (here 4) of the display area 30 located in the lower part of the display area 30.
[0114] Fig. 4F illustrates an example of an audiovisual composition model corresponding to a source audiovisual composition associated with a 'televised debate' type which corresponds to a display in portrait mode on the display screen of the device 130. This example of an audiovisual composition model defines a first part 41 of the display area 33 located in the upper part and in the centre of the display area 33 and a set of several parts 421 to 424 (here 4) of the display area 33 located in the lower part of the display area 33.
[0115] Fig. 4G illustrates an example of an audiovisual composition model corresponding to a source audiovisual composition associated with a 'match' type which corresponds to a landscape mode display on the display screen of the device 130. This example of an audiovisual composition model defines a first part 43 of the display area 30 located in the upper left part of the display area 30 and a second part 44 of the display area 30 located in the center of the display area 30.
[0116] Fig. 4H illustrates an example of an audiovisual composition model corresponding to a source audiovisual composition associated with a 'match' type which corresponds to a display in portrait mode on the display screen of the device 130. This example of an audiovisual composition model defines a first part 45 of the display area 33 located in the upper part and to the left of the display area 33 and a second part 46 of the display area 33 located in the center of the display area 33.
[0117] The present invention is not limited to particular types of audiovisual content or to particular examples of audiovisual composition patterns such as those illustrated above, but extends to any type of audiovisual content and to any type of audiovisual composition pattern that defines at least a part of a display area intended for the display of audiovisual content.
[0118] In a step 320 of [Fig.3], module 121 obtains at least one audiovisual composition model as a function of the source audiovisual composition.
[0119] According to the examples in Figures 4A to 4H, if the video stream is of the 'TV news' type, then four audiovisual composition models (illustrated by Figures 4A to 4D) can be obtained. If the video stream is of the 'televised debate' type, then two audiovisual composition models (illustrated by Figures 4E and 4F) can be obtained. If the video stream is of the 'match' type, then two audiovisual composition models (illustrated by Figures 4G and 4H) can be obtained.
[0120] In a step 330, module 121 detects at least one area of interest in an image of the video stream 111 according to the source audiovisual composition.
[0121] According to a particular and non-limiting embodiment of the present invention, a region of interest is defined by spatial positions in the image of the video stream 111 of two opposite vertices of a rectangle.
[0122] According to a particular and non-limiting embodiment of the present invention, a region of interest can be detected in at least a part of the display area of at least one obtained audiovisual composition model (step 320).
[0123] This example of implementation is advantageous because it allows methods for defining regions of interest to be dedicated to particular parts of the display area of an audiovisual composition model.
[0124] For example, in the case of the audiovisual composition model of Figures 4A to 4F, parts 31, 35, 37, 39, 40i to 404, 41, and 42i to 424 can each be dedicated to face display. In this case, a face detection method can be applied to an image of the video stream 111 by delimiting face detection in the image of the video stream 111 to these parts of the audiovisual composition models. An example is the face detection method of Pau Viola and Michael Jones (“Robust Real-time Face Detection,” IJVC, 2004, pp. 137–154).
[0125] In the case of part 44 or 46 of the display area 30 or 33, an object detection and tracking method can be used to detect and track an object in the video stream 111. For example, the method of Sayed Mohammed Majidi Dorcheh et al. (SmartCrop: AI-based cropping of soccer videos, 2023, IEEE International Symposium on Multimedia (ISM)) describes a method that enables the detection and tracking of a soccer player and the ball. This method can be used, for example, to detect and track a region of interest around the ball and to dedicate part 44 or 46 of the display area 30 or 33 to displaying the content of the video stream delimited by this region of interest.
[0126] In a step 340, the module 121 determines the first data 1211 which are representative of the spatial position of each area of interest detected in the image of the video stream 111.
[0127] In a step 350, module 121 determines the second data 1212 for each audiovisual composition model obtained (step 320).
[0128] The second data 1212 determined for an audiovisual composition model define a display area of a target audiovisual composition and a spatial position in the display area of each detected area of interest.
[0129] The spatial position within the display area of a detected region of interest allows for the partial generation of the target audiovisual composition by establishing a relationship between the region of interest and a portion of the display area. The content of the video stream delimited by the region of interest can then be viewed within that portion of the display area.
[0130] In a step 360, the module 121 obtains the third data 1213 representative of the video stream 111.
[0131] The first data 121 b the second data 1212 determined for each audiovisual composition model and the third data 1213 are presented as input to module 122 ([Fig.2]).
[0132] In a step 370, the module 122 disseminates the data 122b, the data 1222 determined for each audiovisual composition model, and the data 1223 which are obtained, respectively, from the first data 121b, the second data 1222 determined for each audiovisual composition model, and the third data 1223.
[0133] According to an example of an embodiment, the data 122b, the data 1222 determined for each audiovisual composition model and the data 1223 are disseminated cyclically.
[0134] According to a particular and non-limiting embodiment of the present invention, in a step 380, the module 121 can obtain data 113 representative of at least one graphic element associated with the video stream 111. The module 121 then broadcasts the fourth data 1214 representative of said at least one graphic element.
[0135] A graphic element can represent any type of visual information relating to the video stream 111. It can, for example, represent a brand logo, be presented as a scrolling banner ad or as an area in which textual information or thumbnails representing still images are displayed or in which videos are viewed.
[0136] The dimensions of a graphic element are defined according to each audiovisual composition model, that is to say that the dimensions of a graphic element are adapted to those of the part of the display area dedicated to it.
[0137] According to an example of implementation, each graphic element can be represented in an HTML5 format.
[0138] According to a particular and non-limiting embodiment of the present invention, the data 122b, 1222 and 1223 can be disseminated through a first communication channel and the data 1214 can be disseminated through a second communication channel distinct from the first communication channel.
[0139] According to one example, the first and second communication channels can be established via the Internet network.
[0140] According to a particular and non-limiting embodiment of the present invention, in a step 390, the module 122 can receive the clock signal 112 and broadcast synchronization data obtained from the clock signal 112 through the first communication channel in relation to the data 122b, 1222 and 1223 and the same synchronization data through the second communication channel in relation to the data 1224.
[0141] According to one example, the synchronization data can represent time instants obtained from the clock signal 112.
[0142] According to a particular and non-limiting embodiment of the present invention, in a step 300, the module 121 detects whether a scene change appears in the video stream 11. If a scene change is detected then steps 310-370 and possibly 380 and 390 are executed.
[0143] Module 122 is configured to perform processing on the third data representing the video stream 111. For example, one such processing is adaptive bitrate (ABR) transcoding, which allows the video stream 111 to be adapted to different formats and resolutions required for viewing the video stream 111 on various devices 130. Adaptive transcoding also allows the quality of the video stream 111 to be automatically adjusted according to the available bandwidth of a user. For example, a 4K UHD video stream can be transcoded into several resolutions, such as 1080p, 720p, and 480p. Thus, if the user's connection is fast and stable, they will receive the video stream 111 in high definition. Conversely, if the connection is slow or unstable, the quality of the video stream 111 will be dynamically reduced to prevent playback interruptions.This ensures a smooth and uninterrupted user experience, regardless of bandwidth variations.
[0144] The different versions of the video stream 111 output from the transcoding can be represented in an MBR (Multiple BitRates) format. In this case, several versions of the video stream 111 at different bitrates are then available. These different versions of the video stream 111 can be encoded using a video codec such as HEVC or VVC, for example. The third data can then represent image data encoded according to this video codec.
[0145] The third data 1213 may represent the different versions of the video stream 111 (possibly encoded).
[0146] Module 122 is also configured to package the first 121b, second 1212, and third 1213 data (and optionally the synchronization data) into formats suitable for streaming. Packaged data consists of segmenting these first, second, and third data (and optionally the synchronization data) into chunks and encapsulating them in formats specific to streaming. The most commonly used formats are HLS / TS (HTTP Live Streaming with MPEG-TS type packet) and HLS / CMAF (HTTP Live Streaming associated with Common Media Application Format). The HLS / TS format segments the first, second, and third data (and optionally the synchronization data) into chunks encapsulated in the MPEG-TS format, which is widely compatible with many devices but relatively inefficient in terms of file size.In contrast, the HLS / CMAF format uses the CMAF format, which reduces latency and improves broadcast efficiency by enabling faster startup times and better network resource management. This latter format is increasingly adopted due to its performance and flexibility advantages.
[0147] According to a particular and non-limiting embodiment of the present invention, the first 121b, second 1212, and third 1213 data (and optionally the synchronization data) can be encapsulated using the MPEG-TS (MPEG Transport Stream) protocol defined by the MPEG-2 Part 1 (System, ISO / IEC 13818-1 standard) of the Moving Picture Experts Group. The MPEG-2 standard defines the transport aspects across networks for digital television but is widely extended to the transport of other audiovisual content. Its primary purpose is to enable the multiplexing of video and audio in order to synchronize them. An MPEG-TS stream (named after the protocol used) can include several audio / video programs as well as program description and service data.
[0148] Figure 5 illustrates an example of encapsulation of the first, second and third data (and possibly the synchronization data) according to the MPEG2-TS protocol, according to a particular and non-limiting embodiment of the present invention.
[0149] According to this example, three MPEG2 streams 541, 542, and 543 can be multiplexed. Stream 541 can include several programs 531 to 534, here 4. One program, per For example, program 531 is made up of at least one packet of elementary streams (PES), here a packet of 3 elementary streams (ES). One of these elementary streams, for example 511, can encapsulate the visual part of the third data 1213 representing the video stream 111, another, for example 512, can encapsulate the audio part of the third data 1213 representing the video stream 111 and another, for example 513, can encapsulate the first 1211 and the second 1212 data (and possibly the synchronization data).
[0150] According to a particular and non-limiting embodiment of the present invention, the first 1211 and second 1212 data (and possibly the synchronization data) are of type ID3 or KLV.
[0151] The encapsulation of the first, second and third data (and possibly the synchronization data) by the MPEG2-TS protocol ensures the persistence of these first and second data (and possibly the synchronization data) during various processing (transcoding, packetization, etc.) carried out during the broadcast of the first, second and third data by module 122.
[0152] The first, second, and third data (and possibly the synchronization data) are stored once packaged. This is generally done in data centers using content management systems (CMS). These systems allow for the classification, security, and accessibility of on-demand video streams.
[0153] Once stored, the first, second, and third packaged data (and possibly synchronization data) are distributed. Content Delivery Networks (CDNs) can be used for this purpose. CDNs have servers located worldwide, which makes it possible to bring available video streams closer to end users and reduce latency. Thus, when a user requests a video stream from the HMI of device 130 via the OTT service, it is streamed from the server closest to their location.
[0154] Figure 6 schematically illustrates a device configured to display a video stream broadcast by an OTT service according to a particular and non-limiting embodiment of the present invention.
[0155] The OTT video streaming service can, for example, implement the process of [Fig.3].
[0156] The video stream display device 130 111 includes a display screen 131.
[0157] In addition, the device 130 includes a human-machine interface (HMI) 133 configured so that a user can interact with a graphical interface 134 displayed on the display screen 131.
[0158] The 133 HMI is designed to be intuitive so that a user can easily navigate among audiovisual content, create lists of favorites, access display options and benefit from personalized recommendations based on their viewing habits.
[0159] For example, this graphical interface 134 may include graphical representations of videos available for display on demand. A user can then navigate among these graphical representations and select one of them to display the corresponding video stream by means of a video player (not shown).
[0160] For example, the graphical interface 134 may be similar to those of video-on-demand systems currently found on various online platforms.
[0161] According to a particular and non-limiting embodiment of the present invention, the display screen 131 may include a touch functionality which is used by a user as a means of interaction with the graphical interface 134. A user can then navigate among the graphical representations and select a video stream to be displayed by direct action on the graphical interface 134.
[0162] The touch display screen 131 corresponds for example to an LCD type screen (from the English "Liquid Crystal Display" or in French "Display à cristals liquide"), for example of type TFT (from the English "Thin-Film Transistor" or in French "Transistor en film mince"), or OLED (from the English "Organic Light-Emitting Diode" or in French "Diode électroluminescente organique").
[0163] Furthermore, the device 130 includes a communication interface 135 configured to send requests for video to be displayed to a multimedia data server such as, for example, a CDN server and to receive data relating to the requested video via a communication network.
[0164] According to examples, the communication network can be a wired, wireless or hybrid network of the Internet type.
[0165] The communication interface 135 is configured to receive a request to display a video represented by a graphical representation of the graphical interface 134 selected by a user via a remote control 135 (or directly from the touchscreen). The communication interface 135 is also configured to send a request to display the selected video to a CDN server located closest to the device 130. The CDN server then offers several versions of the requested video stream to the device 130. The communication interface 135 automatically selects the highest bitrate that the connection to this server can support without interruption. and selects one of the available versions. For example, if a fast connection is established between this CDN server and device 130, then a 1080p version at 5 Mbps (for example) of the requested video stream might be selected, while if a slower connection is established, then the 480p version at 1 Mbps (for example) is selected. Once the requested video stream version is selected, the CDN server broadcasts 122b, 1222, and 1233 data (and possibly synchronization data) related to the selected version of the requested video stream.
[0166] According to one variant, data 1224 (and possibly synchronization data) are also broadcast to device 130.
[0167] The communication interface 135 receives the data 122b, 1222 and 1233 and, optionally 1224 and obtains first data 135i representing the spatial position of at least one area of interest detected in the image of the requested video stream, second data 1352 representing at least one audiovisual composition model and third data 1353 representing the selected version of the selected video stream and, optionally fourth data 1354 representing at least one graphic element relating to the selected version of the requested video stream, according respectively to the data 122b, 1222, 1233 and, optionally 1224.
[0168] According to one variant, the communication interface 135 can receive synchronization data in relation to the data 122b 1222 and 1223 through a first communication channel and the same synchronization data through a second communication channel in relation to the data 1224.
[0169] According to a particular and non-limiting embodiment of the present invention, the data 122b 1222 and 1233 and, optionally 1224 and the synchronization data are received in a binary file and the communication interface 135 obtains the first 135b second 1352, third 1353 and, optionally fourth 1354 data and the synchronization data by parsing the received binary file.
[0170] For example, this binary file is in the HLS / TS or HLS / CMAF format discussed previously.
[0171] For example, the MPEG-TS protocol can be used to obtain the first 135i, second 1222, third 1223 and, possibly, fourth 1224 data and synchronization data from a binary stream carrying this data.
[0172] In addition, the device 130 includes a module 136 for creating a target audiovisual composition providing data 132il when the first data 135i, the second data 1352, the third data 1353 and, possibly, the fourth data 1354 are presented as input to the module 136.
[0173] Module 136 is configured to implement the process of [Fig.7].
[0174] The device 130 further comprises a display control module 132 of a selected target audiovisual composition of a requested video stream on the display screen 131 according to the data 132i provided by the module 136 and possibly the synchronization data.
[0175] According to examples, device 130 can be a computer, possibly a laptop, a tablet, a smartphone, a television, or any other mobile communication device configured to display a video stream.
[0176] Figure 7 schematically illustrates a diagram of the steps of a process displaying a video stream according to a particular and non-limiting embodiment of the present invention.
[0177] In a step 71, the module 136 receives the first data 135i representative of a spatial position of at least one area of interest of an image of the video stream.
[0178] In a step 72, module 136 receives the second data 1352 for at least one audiovisual composition model. The second data 1352 defines a display area of a target audiovisual composition and a spatial position of each area of interest within the display area.
[0179] The display area spatially delimits a zone of the display screen 131 in which a target audiovisual composition is displayed. The dimensions of the display area may, for example, correspond to those of the display screen 131 or be smaller than them.
[0180] In a step 73, module 136 receives the third data 1353 representative of the video stream.
[0181] In a step 74, module 36 selects an audiovisual composition model from said at least one audiovisual composition model defined by the second data 1352.
[0182] In a step 75, module 136 obtains a display area of the selected audiovisual composition model defined by the second data 1352.
[0183] In a step 76, for each region of interest spatially defined by the first data 135i received, the module 136 obtains a portion of the video stream delimited by the region of interest and, in a step 77, adds the portion of the video stream obtained in a portion of the display area according to the spatial position of the region of interest in the display area determined by the second data 1352.
[0184] Module 136 then provides the data 132i as input to module 132.
[0185] In a step 78, module 132 controls a display, on display screen 131, of the audiovisual content of the display area of the audiovisual composition target corresponding to the audiovisual composition model selected from data 132b
[0186] A control for displaying audiovisual content in the display area of a target audiovisual composition includes rendering that audiovisual content, such rendering corresponding to a set of operations performed by one or more processors on the pixels of one or more images of the audiovisual content to be displayed on the display screen 131. For example, rendering consists of associating pixel data (for example, color data expressed in an RGB (Red, Green, Blue) color space) with each graphic object. Rendering may include decoding data to obtain pixel data according to, for example, MPEG-type video encodings such as HEVC or VVC.
[0187] The control of the display of the audiovisual content thus includes the transmission by the module 132 of control signals to the display screen 131 to modify the values associated with the pixels of the display screen 131 at the place intended to display the audiovisual content.
[0188] According to a particular and non-limiting embodiment of the present invention, in a step 79, the module 136 can receive the fourth data 1354 representing at least one graphic element associated with the video stream and, in a step 80, the module 136 adds said at least one graphic element to a part of the display area of the selected audiovisual composition model.
[0189] According to a particular and non-limiting embodiment of the present invention, the first 135b second 1352 and third 1353 data can be received through a first communication channel and the fourth data 1354 can be received through a second communication channel distinct from the first communication channel.
[0190] According to a particular and non-limiting embodiment of the present invention, in a step (81), the module 136 can receive synchronization data through the first communication channel in relation to the first 135b second 1352 and third 1353 data and the same synchronization data through the second communication channel in relation to the fourth 1354 data.
[0191] According to a particular and non-limiting embodiment of the present invention, the audiovisual composition model is selected from said at least one audiovisual composition model defined by the second data 1352 from a human-machine interface, for example the HMI 133.
[0192] According to a particular and non-limiting embodiment of the present invention, the audiovisual composition model is selected from said at least one audiovisual composition model defined by the second data 1352 according to an orientation of the display screen 131.
[0193] For example, when the module 136 is configured to detect an orientation (landscape or portrait mode) of the display screen 131 and selects an audiovisual composition model from said at least one audiovisual composition model defined by the second data 1352 depending on whether the display screen 131 is in landscape or portrait mode.
[0194] According to a particular and non-limiting embodiment of the present invention, the audiovisual composition model is selected from said at least one audiovisual composition model defined by the second data 1352 according to a preferred display format.
[0195] For example, this preferred display format is chosen beforehand by a user.
[0196] For example, a preferred display format can define the dimensions of an area display and / or a display mode of the target audiovisual composition displayed on the display screen 131.
[0197] According to a particular and non-limiting embodiment of the present invention, the audiovisual composition model is selected from said at least one audiovisual composition model based on video stream display capacity and / or based on data reception capabilities.
[0198] This example of implementation is advantageous because it allows limiting the number of audiovisual composition models that a user can choose to display a video stream to those that allow a smooth display experience (without stuttering or unexpected blocking).
[0199] According to a particular and non-limiting embodiment of the present invention, the addition of a portion of the video stream obtained in a portion of the display area of the selected audiovisual composition model further includes cropping, depending on the dimensions of the portion of the display area and the dimensions of the portion of the video stream to be displayed in said portion.
[0200] The process of [Fig.7] makes it possible to obtain a target audiovisual composition from the selected video stream and possibly one or more graphic elements.
[0201] The audiovisual content that makes up this target audiovisual composition must be displayed in a synchronized manner, for example, by synchronization data.
[0202] When the display of the target audiovisual composition is implemented by an application installed on device 130 under an operating system such as On Android or iOS, a software component integrated into the application performs the operations of obtaining the requested portions of the video stream (cropping) and inserting graphic elements (overlay), frame by frame. The resulting video images are then displayed on the display screen 131. It should be noted that audio tracks can also be rendered synchronously with the display of the generated video images.
[0203] When the display of the target audiovisual composition is implemented by a web browser displayer (web player), a calculation module such as a JavaScript library that can be integrated into a web page of a portal, performs the operations of obtaining the parts of the requested video stream (cropping) and inserting the graphic elements (overlay) and then obtains a new video stream in a standard format such as .ts or .mp4 which is then sent to the native decoder of a web browser for the display of the selected target audiovisual composition of the requested video stream.
[0204] Fig. 8A illustrates an example of a target audiovisual composition of a requested video stream, according to a particular and non-limiting embodiment of the present invention.
[0205] According to this example, the target audiovisual composition of the requested video stream is generated by the process of [Fig. 7] according to the audiovisual composition model of [Fig. 4A]. The target audiovisual composition is thus adapted for display on the display screen 131 in a landscape format. The target audiovisual composition comprises the content of a region of interest 91 extracted from the requested video stream and displayed in part 31 of the display area 30 defined by the audiovisual composition model of [Fig. 4A], and a graphic element 92, for example an announcement banner, displayed in part 32 of the display area 30.
[0206] Fig. 8B illustrates an example of a target audiovisual composition of a requested video stream, according to a particular and non-limiting embodiment of the present invention.
[0207] According to this example, the target audiovisual composition of the requested video stream is generated by the process of [Fig. 7] according to the audiovisual composition model of [Fig. 4B]. The target audiovisual composition is thus adapted to be displayed on the display screen 131 in a portrait format. The target audiovisual composition comprises the content of a region of interest 93 extracted from the requested video stream and displayed in part 35 of the display area 33 defined by the audiovisual composition model of [Fig. 4B], and a graphic element 94, for example an announcement banner, displayed in part 34 of the display area 33.
[0208] The target audiovisual composition of [Fig. 8A] is intended to be displayed in landscape format, while the target audiovisual composition of [Fig. 8B] is intended to be displayed in portrait format. Parts of the video stream 91 and 93 and elements 92 and 94 are adapted to the dimensions of the display area depending on whether the display format is portrait or landscape.
[0209] Fig. 8C illustrates an example of a target audiovisual composition of a requested video stream, according to a particular and non-limiting embodiment of the present invention.
[0210] According to this example, the target audiovisual composition of the requested video stream is generated by the process of [Fig. 7] according to the audiovisual composition model of [Fig. 4E]. The target audiovisual composition is thus adapted for display on the display screen 131 in a landscape format. The target audiovisual composition comprises the content of a region of interest 96 extracted from the requested video stream and displayed in part 39 of the display area 30 defined by the audiovisual composition model of [Fig. 4E], and the content of four regions of interest 97 to 100 extracted from the requested video stream and displayed in parts 40i to 404 of the display area 30.
[0211] Fig. 8D illustrates an example of target audiovisual composition of a requested video stream, according to a particular and non-limiting embodiment of the present invention.
[0212] According to this example, the target audiovisual composition of the requested video stream is generated by the process of [Fig. 7] according to the audiovisual composition model of [Fig. 4E]. The composition is thus adapted for display on the display screen 131 in a portrait format. The target audiovisual composition comprises the content of a region of interest 102 extracted from the requested video stream and displayed in part 41 of the display area 33 defined by the audiovisual composition model of [Fig. 4F], and the content of four regions of interest 103 to 106 extracted from the requested video stream and displayed in parts 42i to 424 of the display area 33.
[0213] The target audiovisual composition of [Fig. 8C] is intended to be displayed in landscape format, while the target audiovisual composition of [Fig. 8D] is intended to be displayed in portrait format. Portions 96-100 and 102-106 of the video stream are adapted to the dimensions of the display area depending on whether the display format is portrait or landscape.
[0214] Of course, the present invention is not limited to the embodiments described above but extends to a method for broadcasting and displaying video streams that would include secondary steps without departing from the scope of the present invention. The same would apply to a device configured for implementing such a method.
[0215] The embodiments or examples of the present invention can be implemented using equipment comprising one or more analog circuits and / or digital, and / or software, by the execution of instructions by one or more general-purpose or special-purpose processors, or as a combination of hardware and software. Therefore, the embodiments or examples of the present invention can be implemented in the environment of a computer system or other processing system. An example of such a computer system is shown in [Fig. 9]. The blocks described in the figures above, such as the blocks in Figures 3 and 7, can run on one or more computer systems. Furthermore, each of the steps in the flowcharts described above can be implemented on one or more computer systems.When more than one 900 computer system is used to implement embodiments of the present invention, the 900 computer systems can be interconnected by one or more networks to form a cluster of computer systems that can act as a single pool of homogeneous resources. The interconnected 900 computer systems can form a "cloud" of computers.
[0216] The computer system 900 includes one or more processors, such as the processor 904. The processor 904 may be, for example, a dedicated-purpose processor, a general-purpose processor, a microprocessor, or a digital signal processor. The processor 904 may be connected to a communication infrastructure 902 (for example, a bus or a network). The computer system 900 may also include main memory 906, such as random access memory (RAM), and may also include secondary memory 908. The secondary memory 908 may include, for example, a hard disk drive 910 and / or a removable storage unit 912, representing a magnetic tape drive, an optical disk drive, or the like. The removable storage unit 912 may read from and / or write to a removable storage unit 916 in a well-known manner.Removable storage unit 916 represents a magnetic tape, optical disc or other, which is read and written by removable storage unit 912. As will be understood by persons competent in the relevant fields, removable storage unit 916 comprises a storage medium usable by a computer on which software and / or data are stored.
[0217] In other embodiments, the secondary memory 908 may include other similar means for loading computer programs or other instructions into the computer system 900. These means may include, for example, a removable storage unit 918 and an interface 914. These may be, for example, a program cartridge and cartridge interface (such as those found in video game devices), a removable memory chip (such as an EPROM or PROM) and associated connector, a USB flash drive and USB port, and other removable storage units 918 and interfaces. 914 which allow software and data to be transferred from the removable storage unit 918 to the computer system 900.
[0218] The computer system 900 may also include a communication interface 920. The communication interface 920 allows the transfer of software and data between the computer system 900 and external devices such as a display screen, for example. The communication interface 920 may include, for example, a modem, a network interface (such as an Ethernet card), a communication port, etc. The software and data transferred via the communication interface 920 are in the form of signals that may be electronic, electromagnetic, optical, or other signals capable of being received by the communication interface 920. These signals are transmitted to the communication interface 920 via a communication path 922.The 3122 communication path carries signals and can be implemented using wire or cable, optical fiber, telephone line, cellular phone link, RF link, and other communication channels.
[0219] The computer system 900 may also include one or more sensors 924. The sensor(s) 924 may measure or detect one or more physical quantities and convert the measured or detected physical quantities into an electrical signal in digital and / or analog form. For example, the sensor(s) 924 may include a camera to capture a video stream.
[0220] In this document, the terms "computer program media" and "computer-readable media" refer to tangible storage media, such as removable storage units 916 and 918 or a hard disk drive installed in the hard disk drive 910. These computer program products are means of providing software to the computer system 900. Computer programs (also called computer control logic) can be stored in main memory 906 and / or secondary memory 908. Computer programs can also be received via the communication interface 920. These computer programs, when executed, enable the computer system 900 to implement this disclosure as described herein.In particular, computer programs, when executed, allow the processor 904 to implement the processes of this disclosure, such as the methods described herein. Consequently, these computer programs represent controllers of the computer system 900.
[0221] In another embodiment, the features of the present invention can be implemented in hardware using, for example, hardware components such as application-specific integrated circuits (ASICs) and gate arrays. The implementation of a state machine The hardware required to perform the functions described above will also be obvious to people competent in the relevant field.
Claims
Demands
1. A method for broadcasting a video stream, the method comprising the following steps: - obtaining (310) a source audiovisual composition from the video stream; - obtaining (320) at least one audiovisual composition model based on the source audiovisual composition; - detecting (330) at least one area of interest in an image of the video stream based on the source audiovisual composition; - determining (340) first data representative of the spatial position of each detected area of interest in the image of the video stream; - determining (350), for each audiovisual composition model, second data defining a display area of a target audiovisual composition; and a spatial position within the display area of each detected area of interest;and - dissemination (370) of the first data, the second data determined for each audiovisual communication model and the third data representative of the video stream.;
2. A method according to claim 1, further comprising a step (380) of disseminating fourth data representing at least one graphic element associated with the video stream.
3. A method according to claim 2, wherein the first, second and third data are disseminated through a first communication channel and the fourth data are disseminated through a second communication channel distinct from the first communication channel.
4. A method according to claim 3, further comprising a step (390) of disseminating synchronization data from a clock signal through the first communication channel in relation to the first, second and third data and the same synchronization data through the second communication channel in relation to the fourth data.
5. A method according to any one of claims 2 to 4, further comprising a step (300) for detecting a scene change in the video stream, and wherein the steps for obtaining a source audiovisual composition, obtaining at least one audiovisual composition model, detecting at least one area of interest, determining first, second, third and fourth data and broadcasting are executed following the detection of each scene change.
6. A method for displaying a video stream on a display screen, the method comprising the following steps: - receiving (71) first data representing a spatial position of at least one area of interest in an image of the video stream; - receiving (72), for at least one audiovisual composition model, second data defining a display area of a target audiovisual composition; and a spatial position of each area of interest in the display area; - receiving (73) third data representing the video stream; - selecting (74) an audiovisual composition model from among said at least one audiovisual composition model defined by the second data received; - obtaining (75) a display area of the selected audiovisual composition model defined by the second data received;- for each region of interest spatially defined by the first data received: obtaining (76) a portion of the video stream delimited by the region of interest; and adding (77) the portion of the video stream obtained into a portion of the display area according to the spatial position of the region of interest in the display area determined by the second data; and - checking (78) the display, on the display screen, of the audiovisual content of the display area of the target audiovisual composition corresponding to the selected audiovisual composition model.
7. A method according to claim 6, further comprising a step (79) of receiving fourth data representing at least one graphic element associated with the video stream and a step (80) of adding said at least one graphic element into at least a part of the display area of the selected audiovisual composition template.
8. A method according to claim 7, wherein the first, second, and third data points are received through a first communication channel and the fourth data point is received at through a second communication channel distinct from the first communication channel.
9. A method according to claim 8, further comprising a step (81) of receiving synchronization data from a clock signal through the first communication channel in relation to the first, second and third data and the same synchronization data through the second communication channel in relation to the fourth data.
10. A method according to any one of claims 6 to 9, wherein the audiovisual composition model is selected from said at least one audiovisual composition model from a human-machine interface or according to a preferred display screen orientation or display format.
11. A method according to any one of claims 6 to 9, wherein the audiovisual composition model is selected from said at least one audiovisual composition model based on video stream display capacity and / or based on data reception capabilities.
12. A method according to any one of claims 6 to 11, wherein the addition of a portion of the video stream obtained in a portion of the display area of the selected audiovisual composition model further includes cropping, depending on the dimensions of the portion of the display area and the dimensions of the portion of the video stream to be displayed in said portion.
13. Device for disseminating a video stream implementing one of the methods according to any one of claims 1 to 5.
14. A video stream display device comprising a display screen implementing one of the methods according to any one of claims 6 to 12.
15. A video stream broadcasting and display system comprising a video stream broadcasting device according to claim 13 and at least one video stream display device according to claim
16. 1H-. Computer program comprising instructions adapted for carrying out the steps of the process according to any one of claims 1 to 12, when the computer program is executed by at least one processor. 34
17. Computer-readable recording medium on which is recorded a computer program comprising instructions for carrying out the steps of the process according to any one of claims 1 to 12.
Citation Information
Patent Citations
Multiple camera video system which displays selected images
US20020049979A1
Information reading apparatus
US20070229706A1
User terminal apparatus, display apparatus, system and control method thereof
US20160050449A1
Method and apparatus for transreceiving broadcast signal for panorama service
US20160337706A1
Multi-source video navigation
US20180167685A1