Image sharing method and device of electronic eyepiece, and storage medium

Abstract

The invention discloses an image sharing method and device of an electronic eyepiece and a storage medium, and belongs to the technical field of image communication. The method comprises the steps of obtaining original image data through an image sensor, executing a first image processing action on the original image data based on eyepiece display information to obtain an eyepiece display image, obtaining target terminal display information, executing a second image processing action on the original image data according to the target terminal display information to obtain a shared image, the eyepiece display image is output to the local display module through the eyepiece interface, and the shared image is sent to the target terminal through the communication interface, so that the target terminal displays the shared image on the display screen. According to the invention, local observation and remote sharing are synchronously carried out through a double-path parallel processing mechanism, so that the efficiency of image observation and the convenience of operation in a multi-person collaborative scene are improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of image communication, in particular to an image sharing method and device of an electronic eyepiece and a storage medium. BACKGROUND

[0002] In the related art, in viewing devices such as telescopes, night vision devices, etc., an image is usually collected and displayed through an electronic eyepiece. Specifically, after the device obtains original image data through an image sensor, a set of fixed image processing algorithms such as denoising, color correction, scaling, etc. are performed on the original data based on the parameter characteristics of the display module of the eyepiece, to generate an image suitable for local display, and output to a local display screen through an eyepiece interface for observation.

[0003] However, since the viewing device only provides local display output, it cannot provide adaptive image output functions for other observers, and in the process of observing the image, only one user can usually watch the image through the eyepiece. Thus, in the scenario of multiple people observing together, different users can usually only take turns to watch the image, which is inconvenient to use.

[0004] The above content is only used to assist in understanding the technical solutions of the present application and does not represent the acknowledgement of the above content as prior art. SUMMARY

[0005] The main purpose of the present application is to provide an image sharing method and device of an electronic eyepiece and a storage medium, aiming to solve the technical problem of inconvenient use of the electronic eyepiece in the scenario of multiple people observing together.

[0006] To achieve the above purpose, the present application provides an image sharing method of an electronic eyepiece, which comprises the following steps: obtaining original image data through an image sensor; performing a first image processing action on the original image data based on eyepiece display information to obtain an eyepiece display image; obtaining target terminal display information, performing a second image processing action on the original image data according to the target terminal display information to obtain a shared image; outputting the eyepiece display image to a local display module through an eyepiece interface; and sending the shared image to a target terminal through a communication interface, so that the target terminal displays the shared image on a display screen.

[0007] In an embodiment, the step of performing a first image processing action on the original image data based on the eyepiece display information to obtain an eyepiece display image comprises: determining the field of view information and watermark information in the eyepiece display information; According to the field of view information, the original image data is image-masked to obtain a target display image; The watermark information is encoded into the target display image to obtain the eyepiece display image.

[0008] In an embodiment, the step of obtaining target terminal display information and performing a second image processing action on the original image data according to the target terminal display information to obtain a shared image includes: Obtaining display information of the target terminal, wherein the display information includes target terminal information and display requirement information; According to the display requirement information, the original image data is watermarked and / or image-masked to form a target device image; According to the target terminal information, the target device image is format-converted and resolution-adjusted to generate the shared image.

[0009] In an embodiment, the step of outputting the eyepiece display image to a local display module through an eyepiece interface includes: The eyepiece display image is packaged into a mobile display interface frame, and the mobile display interface frame is sent to a bridge chip through a mobile display interface; The bridge chip performs a physical layer packet image format conversion on the mobile display interface frame to generate a mobile processor interface frame; The mobile processor interface frame is sent to a local display module through a mobile processor interface, so that the local display module refreshes and presents the eyepiece display image frame by frame according to the received timing.

[0010] In an embodiment, the step of sending the shared image to a target terminal through a communication interface so that the target terminal displays the shared image on a display screen includes: According to a preset communication link protocol, the shared image is encoded into a transmission frame; A wireless communication link with the target terminal is established, and the transmission frame is sent to the target terminal through the wireless communication link, wherein the target terminal obtains the shared image by decoding the transmission frame, and displays the shared image at the current time on the display screen; And / or, the transmission frame is sent to a shared server, so that the shared server sends the transmission frame to the target terminal after receiving a sharing request of the target terminal, and the target terminal obtains the shared image by decoding the transmission frame, and displays the shared image at the current time on the display screen.

[0011] In an embodiment, the method further comprises, after the step of establishing the wireless communication link with the target terminal and sending the transmission frame to the target terminal through the wireless communication link, wherein the target terminal decodes the transmission frame to obtain the shared image, and displays the shared image at the current time on the display screen, the method further comprises: The target terminal generates a target shared image based on the shared image, and sends the target shared image to the sharing server. The sharing server sends the target shared image to other terminals after receiving a target sharing request sent by the other terminals.

[0012] In an embodiment, the method further comprises, after the step of outputting the eyepiece display image to the local display module through the eyepiece interface, the method further comprises: Receiving an image zoom request, determining a center pixel point and a zoom ratio of the image zoom request; Obtaining zoom size information, and determining a zoomed pixel region according to the zoom size information and the center pixel point; Performing a zoom-out action or a zoom-in action on the zoomed pixel region according to the zoom ratio.

[0013] In an embodiment, the method further comprises, after the step of sending the shared image to the target terminal through the communication interface, so that the target terminal displays the shared image on the display screen, the method further comprises: In response to a recording instruction, caching the generated shared image as recording data according to time sequence; After receiving a playback request of the recording data, outputting the recording data to the local display module, and / or sending the recording data to the target terminal.

[0014] In addition, to achieve the above-mentioned purposes, the present application also provides an image sharing device of an electronic eyepiece, the device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, the computer program being configured to implement the steps of the image sharing method of the electronic eyepiece.

[0015] In addition, to achieve the above-mentioned purposes, the present application also provides a storage medium, which is a computer-readable storage medium, and the storage medium stores a computer program, and the computer program is executed by a processor to implement the steps of the image sharing method of the electronic eyepiece.

[0016] The one or more technical solutions provided by the present application have at least the following technical effects: The application obtains original image data through an image sensor, performs first image processing on the original data based on eyepiece display information to obtain eyepiece display images adapted to local display, and performs second image processing on the same original data according to target terminal display information to generate shared images adapted to a remote terminal, so that the local display images are displayed in the target terminal and the electronic eyepiece through different interfaces, respectively, in the target terminal and the electronic eyepiece, so that the electronic observation device not only provides image streams to external terminals through a communication interface while maintaining normal observation experience of local users, but also realizes synchronous performance of local observation and remote sharing through a double-path parallel processing mechanism, thereby improving the efficiency of image observation and the convenience of operation in a multi-person collaborative scenario. BRIEF DESCRIPTION OF DRAWINGS

[0017] The accompanying drawings, which are incorporated herein and form part of the specification, illustrate embodiments consistent with the present application and, together with the description, further serve to explain the principles of the application.

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the accompanying drawings needed to be used in the embodiments or prior art description will be briefly introduced as follows. Obviously, for those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

[0019] Figure 1 A flowchart of a first embodiment of the image sharing method of the electronic eyepiece of the present application; Figure 2 A flowchart of a second embodiment of the image sharing method of the electronic eyepiece of the present application; Figure 3 A flowchart of a third embodiment of the image sharing method of the electronic eyepiece of the present application; Figure 4 A structural diagram of the image sharing device of the electronic eyepiece of the hardware running environment involved in the embodiment scheme of the present application.

[0020] The implementation, functional features and advantages of the present application will be further described with reference to the accompanying drawings in conjunction with the embodiments. DETAILED DESCRIPTION

[0021] It should be understood that the specific embodiments described herein are only used to explain the present application and not to limit the present application.

[0022] In order to better understand the above technical solutions, the above technical solutions will be described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0023] The main solution of the embodiment of the present application is: obtaining original image data through an image sensor, performing a first image processing action on the original image data based on eyepiece display information to obtain an eyepiece display image, obtaining target terminal display information, performing a second image processing action on the original image data according to the target terminal display information to obtain a shared image, outputting the eyepiece display image to a local display module through an eyepiece interface, and sending the shared image to a target terminal through a communication interface, so that the target terminal displays the shared image on a display screen.

[0024] In the prior art, such as viewing and sighting devices such as telescopes and night vision devices, an image is usually collected and displayed through an electronic eyepiece. After the device obtains original image data through an image sensor, a fixed image processing algorithm such as denoising, color correction, scaling, etc. is performed on the original data based on the parameter characteristics of the display module of the eyepiece, an image suitable for local display is generated, and the image is output to a local display screen through an eyepiece interface for observation. However, since the viewing and sighting device only provides local display output, it cannot provide adaptive image output function for other observers, and in the process of observing the image, only one user can usually watch the image through the eyepiece. Therefore, in the scene of collaborative observation by multiple people, different users can usually only take turns to watch the image, which is inconvenient to use.

[0025] After the present application obtains original image data through an image sensor, the original data is first image processed based on eyepiece display information to obtain an eyepiece display image suitable for local display, and the same original data is second image processed according to target terminal display information to generate a shared image suitable for a remote terminal. The image is displayed in the target terminal and the electronic eyepiece through different interfaces, so that the electronic viewing and sighting device can provide an image stream to an external terminal through a communication interface while maintaining the normal observation experience of local users, and the synchronization of local observation and remote sharing is realized through a double-path parallel processing mechanism, thereby improving the efficiency and convenience of image observation in the scene of collaborative observation by multiple people.

[0026] In order to better understand the above technical solutions, the exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present application are shown in the drawings, it should be understood that the present application can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present application and to fully convey the scope of the present application to those skilled in the art.

[0027] It should be noted that the execution subject of the embodiment can be an image processing system of an electronic viewing device, or a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, or an image sharing device of an electronic device or an electronic eyepiece capable of realizing the above functions, and the embodiment is not limited specifically. The image processing system is taken as an example to describe the embodiment and the following embodiments.

[0028] Based on this, the embodiment of the present application provides an image sharing method of an electronic eyepiece, which is described with reference to Figure 1 , Figure 1 The embodiment of the present application provides an image sharing method of an electronic eyepiece.

[0029] In the embodiment, the image sharing method of the electronic eyepiece includes steps S10-S40: Step S10: obtaining original image data through an image sensor; In the embodiment, the electronic eyepiece can be deployed in an electronic viewing device such as a telescope, a night vision instrument or a microscope, which has an image sensor and can convert optical signals into electrical signals through a photoelectric conversion device to obtain original image data. The image sensor first receives light from the outside, focuses through an optical lens and irradiates on the pixel array of the sensor. Each pixel converts the received optical signal into an electrical signal and quantizes it into a digital signal through an analog-to-digital converter (ADC). The digital signal is read out based on timing to form original image data.

[0030] Step S20: performing a first image processing action on the original image data based on eyepiece display information to obtain an eyepiece display image; In the embodiment, the eyepiece display information is information used by the electronic eyepiece to display the original image data, including data format, field of view range, watermark pattern, etc. The eyepiece display information can be obtained by the image processing system based on the display information and display mode preset by the user, and / or the device information of the electronic eyepiece. The image processing system performs a first image processing action on the original image data based on the eyepiece display information to generate an image suitable for display on the eyepiece, i.e. an eyepiece display image. The first image processing action refers to a series of processing operations performed by the image processing system on the original image data.

[0031] Specifically, after the eyepiece display information is obtained, the field of view information and the watermark information in the eyepiece display information are determined, the original image data is image-masked according to the field of view information of the eyepiece to obtain a target display image. The target display image is taken as the eyepiece display image, and / or the watermark information is encoded into the target display image to obtain the eyepiece display image.

[0032] As an optional implementation, since the electronic eyepiece displays the image in a circular shape during the image display process, the image processing system usually needs to process the original image into an image matching the eyepiece display screen through a circular mask and / or image cropping. The image mask is used to display only a part of the image without changing the image. Alternatively, the image processing system can crop the original image data according to the field of view range parameter in the eyepiece display information, remove the redundant part, and retain the circular field of view area, so that the user's field of view based on the electronic eyepiece matches the eyepiece display image.

[0033] As another optional implementation, the image processing system also needs to add a watermark to the image. The watermark includes a watermark identification displayed in the eyepiece display screen of the electronic eyepiece, such as a power identification, a WIFI identification, and menu information, and / or user-defined watermark information.

[0034] Specifically, the eyepiece display information can encode the watermark information into the target display image directly through image encoding to obtain the eyepiece display image, or add the watermark to the target display image through watermark overlay to obtain the eyepiece display image. It should be noted that the watermark added by the encoding method is directly "embedded" in the video, so that the video stream obtained when the video is output is the eyepiece display image containing the watermark. The eyepiece display image with the watermark added through the overlay method does not contain the corresponding watermark based on a separate layer when the image is output, such as generating a video recording or sending a video stream.

[0035] Alternatively, the electronic eyepiece also has a laser ranging function. It determines the target distance information by sending laser information to the observation direction and receiving the reflection information of the laser. The image processing system can encode the distance information as a watermark into the image, so that the output video directly contains the watermark. For example, in a golf scene, the electronic eyepiece identifies the distance of the flag or the golf ball based on the different reflection distances of the laser touching the flag or the front plate and / or the movement information caused by the continuously changing distance of the golf ball, and adds the distance as encoding information to the pixel point area corresponding to the landing point of the flag and / or the golf ball in the image.

[0036] Alternatively, the user can set the watermark information in the electronic eyepiece or input the watermark information through the target terminal through communication connection with the target terminal, so that the image processing system adds the corresponding watermark when encoding.

[0037] For example, the microprocessor first groups the watermark bit stream into fixed length, each group corresponding to a pixel channel, generates a mapping table of pixel address and bit, and ensures uniform distribution and subsequent addressability of the watermark. The microprocessor scans the circular area of the target display image by row, and sequentially takes out the red, green and blue component values of each pixel, ready for modification. For the current pixel channel value, the lowest bit is cleared, and the corresponding watermark bit is written into the bit, wherein if higher robustness is required, the lowest two bits can be expanded or the parity bit can be used. This action has little effect on the pixel value, and the brightness change is less than 1 gray scale, which cannot be distinguished by the naked eye. The modified pixel value is immediately written back to the frame buffer at the same address, overwriting the original value. After completing the whole frame, the watermark has been completely integrated into the image data, without the need for an additional layer. The processor calculates the cyclic redundancy check (CRC) of the whole frame and attaches it to the end of the watermark, which is also embedded in the reserved pixel bit for subsequent terminal verification of the integrity of the watermark. For example, when the watermark content is 32 bits of timestamp and device ID, the microprocessor uniformly distributes the 32 bits to the lowest bit of 1024 pixels in the circular field, with each pixel contributing 1 bit. The final displayed ocular image is indistinguishable from the ordinary image to the naked eye, but the decoding end only needs to read the lowest bit of the 1024 pixels to restore the timestamp and device ID without loss, achieving covert tracing.

[0038] Step S30: obtaining target terminal display information, and performing a second image processing action on the original image data according to the target terminal display information to obtain a shared image; In this embodiment, the target terminal can be a computer, a mobile phone or other terminal device with a display screen and communication transmission function, which can transmit information with the electronic observation device through wired or wireless means. The image processing system deployed in the electronic observation device can send the original image data to the target terminal as a shared image through a second image processing action based on the target terminal display information. The target terminal display information refers to the display requirement parameters sent by the target terminal, including resolution, watermark requirement, display requirement, etc. The second image processing action refers to another series of processing operations on the original image data, such as information frequency modulation, data format conversion and / or image cutting, to generate an image suitable for display on the target terminal.

[0039] As an optional implementation, the image processing system can acquire display information of the target terminal, the display information comprising target terminal information and display requirement information. The target terminal information is device information of the target terminal, used to determine the format conversion and / or resolution adjustment manner required by the image, and the display requirement information can be determined based on the setting information of the user on the menu interface of the target terminal, and comprises a display mode and / or display parameters. The image processing system encodes the original image data with a watermark and / or performs image masking according to the display requirement information, to form a target device image. For example, when the user selects a preview mode, the image processing system crops the original image data into a circular image based on the same field of view parameter information of the electronic device. The image processing system further performs format conversion and resolution adjustment on the target device image according to the target terminal information, to generate a shared image.

[0040] Optionally, the target terminal information further comprises communication quality information, and the image processing system can acquire the communication quality information fed back by the target terminal in real time. When the communication quality information is lower than a preset threshold, the image processing system dynamically reduces the code rate or resolution of the shared image, and continues to send the adjusted shared image to the target terminal, to maintain continuous display. The second image processing action can be the same as or different from the first image processing action.

[0041] As another optional implementation, the image processing system can also perform a second image processing action on the eyepiece display image obtained by performing the first image processing action on the original image data, according to the display requirement information of the user sent by the target terminal, to generate a shared image. The second image processing action comprises format conversion, resolution adjustment, image cropping or splicing, etc.

[0042] Step S40: outputting the eyepiece display image to a local display module through an eyepiece interface; In this embodiment, the local display module refers to a display screen inside the electronic eyepiece, used to display the processed image to the user. The eyepiece interface refers to an interface used to transmit image data from the image processing module to the local display module.

[0043] As an optional implementation, the eyepiece interface comprises a high-bandwidth mobile display interface (HTMI) and / or a mobile industry processor interface (MIPI). The image processing system encapsulates the eyepiece display image into a high-bandwidth mobile display interface frame, and transmits the mobile display interface frame to the bridge chip through the mobile display interface. The bridge chip performs a physical layer packet image format conversion on the mobile display interface frame, generates a mobile processor interface frame, and transmits the mobile processor interface frame to the local display module through the mobile processor interface, so that the local display module refreshes and presents the eyepiece display image frame by frame according to the received timing.

[0044] For example, the bridge chip completes two-point conversion of the data packet format at the physical layer, converts the high-speed serial differential signal of the HTMI into a low-voltage differential signal of the MIPI, and maps the frame synchronization and line synchronization packet of the HTMI into a cycle packet of the MIPI.

[0045] Step S50: and transmit the shared image to the target terminal through the communication interface, so that the target terminal displays the shared image on the display screen.

[0046] In this embodiment, the communication interface refers to a communication module for transmitting image data from the electronic eyepiece to the target terminal, such as a wireless communication module such as Wi-Fi or Bluetooth, or a wired communication module based on a data line. The image processing system encodes the shared image into a frame format suitable for transmission according to the corresponding communication protocol. Then, the encoded frame is sent to the target terminal in a direct connection or forwarding manner through the communication interface. After receiving the frame, the target terminal decodes and displays the shared image. Among them, the image processing system can be connected through Bluetooth or wifi wireless network, and the shared image is sent directly to the target terminal through the wireless network, or the image is sent to the server, and the server forwards the shared image to the target terminal for sharing.

[0047] As a first optional implementation, the electronic eyepiece directly sends the shared image to the target terminal for sharing. It establishes a wireless communication link with the target terminal, and transmits a transmission frame to the target terminal through the wireless communication link, wherein the target terminal obtains the shared image by decoding the transmission frame, and displays the shared image at the current time on the display screen. The shared images of different time frames are played based on time to form a video stream.

[0048] As a second optional implementation, the electronic eyepiece can send the shared image to a sharing server and share the shared image to one or more terminal devices through image forwarding of the sharing server. Wherein, the electronic eyepiece sends a transmission frame to the sharing server, so that the sharing server sends the transmission frame to a target terminal after receiving a sharing request of the target terminal, and the target terminal obtains the shared image by decoding the transmission frame and displays the shared image of the current time on a display screen.

[0049] As a third optional implementation, since some electronic eyepieces lack networking or remote communication functions, they can share the shared image to other terminal devices through the target terminal and the sharing server and the like after sending the shared image to the target terminal. Specifically, the target terminal generates a target shared image based on the shared image and sends the target shared image to the sharing server. The sharing server sends the target shared image to other terminal devices after receiving a target sharing request sent by the other terminal devices.

[0050] The embodiment of the present application obtains original image data through the image sensor, performs first image processing on the original data based on the eyepiece display information to obtain an eyepiece display image adapted to local display, and performs second image processing on the same original data according to target terminal display information to generate a shared image adapted to a remote terminal. The local display image is displayed in the target terminal and the electronic eyepiece through different interfaces, so that the electronic sighting device maintains normal observation experience of the local user while providing an image stream to external terminal devices through a communication interface, thereby realizing synchronous performance of local observation and remote sharing through a double-path parallel processing mechanism, and improving the efficiency of image observation and the convenience of operation in a multi-person collaborative scenario.

[0051] Based on the same inventive concept, the present application also provides a second embodiment, which refers to Figure 2 , Figure 2 The flowchart of the second embodiment of the image sharing method of the electronic eyepiece of the present application is shown.

[0052] In the present embodiment, after the eyepiece display image is output to the local display module through the eyepiece interface as described in step S40, steps S41-S43 are further included: Step S41: receiving an image zoom request, determining a center pixel point and a zoom ratio of the image zoom request; Step S42: obtaining zoom size information, determining a zoomed pixel region according to the zoom size information and the center pixel point; Step S43: performing a zoom-out action or a zoom-in action on the zoomed pixel region according to the zoom ratio.

[0053] In the embodiment, the image zoom request is captured by the interaction unit of the electronic eyepiece, which can be a physical button or a voice instruction parser. The center pixel point is obtained by recording the current field center coordinates or selected by the user, and the zoom scale is represented by a floating point value, for example, 2.0 corresponds to two times magnification. The interaction unit writes the center pixel point coordinates and the zoom scale into the zoom control register for reading by the subsequent modules. The zoom size information is derived from the real-time resolution feedback of the local display module or the target terminal. The image processing core of the electronic eyepiece expands uniformly around the center pixel point to form a rectangular or circular zoomed pixel region, ensuring that the center pixel is always located at the geometric center of the region, thereby avoiding picture drift. The image processing core calls the bicubic interpolation engine to resample the pixel values in the zoomed pixel region. When zooming in, the interpolation engine inserts estimated values between the original pixels to improve details, and when zooming out, the engine reduces the pixel density by weighted averaging to reduce the amount of data. The processed pixel values immediately overwrite the corresponding area in the original frame buffer and seamlessly splice with the non-zoomed area. Optionally, the zoomed image can be displayed in a floating window on the screen, allowing the electronic eyepiece to display the image in a paging manner.

[0054] The embodiment of the present application provides zoom-in or zoom-out of the field of view in real time while keeping the center aiming point unchanged, so that the wearer can obtain clear details without moving the device when observing a distant place, and the image observation accuracy is improved.

[0055] The system described in Embodiment Two of the present application is the system used to implement the method of Embodiment One of the present application, so based on the method described in Embodiment One of the present application, those skilled in the art can understand the specific structure and modifications of the system, and thus it will not be described here. Any system used by the method of Embodiment One of the present application belongs to the scope of protection of the present application.

[0056] Based on the same inventive concept, the present application also provides a third embodiment, which is described with reference to Figure 3 , Figure 3 The flowchart of the third embodiment of the image sharing method of the electronic eyepiece of the present application.

[0057] In the embodiment, after the shared image is sent to the target terminal through the communication interface as described in step S50 and, the target terminal displays the shared image on the display screen, further comprising steps S51-S52: Step S51: in response to the video recording instruction, the generated shared image is cached as video recording data according to the time sequence; Step S52: after receiving the playback request of the video recording data, the video recording data is output to the local display module, and / or the video recording data is sent to the target terminal.

[0058] In the embodiment, the video recording instruction is sent by the target terminal through the wireless link, and the communication interface of the electronic eyewear triggers the video recording control logic after parsing the instruction. The video recording control logic opens a circular buffer in the memory, and each received frame of shared image is written into the buffer in the order of time stamp. When the buffer is full, the earliest frame is automatically overwritten, ensuring continuous recording. The buffer index table records the starting address and duration of each frame, facilitating fast retrieval. The replay request is triggered by the terminal or the local button. The microprocessor of the electronic eyewear locates the starting frame according to the index table, and reads out the video data in the original frame rate. If local playback is selected, the microprocessor sends the frame data directly to the local display module; if remote playback is selected, the microprocessor re-encodes the frame data into transmission frames and sends them to the target terminal. The target terminal presents the decoded frames in the original time sequence, maintaining audio and video synchronization. The recording can be performed by the target terminal or sent to the server for storage. When the image processing action of the electronic eyewear includes watermark encoding, the output video contains watermark information.

[0059] Since the system introduced in Embodiment Three of the present application is the system used to implement the method of Embodiment One of the present application, the specific structure and variations of the system can be understood by those skilled in the art based on the method introduced in Embodiment One of the present application, and thus will not be described here. Any system used by the method of Embodiment One of the present application belongs to the scope intended to be protected by the present application.

[0060] The present application provides an image sharing device of an electronic eyewear, which comprises at least one processor; and a memory in communication connection with the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the image sharing method of the electronic eyewear in Embodiment One.

[0061] Reference will now be made to Figure 4 which shows a structural schematic diagram of an image sharing device of an electronic eyewear suitable for implementing the embodiments of the present application. The image sharing device of the electronic eyewear in the embodiments of the present application can include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (Personal Digital Assistant), PADs (Portable Application Description), PMPs (Portable Media Player), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), and the like, and fixed terminals such as digital TVs, desktop computers, and the like. Figure 4 The image sharing device of the electronic eyewear shown is merely an example and should not impose any limitation on the functions and use range of the embodiments of the present application.

[0062] As shown in Figure 4 The image sharing device of the electronic eyeglasses can include a processing device 1001 (e.g., a core processor, a graphics processor, etc.) that can perform various appropriate actions and processes according to programs stored in a read-only memory (ROM) 1002 or programs loaded from a storage device 1003 into a random access memory (RAM) 1004. Various programs and data required for the operation of the image sharing device of the electronic eyeglasses are also stored in the random access memory 1004. The processing device 1001, the read-only memory 1002, and the random access memory 1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: input devices 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; output devices 1008 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; the storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the image sharing device of the electronic eyeglasses to communicate with other devices wirelessly or by wire to exchange data. Although the image sharing device of the electronic eyeglasses with various systems is shown in the figure, it should be understood that all the systems shown are not required to be implemented or possessed. More or fewer systems can be alternatively implemented or possessed.

[0063] In particular, the processes described above with reference to the flowcharts can be implemented as a computer software program according to embodiments of the present disclosure. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a computer readable medium, the computer program containing program code for executing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network by a communication device, or installed from the storage device 1003, or installed from the read-only memory 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the methods of embodiments of the present disclosure are performed.

[0064] The image sharing device of the electronic eyeglasses provided by the present disclosure adopts the image sharing method of the electronic eyeglasses in the above-mentioned embodiments, and can solve the technical problem that the electronic eyeglasses are inconvenient to use in the scene of collaborative observation by multiple people. Compared with the prior art, the image sharing device of the electronic eyeglasses provided by the present disclosure has the same beneficial effects as the image sharing method of the electronic eyeglasses provided by the above-mentioned embodiments, and other technical features in the image sharing device of the electronic eyeglasses are the same as the features disclosed in the previous embodiment method, which will not be described here.

[0065] It should be understood that various parts of the present disclosure can be implemented in hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0066] The above description is merely illustrative of the application and not restrictive thereof; the scope of the application should be determined by the appended claims.

[0067] The present application provides a computer readable storage medium having stored thereon computer readable program instructions (i.e., computer programs) for performing the image sharing method of the electronic eyepiece in the above embodiments.

[0068] The computer readable storage medium provided by the present application may, for example, be a U disk, but is not limited to an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, system, or device, or any combination thereof. More specific examples of the computer readable storage medium can include, but are not limited to, an electrical connection having one or more conductive wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present embodiment, the computer readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer readable storage medium can be transmitted in any suitable medium, including but not limited to electrical wire, optical cable, radio frequency (RF), and the like, or any suitable combination thereof.

[0069] The above computer readable storage medium can be included in the image sharing device of the electronic eyepiece; or can exist separately and not be assembled into the image sharing device of the electronic eyepiece.

[0070] The computer readable storage medium described above carries one or more programs, when the one or more programs are executed by the image sharing device of the electronic eyepiece, the image sharing device of the electronic eyepiece: acquires original image data through the image sensor, performs a first image processing action on the original image data based on the eyepiece display information to obtain an eyepiece display image, acquires target terminal display information, performs a second image processing action on the original image data according to the target terminal display information to obtain a shared image, outputs the eyepiece display image to the local display module through the eyepiece interface, and sends the shared image to the target terminal through the communication interface, so that the target terminal displays the shared image on the display screen.

[0071] Computer program code for carrying out operations of the present application can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0072] The flow diagrams and the block diagrams in the drawings are illustrations of possible architectures, functions, and operations for systems, methods, and computer program products according to various embodiments of the present application. In this regard, each block in the flow diagrams or block diagrams can represent a module, a segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks may

[0073] The modules described in the embodiments of the present application can be implemented in the form of software or in the form of hardware. In some cases, the name of the module does not constitute a limitation on the module itself.

[0074] The readable storage medium provided by the present application is a computer readable storage medium, which stores computer readable program instructions (i.e. computer programs) for executing the image sharing method of the electronic eyepiece, and can solve the technical problem that the electronic eyepiece is inconvenient to use in the scene of multi-person collaborative observation. Compared with the prior art, the beneficial effects of the computer readable storage medium provided by the present application are the same as those of the image sharing method of the electronic eyepiece provided by the above-mentioned embodiments, and are not described here.

[0075] The above only describes some embodiments of the present application, and does not limit the patent scope of the present application. Any equivalent structural transformation, direct / indirect application in other related technical fields based on the technical concept of the present application, and the contents of the present application specification and drawings are included in the patent protection scope of the present application.

Claims

1. An image sharing method for an electronic eyepiece, characterized in that, The method includes the following steps: Raw image data is acquired using an image sensor; Based on the eyepiece display information, a first image processing action is performed on the original image data to obtain the eyepiece display image; Obtain target terminal display information, and perform a second image processing action on the original image data based on the target terminal display information to obtain a shared image; The image displayed through the eyepiece interface is output to the local display module. Furthermore, the shared image is sent to the target terminal via a communication interface so that the target terminal displays the shared image on its screen.

2. The method as described in claim 1, characterized in that, The step of performing a first image processing action on the original image data based on the eyepiece display information to obtain the eyepiece display image includes: Determine the field of view information and watermark information in the eyepiece display information; Based on the field of view information, image masking is performed on the original image data to obtain the target display image; The watermark information is encoded into the target display image to obtain the eyepiece display image.

3. The method as described in claim 1, characterized in that, The steps of acquiring target terminal display information and performing a second image processing action on the original image data based on the target terminal display information to obtain a shared image include: Obtain the display information of the target terminal, wherein the display information includes target terminal information and display requirement information; Based on the display requirement information, the original image data is watermarked and / or masked to form a target device image; Based on the target terminal information, the target device image is converted in format and its resolution is adjusted to generate the shared image.

4. The method as described in claim 1, characterized in that, The step of outputting the image displayed through the eyepiece interface to the local display module includes: The eyepiece display image is encapsulated into a mobile display interface frame, and the mobile display interface frame is sent to the bridge chip through the mobile display interface; The bridging chip performs physical layer data packet image format conversion on the mobile display interface frame to generate a mobile processor interface frame. The mobile processor interface frame is sent to the local display module via the mobile processor interface, so that the local display module refreshes and presents the eyepiece display image frame by frame according to the received timing.

5. The method as described in claim 1, characterized in that, The step of sending the shared image to the target terminal via a communication interface, so that the target terminal displays the shared image on its screen, includes: According to the preset communication link protocol, the shared image is encoded into a transmission frame; A wireless communication link is established with the target terminal, and the transmission frame is sent to the target terminal through the wireless communication link. The target terminal obtains the shared image by decoding the transmission frame and displays the shared image at the current moment on the display screen. And / or, the transmission frame is sent to the sharing server, so that after receiving the sharing request from the target terminal, the sharing server sends the transmission frame to the target terminal, the target terminal obtains the shared image by decoding the transmission frame, and displays the shared image at the current moment on the display screen.

6. The method as described in claim 5, characterized in that, After the steps of establishing a wireless communication link with the target terminal and sending the transmission frame to the target terminal through the wireless communication link, wherein the target terminal obtains the shared image by decoding the transmission frame and displays the shared image at the current moment on the display screen, the method further includes: The target terminal generates a target shared image based on the shared image and sends the target shared image to the sharing server; After receiving a target sharing request from another terminal, the sharing server sends the target shared image to the other terminal.

7. The method as described in claim 1, characterized in that, After the step of outputting the eyepiece display image to the local display module via the eyepiece interface, the method further includes: Receive an image scaling request and determine the center pixel and scaling ratio of the image scaling request; Obtain scaling size information, and determine the scaling pixel region based on the scaling size information and the center pixel point; Based on the scaling ratio, a shrinking or enlarging action is performed on the scaling pixel region.

8. The method as described in claim 1, characterized in that, After the step of sending the shared image to the target terminal via a communication interface so that the target terminal displays the shared image on its screen, the method further includes: In response to a recording command, the generated shared images are cached as recording data according to time sequence; Upon receiving a playback request for the recorded data, the recorded data is output to the local display module, and / or sent to the target terminal.

9. An image sharing device for an electronic eyepiece, characterized in that, The device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the image sharing method for the electronic eyepiece as claimed in any one of claims 1 to 8.

10. A storage medium, characterized in that, The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, it implements the steps of the image sharing method of the electronic eyepiece as described in any one of claims 1 to 8.

Images