Image sharing methods, devices and storage media for electronic eyepieces

Abstract

This application discloses an image sharing method, device, and storage medium for an electronic eyepiece, belonging to the field of image communication technology. The method includes: acquiring raw image data through an image sensor; performing a first image processing action on the raw image data based on eyepiece display information to obtain an eyepiece display image; acquiring target terminal display information; performing a second image processing action on the raw image data based on the target terminal display information to obtain a shared image; outputting the eyepiece display image to a local display module through an eyepiece interface; and sending the shared image to the target terminal through a communication interface, so that the target terminal displays the shared image on its screen. This application achieves simultaneous local observation and remote sharing through a dual-path parallel processing mechanism, thereby improving the efficiency and ease of operation of image observation in multi-person collaborative scenarios.

Description

Technical Field

[0001] This application relates to the field of image communication technology, and in particular to an image sharing method, device and storage medium for an electronic eyepiece. Background Technology

[0002] In related technologies, such as telescopes and night vision devices, images are typically acquired and displayed through electronic eyepieces. Specifically, after acquiring raw image data through an image sensor, the device performs a set of fixed image processing algorithms, such as noise reduction, color correction, and scaling, based on the parameter characteristics of the eyepiece's built-in display module, to generate an image suitable for local display. This image is then output to a local display screen for observation via the eyepiece interface.

[0003] However, because the observation equipment only provides local display output and cannot offer adaptive image output to other observers, usually only one user can view the image through the eyepiece during the observation process. Therefore, in scenarios involving collaborative observation by multiple people, different users can usually only take turns viewing the image, which is quite inconvenient.

[0004] The above content is only used to help understand the technical solution of this application and does not represent an admission that the above content is prior art. Summary of the Invention

[0005] The main purpose of this application is to provide an image sharing method, device and storage medium for electronic eyepieces, which aims to solve the technical problem of the inconvenience of using electronic eyepieces in scenarios of multi-person collaborative observation.

[0006] To achieve the above objectives, this application provides an image sharing method for an electronic eyepiece, the method comprising the following steps:

[0007] Raw image data is acquired using an image sensor;

[0008] Based on the eyepiece display information, a first image processing action is performed on the original image data to obtain the eyepiece display image;

[0009] Obtain target terminal display information, and perform a second image processing action on the original image data based on the target terminal display information to obtain a shared image;

[0010] The image displayed through the eyepiece interface is output to the local display module.

[0011] Furthermore, the shared image is sent to the target terminal via a communication interface so that the target terminal displays the shared image on its screen.

[0012] In one embodiment, the step of performing a first image processing action on the original image data based on the eyepiece display information to obtain the eyepiece display image includes:

[0013] Determine the field of view information and watermark information in the eyepiece display information;

[0014] Based on the field of view information, image masking is performed on the original image data to obtain the target display image;

[0015] The watermark information is encoded into the target display image to obtain the eyepiece display image.

[0016] In one embodiment, the step of acquiring target terminal display information and performing a second image processing action on the original image data based on the target terminal display information to obtain a shared image includes:

[0017] Obtain the display information of the target terminal, wherein the display information includes target terminal information and display requirement information;

[0018] Based on the display requirement information, the original image data is watermarked and / or masked to form a target device image;

[0019] Based on the target terminal information, the target device image is converted in format and its resolution is adjusted to generate the shared image.

[0020] In one embodiment, the step of outputting the eyepiece display image to the local display module via the eyepiece interface includes:

[0021] The eyepiece display image is encapsulated into a mobile display interface frame, and the mobile display interface frame is sent to the bridge chip through the mobile display interface;

[0022] The bridging chip performs physical layer data packet image format conversion on the mobile display interface frame to generate a mobile processor interface frame.

[0023] The mobile processor interface frame is sent to the local display module via the mobile processor interface, so that the local display module refreshes and presents the eyepiece display image frame by frame according to the received timing.

[0024] In one embodiment, the step of sending the shared image to a target terminal via a communication interface, so that the target terminal displays the shared image on a display screen, includes:

[0025] According to the preset communication link protocol, the shared image is encoded into a transmission frame;

[0026] A wireless communication link is established with the target terminal, and the transmission frame is sent to the target terminal through the wireless communication link. The target terminal obtains the shared image by decoding the transmission frame and displays the shared image at the current moment on the display screen.

[0027] And / or, the transmission frame is sent to the sharing server, so that after receiving the sharing request from the target terminal, the sharing server sends the transmission frame to the target terminal, the target terminal obtains the shared image by decoding the transmission frame, and displays the shared image at the current moment on the display screen.

[0028] In one embodiment, after the steps of establishing a wireless communication link with the target terminal and sending the transmission frame to the target terminal through the wireless communication link, wherein the target terminal obtains the shared image by decoding the transmission frame and displays the shared image at the current moment on the display screen, the method further includes:

[0029] The target terminal generates a target shared image based on the shared image and sends the target shared image to the sharing server;

[0030] After receiving a target sharing request from another terminal, the sharing server sends the target shared image to the other terminal.

[0031] In one embodiment, after the step of outputting the eyepiece display image to the local display module via the eyepiece interface, the method further includes:

[0032] Receive an image scaling request and determine the center pixel and scaling ratio of the image scaling request;

[0033] Obtain scaling size information, and determine the scaling pixel region based on the scaling size information and the center pixel point;

[0034] Based on the scaling ratio, a shrinking or enlarging action is performed on the scaling pixel region.

[0035] In one embodiment, after the step of sending the shared image to the target terminal via a communication interface so that the target terminal displays the shared image on a display screen, the method further includes:

[0036] In response to a recording command, the generated shared images are cached as recording data according to time sequence;

[0037] Upon receiving a playback request for the recorded data, the recorded data is output to the local display module, and / or sent to the target terminal.

[0038] In addition, to achieve the above objectives, this application also provides an image sharing device for an electronic eyepiece, the device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the image sharing method for the electronic eyepiece as described above.

[0039] In addition, to achieve the above objectives, this application also provides a storage medium, which is a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, it implements the steps of the image sharing method of the electronic eyepiece as described above.

[0040] One or more technical solutions proposed in this application have at least the following technical effects:

[0041] This application acquires raw image data via an image sensor, performs a first image processing on the raw data based on the eyepiece display information to obtain an eyepiece display image adapted for local display, and simultaneously performs a second image processing on the same raw data according to the target terminal display information to generate a shared image adapted for a remote terminal. The images are simultaneously displayed on the target terminal and the electronic eyepiece through different interfaces, allowing the electronic observation device to maintain the normal observation experience of the local user while also providing an image stream to an external terminal through a communication interface. This dual-path parallel processing mechanism enables simultaneous local observation and remote sharing, thereby improving the efficiency of image observation and the convenience of operation in multi-person collaborative scenarios. Attached Figure Description

[0042] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0043] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0044] Figure 1 This is a flowchart illustrating the first embodiment of the image sharing method for the electronic eyepiece of this application;

[0045] Figure 2 This is a flowchart illustrating the second embodiment of the image sharing method for the electronic eyepiece of this application;

[0046] Figure 3 This is a flowchart illustrating the third embodiment of the image sharing method for the electronic eyepiece of this application;

[0047] Figure 4 This is a schematic diagram of the structure of an image sharing device with an electronic eyepiece in the hardware operating environment involved in the embodiments of this application.

[0048] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0049] It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to limit this application.

[0050] To better understand the above technical solutions, the following will provide a detailed explanation of the technical solutions in conjunction with the accompanying drawings and specific implementation methods.

[0051] The main solution of this application embodiment is as follows: acquiring raw image data through an image sensor, performing a first image processing action on the raw image data based on the eyepiece display information to obtain an eyepiece display image, acquiring target terminal display information, performing a second image processing action on the raw image data according to the target terminal display information to obtain a shared image, outputting the eyepiece display image to a local display module through the eyepiece interface, and sending the shared image to the target terminal through a communication interface so that the target terminal displays the shared image on the display screen.

[0052] In existing technologies, such as telescopes and night vision devices, images are typically acquired and displayed through electronic eyepieces. After acquiring raw image data via an image sensor, the device performs a fixed image processing algorithm—such as noise reduction, color correction, and scaling—based on the parameters of the eyepiece's built-in display module, generating an image suitable for local display. This image is then output to a local display screen via the eyepiece interface for observation. However, because these devices only provide local display output and cannot offer adaptive image output to other observers, typically only one user can view the image through the eyepiece during observation. Therefore, in scenarios involving collaborative observation by multiple users, different users can only take turns viewing the image, which is inconvenient.

[0053] This application acquires raw image data via an image sensor, performs a first image processing on the raw data based on the eyepiece display information to obtain an eyepiece display image adapted for local display, and simultaneously performs a second image processing on the same raw data according to the target terminal display information to generate a shared image adapted for a remote terminal. The images are simultaneously displayed on the target terminal and the electronic eyepiece through different interfaces, allowing the electronic observation device to maintain the normal observation experience of the local user while also providing an image stream to an external terminal through a communication interface. This dual-path parallel processing mechanism enables simultaneous local observation and remote sharing, thereby improving the efficiency of image observation and the convenience of operation in multi-person collaborative scenarios.

[0054] To better understand the above technical solutions, exemplary embodiments of this application will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of this application are shown in the drawings, it should be understood that this application can be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided to enable a more thorough understanding of this application and to fully convey the scope of this application to those skilled in the art.

[0055] It should be noted that the executing entity in this embodiment can be an image processing system of an electronic observation and aiming device, or a computing service device with data processing, network communication, and program execution functions, such as a tablet computer, personal computer, or mobile phone, or an electronic device or an image sharing device for an electronic eyepiece capable of the above functions. This embodiment does not specifically limit it in this regard. The following uses an image processing system as an example to describe this embodiment and the following embodiments.

[0056] Based on this, embodiments of this application provide an image sharing method for an electronic eyepiece, referring to... Figure 1 , Figure 1 This is a flowchart illustrating the first embodiment of the image sharing method for the electronic eyepiece of this application.

[0057] In this embodiment, the image sharing method of the electronic eyepiece includes steps S10 to S40:

[0058] Step S10: Acquire raw image data using an image sensor;

[0059] In this embodiment, the electronic eyepiece can be optionally deployed in electronic observation and aiming devices such as telescopes, night vision devices, or microscopes. It includes an image sensor that converts light signals into electrical signals via a photoelectric conversion device to acquire raw image data. The image sensor first receives light from the outside world, which is then focused by an optical lens onto the sensor's pixel array. Each pixel converts the received light signal into an electrical signal, which is then quantized into a digital signal by an analog-to-digital converter (ADC). The digital signal is read out based on a timing sequence to form the raw image data.

[0060] Step S20: Based on the eyepiece display information, perform a first image processing action on the original image data to obtain the eyepiece display image;

[0061] In this embodiment, the eyepiece display information refers to the information used by the electronic eyepiece to display the raw image data, including data format, field of view, watermark pattern, etc. This eyepiece display information can be obtained by the image processing system based on user-preset display information, display mode, and / or the device information of the electronic eyepiece. Based on this eyepiece display information, the image processing system performs a first image processing action on the raw image data to generate an image suitable for display on the eyepiece, i.e., the eyepiece display image. The first image processing action refers to a series of processing operations performed by the image processing system on the raw image data.

[0062] Specifically, after acquiring the eyepiece display information, the field of view information and watermark information in the eyepiece display information are determined. Based on the field of view information of the eyepiece, image masking is performed on the original image data to obtain the target display image. The target display image is then used as the eyepiece display image, and / or, the watermark information is encoded into the target display image to obtain the eyepiece display image.

[0063] As an optional implementation, since electronic eyepieces typically display images in a circular shape, the image processing system usually needs to process the original image to match the eyepiece display screen using a circular mask and / or image cropping. The image mask is used to display only a portion of the image without altering its shape. Optionally, the image processing system can crop the original image data based on the field of view parameters in the eyepiece display information, removing redundant parts and retaining the circular field of view area, so that the user's field of view based on the electronic eyepiece matches the image displayed by the eyepiece.

[0064] As an alternative implementation, the image processing system also needs to add a watermark to the image. This watermark includes watermark identifiers displayed on the eyepiece screen by the electronic eyepiece, such as battery level indicators, Wi-Fi indicators, and menu information, and / or user-defined watermark information.

[0065] Specifically, the eyepiece display information can be obtained by directly encoding the watermark information into the target display image through image encoding, or by adding the watermark to the target display image through watermark overlay. It's important to note that watermarks added through encoding are directly "embedded" in the video, ensuring that the output video stream contains watermarked eyepiece display images. However, eyepiece display images where the watermark is displayed through overlay will have separate layers and will not contain the corresponding watermark during image output actions such as recording or sending video streams.

[0066] Optionally, the electronic eyepiece also features laser ranging capabilities. It determines the target distance by sending laser information in the observation direction and receiving the reflected laser light. The image processing system can encode this distance information as a watermark into the image, ensuring the watermark is directly included in the output video. For example, in a golf scene, the electronic eyepiece identifies the distance to the flag or golf ball based on the varying reflection distances of the laser hitting the flag or front plate, and / or the movement information resulting from the continuously changing distance of the golf ball. This distance is then encoded and added to the pixel area corresponding to the landing point of the flag and / or golf ball in the image.

[0067] Optionally, users can set watermark information in the electronic eyepiece or input watermark information through the target terminal via a communication connection, so that the image processing system can add the corresponding watermark during encoding.

[0068] For example, the microprocessor first groups the watermark bitstream into fixed-length groups, each group corresponding to a pixel channel, generating a mapping table between pixel addresses and bits to ensure the watermark is evenly distributed and subsequently addressable. The microprocessor scans the circular area of ​​the target display image line by line, sequentially extracting the red, green, and blue component values ​​of each pixel, ready for modification. For the current pixel channel value, the least significant bit is cleared first, and then the corresponding watermark bit is written to that bit. For higher robustness, this can be extended to the least significant two bits or a parity check bit can be used. This action has minimal impact on the pixel value; the brightness change is less than one gray level, imperceptible to the naked eye. The modified pixel value is immediately written back to the same address in the frame buffer, overwriting the original value. After the entire frame is completed, the watermark is completely integrated into the image data, requiring no additional layer. The processor calculates the entire frame's cyclic redundancy check (CRC) and appends it to the end of the watermark code, also embedded in a reserved pixel bit, for subsequent terminal verification of watermark integrity. For example, when the watermark content consists of a timestamp and a device ID, totaling 32 bits, the microprocessor evenly distributes these 32 bits across the least significant bits of the 1024 pixels within a circular field of view, with each pixel contributing 1 bit. The final displayed eyepiece image appears identical to a normal image to the naked eye, but the decoding end only needs to read the least significant bits of these 1024 pixels to losslessly reconstruct the timestamp and device ID, achieving covert tracing.

[0069] Step S30: Obtain the target terminal display information, and perform a second image processing action on the original image data according to the target terminal display information to obtain a shared image;

[0070] In this embodiment, the target terminal can be a computer, mobile phone, or other terminal device with a display screen and communication transmission capabilities, which can transmit information with the electronic observation and aiming equipment via wired or wireless means. The image processing system deployed on the electronic observation and aiming equipment can send the original image data to the target terminal based on the target terminal's display information through a second image processing action to share the image. The target terminal's display information refers to the display requirement parameters sent by the target terminal, including resolution, watermark requirements, and display specifications. The second image processing action refers to another series of processing operations performed on the original image data, such as information frequency modulation, data format conversion, and / or image segmentation, to generate an image suitable for display on the target terminal.

[0071] As an optional implementation, the image processing system can acquire display information from the target terminal, including target terminal information and display requirement information. The target terminal information refers to the device information of the target terminal, used to determine the format conversion and / or resolution adjustment methods required for the image. The display requirement information can be determined based on user settings in the target terminal's menu interface, including display mode and / or display parameters. Based on the display requirement information, the image processing system performs watermark encoding and / or image masking on the original image data to form a target device image. For example, when the user selects preview mode, the target device image is cropped into a circular image based on the same field-of-view parameter information as the electronic device. The image processing system also performs format conversion and resolution adjustment on the target device image based on the target terminal information to generate a shared image.

[0072] Optionally, the target terminal information also includes communication quality information. The image processing system can acquire the communication quality information fed back by the target terminal in real time. When the communication quality information is lower than a preset threshold, the system dynamically reduces the bit rate or resolution of the shared image and continues to send the adjusted shared image to the target terminal to maintain continuous display. The second image processing action can be the same as the first image processing action or different from the second image processing action.

[0073] As another optional implementation, the image processing system can also perform a second image processing action, such as format conversion, resolution adjustment, image cropping or stitching, on the eyepiece display image obtained by performing a first image processing action on the original image data, based on the user's display requirement information sent by the target terminal, to generate a shared image.

[0074] Step S40: Output the image displayed through the eyepiece to the local display module via the eyepiece interface;

[0075] In this embodiment, the local display module refers to the display screen inside the electronic eyepiece, used to display the processed image to the user. The eyepiece interface refers to the interface used to transmit image data from the image processing module to the local display module.

[0076] As an optional implementation, the eyepiece interface includes a High-speed Transfer Mobile Interface (HTMI) and / or a Mobile Industry Processor Interface (MIPI). The image processing system encapsulates the eyepiece display image into a high-speed transfer mobile interface frame and sends the HTMI frame to the bridge chip via the HTMI. The bridge chip performs physical layer packet image format conversion on the HTMI frame to generate a mobile processor interface frame, which is then sent to the local display module via the mobile processor interface. This allows the local display module to refresh and present the eyepiece display image frame by frame according to the received timing sequence.

[0077] For example, the bridging chip performs two-point conversion of the data packet format at the physical layer, converting the high-speed serial differential signal of HTMI into the low-voltage differential signal of MIPI, and mapping the frame synchronization and line synchronization packets of HTMI into cyclic packets of MIPI.

[0078] Step S50: And, send the shared image to the target terminal through the communication interface so that the target terminal displays the shared image on the display screen.

[0079] In this embodiment, the communication interface refers to a communication module used to transmit image data from the electronic eyepiece to the target terminal, such as a wireless communication module like Wi-Fi or Bluetooth, or a wired communication module based on a data cable. The image processing system encodes the shared image into a frame format suitable for transmission according to the corresponding communication protocol. Then, the encoded frame is sent to the target terminal via the communication interface, either directly or by forwarding. Upon receiving the frame, the target terminal decodes and displays the shared image. The image processing system can connect wirelessly via Bluetooth or Wi-Fi and send the shared image directly to the target terminal, or send the image to a server, which then forwards it to the target terminal for sharing.

[0080] As a first alternative implementation, the electronic eyepiece directly transmits the shared image to the target terminal for sharing. It establishes a wireless communication link with the target terminal and sends transmission frames through this link. The target terminal decodes the transmission frames to obtain the shared image and displays the current shared image on its screen. Shared images from different time frames are played back in time, forming a video stream.

[0081] As a second alternative implementation, the electronic eyepiece can send the shared image to a sharing server, and then share the shared image to one or more terminal devices through image forwarding by the sharing server. Specifically, the electronic eyepiece sends a transmission frame to the sharing server, so that upon receiving a sharing request from a target terminal, the sharing server sends the transmission frame to the target terminal. The target terminal decodes the transmission frame to obtain the shared image and displays the current shared image on its screen.

[0082] As a third alternative implementation, since some electronic eyepieces lack networking or remote communication capabilities, they can send a shared image to a target terminal, which can then share it with other terminals via a sharing server or similar means. Specifically, the target terminal generates a target shared image based on the shared image and sends it to the sharing server. Upon receiving a target sharing request from another terminal, the sharing server sends the target shared image to that terminal.

[0083] In this embodiment, after acquiring raw image data through an image sensor, the raw data undergoes first image processing based on eyepiece display information to obtain an eyepiece display image adapted for local display. Simultaneously, a second image processing is performed on the same raw data according to the target terminal display information to generate a shared image adapted for a remote terminal. The images are simultaneously displayed on the target terminal and the electronic eyepiece through different interfaces, allowing the electronic observation device to maintain the normal observation experience for the local user while also providing an image stream to an external terminal through a communication interface. This dual-path parallel processing mechanism enables simultaneous local observation and remote sharing, thereby improving the efficiency of image observation and the convenience of operation in multi-person collaborative scenarios.

[0084] Based on the same inventive concept, this application also provides a second embodiment, referring to... Figure 2 , Figure 2 This is a flowchart illustrating the second embodiment of the image sharing method for the electronic eyepiece of this application.

[0085] In this embodiment, after outputting the eyepiece display image to the local display module via the eyepiece interface as described in step S40, steps S41 to S43 are further included:

[0086] Step S41: Receive an image scaling request and determine the center pixel and scaling ratio of the image scaling request;

[0087] Step S42: Obtain scaling size information, and determine the scaling pixel area based on the scaling size information and the center pixel point;

[0088] Step S43: Perform a shrinking or enlarging action on the scaled pixel area according to the scaling ratio.

[0089] In this embodiment, the image scaling request is captured by the interaction unit of the electronic eyepiece, which can be a physical button or a voice command parser. The center pixel is obtained by recording the coordinates of the current field of view center, or by user selection. The scaling ratio is represented by a floating-point value, for example, 2.0 corresponds to a magnification of two times. The interaction unit writes the center pixel coordinates and scaling ratio into the scaling control register for subsequent modules to read. The scaling size information comes from the real-time resolution feedback of the local display module or the target terminal. The image processing core of the electronic eyepiece expands uniformly outward from the center pixel to form a rectangular or circular scaling pixel area, ensuring that the center pixel is always located at the geometric center of the area, thereby avoiding image drift. The image processing core calls a bicubic interpolation engine to resample the pixel values ​​within the scaling pixel area. Specifically, during magnification, the interpolation engine inserts estimated values ​​between the original pixels to improve detail, while during scaling down, the engine reduces pixel density through weighted averaging to reduce data volume. The processed pixel values ​​immediately cover the corresponding area in the original frame buffer and are seamlessly stitched with the unscaled area. Alternatively, the scaled image can be displayed as a floating window on the screen, allowing the electronic eyepiece to display the image in a paginated manner.

[0090] This application embodiment uses an electronic eyepiece to provide real-time magnification or reduction of the field of view while keeping the central aiming point unchanged, so that the wearer can obtain clear details when observing distant objects without moving the device, thus improving the accuracy of image observation.

[0091] Since the system described in Embodiment 2 of this application is a system used to implement the method of Embodiment 1 of this application, those skilled in the art can understand the specific structure and variations of the system based on the method described in Embodiment 1 of this application, and therefore will not be described again here. All systems used in the method of Embodiment 1 of this application fall within the scope of protection of this application.

[0092] Based on the same inventive concept, this application also provides a third embodiment, referring to... Figure 3 , Figure 3 This is a flowchart illustrating the third embodiment of the image sharing method for the electronic eyepiece of this application.

[0093] In this embodiment, as described in step S50, after sending the shared image to the target terminal via the communication interface so that the target terminal displays the shared image on the screen, the method further includes steps S51-S52:

[0094] Step S51: In response to the recording instruction, the generated shared images are cached as recording data according to the time sequence;

[0095] Step S52: After receiving the playback request of the recorded data, output the recorded data to the local display module, and / or send the recorded data to the target terminal.

[0096] In this embodiment, the recording command is sent by the target terminal via a wireless link. The communication interface of the electronic eyepiece parses the command and triggers the recording control logic. The recording control logic allocates a circular buffer in memory. Each received frame of shared image is written to the buffer in timestamp order. When the buffer is full, the earliest frame is automatically overwritten to ensure continuous recording. The buffer index table records the start address and duration of each frame for quick retrieval. Playback requests are also triggered by the terminal or local buttons. The microprocessor of the electronic eyepiece locates the start frame according to the index table and reads the recording data sequentially at the original frame rate. If local playback is selected, the microprocessor sends the frame data directly to the local display module; if remote playback is selected, the frame data is re-encoded into transmission frames through the communication interface and sent to the target terminal. The target terminal decodes the data and presents it in the original time sequence, maintaining audio and video synchronization. The recording can be performed by the target terminal or sent to a server for storage. When the image processing action of the electronic eyepiece includes watermark encoding, the output recording contains watermark information.

[0097] Since the system described in Embodiment 3 of this application is a system used to implement the method of Embodiment 1 of this application, those skilled in the art can understand the specific structure and variations of the system based on the method described in Embodiment 1 of this application, and therefore will not be described again here. All systems used in the method of Embodiment 1 of this application fall within the scope of protection of this application.

[0098] This application provides an image sharing device for an electronic eyepiece, the device comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the image sharing method for the electronic eyepiece in the first embodiment described above.

[0099] The following is for reference. Figure 4The diagram illustrates a structural schematic of an image sharing device suitable for implementing the electronic eyepiece in the embodiments of this application. The image sharing device for the electronic eyepiece in the embodiments of this application may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Description), PMPs (Portable Media Players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 4 The image sharing device shown with the electronic eyepiece is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of this application.

[0100] like Figure 4 As shown, the image sharing device of the electronic eyepiece may include a processing unit 1001 (e.g., a core processor, graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in read-only memory (ROM) 1002 or a program loaded from storage device 1003 into random access memory (RAM) 1004. The random access memory 1004 also stores various programs and data required for the operation of the image sharing device of the electronic eyepiece. The processing unit 1001, the read-only memory 1002, and the random access memory 1004 are interconnected via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to I / O interface 1006: input devices 1007 including, for example, touchscreens, touchpads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; output devices 1008 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 1003 including, for example, magnetic tapes, hard disks, etc.; and communication devices 1009. Communication device 1009 allows the image sharing device of the electronic eyepiece to communicate wirelessly or wiredly with other devices to exchange data. Although the figure shows an image sharing device for an electronic eyepiece with various systems, it should be understood that it is not required to implement or possess all the systems shown. More or fewer systems can be implemented or possessed alternatively.

[0101] Specifically, according to the embodiments disclosed in this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from storage device 1003, or installed from read-only memory 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of the embodiments disclosed in this application.

[0102] The image sharing device for electronic eyepieces provided in this application, employing the image sharing method for electronic eyepieces in the above embodiments, can solve the technical problem of inconvenience in using electronic eyepieces in scenarios involving collaborative observation by multiple people. Compared with the prior art, the beneficial effects of the image sharing device for electronic eyepieces provided in this application are the same as those of the image sharing method for electronic eyepieces provided in the above embodiments, and other technical features in this image sharing device for electronic eyepieces are the same as those disclosed in the previous embodiment method, and will not be repeated here.

[0103] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples.

[0104] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0105] This application provides a computer-readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, the computer-readable program instructions being used to execute the image sharing method of the electronic eyepiece in the above embodiments.

[0106] The computer-readable storage medium provided in this application may be, for example, a USB flash drive, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, radio frequency (RF), etc., or any suitable combination thereof.

[0107] The aforementioned computer-readable storage medium may be included in the image sharing device of the electronic eyepiece; or it may exist independently and not assembled into the image sharing device of the electronic eyepiece.

[0108] The aforementioned computer-readable storage medium carries one or more programs. When the aforementioned one or more programs are executed by the image sharing device of the electronic eyepiece, the image sharing device of the electronic eyepiece: acquires raw image data through an image sensor; performs a first image processing action on the raw image data based on the eyepiece display information to obtain an eyepiece display image; acquires target terminal display information; performs a second image processing action on the raw image data based on the target terminal display information to obtain a shared image; outputs the eyepiece display image to a local display module through an eyepiece interface; and sends the shared image to the target terminal through a communication interface, so that the target terminal displays the shared image on a display screen.

[0109] Computer program code for performing the operations of this application can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0110] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0111] The modules described in the embodiments of this application can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.

[0112] The readable storage medium provided in this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., a computer program) for executing the image sharing method of the electronic eyepiece described above. This solves the technical problem of the inconvenience of using the electronic eyepiece in scenarios involving collaborative observation by multiple people. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as those of the image sharing method of the electronic eyepiece provided in the above embodiments, and will not be elaborated upon here.

[0113] The above description is only a part of the embodiments of this application and does not limit the patent scope of this application. All equivalent structural transformations made under the technical concept of this application and using the contents of the specification and drawings of this application, or direct / indirect applications in other related technical fields, are included in the patent protection scope of this application.

Claims

1. An image sharing method for an electronic eyepiece, characterized in that, Applied to an image processing system deployed in an electronic eyepiece, the method includes the following steps: Raw image data is acquired using an image sensor; Based on the eyepiece display information, a first image processing action is performed on the original image data to obtain the eyepiece display image; The method of obtaining target terminal display information and performing a second image processing action on the original image data according to the target terminal display information to obtain a shared image includes: obtaining the display information of the target terminal, wherein the display information includes target terminal information and display requirement information; performing watermark encoding and / or image masking on the original image data according to the display requirement information to form a target device image; and performing format conversion and resolution adjustment on the target device image according to the target terminal information to generate the shared image, wherein the second image processing action is the same as or different from the first image processing action; The eyepiece display image is encapsulated into a mobile display interface frame, and the mobile display interface frame is sent to the bridge chip through the mobile display interface. The bridge chip performs physical layer data packet image format conversion on the mobile display interface frame to generate a mobile processor interface frame. The mobile processor interface frame is sent to the local display module through the mobile processor interface, so that the local display module refreshes and presents the eyepiece display image frame by frame according to the received timing. Furthermore, the shared image is sent to the target terminal via a communication interface so that the target terminal displays the shared image on its screen.

2. The method as described in claim 1, characterized in that, The step of performing a first image processing action on the original image data based on the eyepiece display information to obtain the eyepiece display image includes: Determine the field of view information and watermark information in the eyepiece display information; Based on the field of view information, image masking is performed on the original image data to obtain the target display image; The watermark information is encoded into the target display image to obtain the eyepiece display image.

3. The method as described in claim 1, characterized in that, The step of sending the shared image to the target terminal via a communication interface, so that the target terminal displays the shared image on its screen, includes: According to the preset communication link protocol, the shared image is encoded into a transmission frame; A wireless communication link is established with the target terminal, and the transmission frame is sent to the target terminal through the wireless communication link. The target terminal obtains the shared image by decoding the transmission frame and displays the shared image at the current moment on the display screen. And / or, the transmission frame is sent to the sharing server, so that after receiving the sharing request from the target terminal, the sharing server sends the transmission frame to the target terminal, the target terminal obtains the shared image by decoding the transmission frame, and displays the shared image at the current moment on the display screen.

4. The method as described in claim 3, characterized in that, After the steps of establishing a wireless communication link with the target terminal and sending the transmission frame to the target terminal through the wireless communication link, wherein the target terminal obtains the shared image by decoding the transmission frame and displays the shared image at the current moment on the display screen, the method further includes: The target terminal generates a target shared image based on the shared image and sends the target shared image to the sharing server; After receiving a target sharing request from another terminal, the sharing server sends the target shared image to the other terminal.

5. The method as described in claim 1, characterized in that, After the step of sending the mobile processor interface frame to the local display module via the mobile processor interface, so that the local display module refreshes and presents the eyepiece display image frame by frame according to the received timing sequence, the method further includes: Receive an image scaling request and determine the center pixel and scaling ratio of the image scaling request; Obtain scaling size information, and determine the scaling pixel region based on the scaling size information and the center pixel point; Based on the scaling ratio, a shrinking or enlarging action is performed on the scaling pixel region.

6. The method as described in claim 1, characterized in that, After the step of sending the shared image to the target terminal via the communication interface so that the target terminal displays the shared image on the screen, the method further includes: In response to a recording command, the generated shared images are cached as recording data according to time sequence; Upon receiving a playback request for the recorded data, the recorded data is output to the local display module, and / or sent to the target terminal.

7. An image sharing device for an electronic eyepiece, characterized in that, The device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the image sharing method for the electronic eyepiece as claimed in any one of claims 1 to 6.

8. A storage medium, characterized in that, The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, it implements the steps of the image sharing method of the electronic eyepiece as described in any one of claims 1 to 6.

Images