Transmission apparatus

Abstract

In some cases, it is difficult to suppress the capacity for transmission while suppressing a decrease in the amount of information.SOLUTION: A transmission device includes a classification unit that classifies image data into a first region and a second region, a generation unit that generates character information according to image content of the second region in the image data by using the image data, and a transmission unit that transmits an image of a portion corresponding to the first region in the image data and the character information generated by the generation unit to an external device.SELECTED DRAWING: Figure 11

Description

[Technical Field]

[0001] The present invention relates to a transmission device, a transmission method, a program, and a receiving device. [Background technology]

[0002] 2. Description of the Related Art Techniques used when transmitting image data such as video to an external device are known.

[0003] For example, Patent Document 1 discloses an interactive method that allows a user to acquire and process diagnostic image data online from a server that accesses stored data via a network with limited communication bandwidth. According to Patent Document 1, the method includes the steps of connecting a user's computer to a server via a communication network, requesting specific image data to be sent from the server to the user's computer, sending the requested specific image data from the server via the network to the user's computer, reconstructing an image from the image data, and processing the image on the user's computer. For example, the connecting step uses an industry-standard browser on the user's computer, and the method includes receiving image reconstruction and processing software for the user's computer from the server via the industry-standard browser without user intervention. The reconstructing step also includes reconstructing an image of diagnostic quality using the reconstruction software on the user's computer. The image processing step is characterized by processing the image using the image reconstruction and processing software. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2008-206979 Summary of the Invention [Problem to be solved by the invention]

[0005] When transmitting image data or video as described in Patent Document 1, there is a problem that the capacity required for transmission becomes large. To address this problem, the amount of data transmitted can be reduced by maintaining the image quality of important areas within the image while lowering the image quality of unimportant areas or not transmitting some of the data. However, lowering the image quality of unimportant areas or limiting the areas to be transmitted as described above reduces the amount of information that can be discerned from the image in those areas. This creates a problem in that the amount of information may be reduced, such that there is no way to confirm what was captured in areas determined to be unimportant.

[0006] Therefore, one object of the present disclosure is to provide a transmission device, a transmission method, a program, and a receiving device that can solve the above-mentioned problems. [Means for solving the problem]

[0007] In order to achieve this object, the transmission device in the present disclosure comprises: a classification unit that classifies the image data into a first region and a second region; a generating unit that generates character information corresponding to the image content of the second region of the image data using the image data; a transmission unit that transmits an image of a portion of the image data corresponding to the first region and the character information generated by the generation unit to an external device; have The structure is as follows.

[0008] Further, the transmission method in the present disclosure includes: Classifying the image data into a first region and a second region; generating character information corresponding to the image content of the second region of the image data using the image data; An image of a portion of the image data corresponding to the first region and the character information generated by the generation unit are transmitted to an external device. The structure is as follows.

[0009] In addition, the program in this disclosure Classifying the image data into a first region and a second region; generating character information corresponding to the image content of the second region of the image data using the image data; An image of a portion of the image data corresponding to the first region and the character information generated by the generation unit are transmitted to an external device. It is a program for realizing the processing.

[0010] In addition, the receiving device in the present disclosure includes: an acquisition unit that acquires, from image data classified at least into a first region and a second region, an image of a portion corresponding to the first region and character information corresponding to the image content of the second region; a restoration unit that restores an image of the second region in accordance with the character information acquired by the acquisition unit; a synthesis unit that synthesizes an image of a portion corresponding to the first region acquired by the acquisition unit and an image of the second region restored by the restoration unit; have The structure is as follows. [Effects of the Invention]

[0011] According to the above-described configurations, it is possible to suppress the reduction in the amount of information and to suppress the capacity for transmission. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram illustrating a configuration example of a transmission system according to the present disclosure. [Figure 2] FIG. 1 is a block diagram illustrating an example of the configuration of a transmission device. [Figure 3] FIG. 10 is a diagram illustrating an example of processing performed by a classification unit. [Figure 4] 10A and 10B are diagrams for explaining an example of processing performed by a character information generating unit. [Figure 5] FIG. 2 is a diagram illustrating an example of a process performed by a processing unit. [Figure 6] FIG. 2 is a block diagram illustrating an example of the configuration of a receiving device. [Figure 7] 10 is a flowchart illustrating an example of the operation of the transmission device. [Figure 8] 10 is a flowchart illustrating an example of the operation of the receiving device. [Figure 9] FIG. 10 is a diagram illustrating another example of the configuration of a transmission device. [Figure 10] FIG. 10 is a diagram illustrating an example of a hardware configuration of a second transmission device according to the present disclosure. [Figure 11] FIG. 10 is a block diagram illustrating a configuration example of a second transmission device. [Figure 12] FIG. 10 is a block diagram showing an example of the configuration of a second receiving device. DETAILED DESCRIPTION OF THE INVENTION

[0013] [First embodiment] An example configuration of a transmission system 100 in the present disclosure will be described with reference to FIGS. 1 to 9. FIG. 1 is a diagram illustrating an example configuration of the transmission system 100. FIG. 2 is a block diagram illustrating an example configuration of a transmission device 200. FIG. 3 is a diagram illustrating an example of processing performed by a classification unit 232. FIG. 4 is a diagram illustrating an example of processing performed by a character information generation unit 233. FIG. 5 is a diagram illustrating an example of processing performed by a processing unit 234. FIG. 6 is a block diagram illustrating an example configuration of a receiving device 300. FIG. 7 is a flowchart illustrating an example operation of the transmission device 200. FIG. 8 is a flowchart illustrating an example operation of the receiving device 300. FIG. 9 is a diagram illustrating another example configuration of the transmission device 200. Note that in the present disclosure, the drawings may be associated with one or more embodiments.

[0014] This disclosure describes a transmission system 100 that transmits image data such as video. As described below, the transmission system 100 classifies image data to be transmitted into a first region and a second region based on predetermined criteria. For example, the transmission system 100 identifies a first region, which is an important region, according to preset conditions or predetermined input content. The transmission system 100 also identifies a region of the image data that is different from the identified first region as a second region. For example, the transmission system 100 classifies the image data into the first region and the second region by identifying the first region and the second region through the above-described process. Then, the transmission system 100 generates text information according to the image content of the second region of the image data. The transmission system 100 then transmits the image of the portion of the image data corresponding to the first region and the generated text information to an external device.

[0015] Furthermore, the transmission system 100 can generate a second-area processed image in which the amount of data is reduced for a portion of the image data corresponding to the second area. The transmission system 100 may transmit the generated second-area processed image to an external device in addition to the image of the portion corresponding to the first area and the generated character information.

[0016] Furthermore, the transmission system 100 can be configured to select the type of information to be transmitted depending on factors such as the load on the transmission path. For example, when the transmission system 100 determines that the load on the transmission path is higher than a predetermined standard, it transmits the image of the portion corresponding to the first region and the generated text information. On the other hand, when the transmission system 100 determines that the load on the transmission path is equal to or lower than the predetermined standard, it transmits the image of the portion corresponding to the first region, the generated text information, and the image processed in the second region. For example, the transmission system 100 can be configured to select the type of information to be transmitted depending on the load on the transmission path as described above. Note that the transmission system 100 may be configured to make more gradual determinations by using multiple thresholds, for example. For example, when the transmission system 100 determines that the load on the transmission path is equal to or lower than a second standard that is lower than the above-mentioned standard, it may be configured to transmit the original image data as is. In this way, the transmission system 100 can be configured to select the type of information to be transmitted from the image of the portion corresponding to the first region, text information, the image processed in the second region, the original image data, etc., depending on factors such as the load on the transmission path.

[0017] Fig. 1 shows an example of the configuration of a transmission system 100. Referring to Fig. 1, the transmission system 100 includes, for example, an imaging device 110 that acquires image data such as video, a transmission device 200, and a receiving device 300. As shown in Fig. 1, the imaging device 110 and the transmission device 200 are connected so as to be able to communicate with each other. Furthermore, the transmission device 200 and the receiving device 300 can be connected so as to be able to communicate with each other via a network or the like.

[0018] The configuration of the transmission system 100 is not limited to the example shown in Fig. 1. For example, the transmission system 100 may include a plurality of imaging devices 110. The transmission system 100 may also include a plurality of transmission devices 200, and may also include a plurality of receiving devices 300.

[0019] The imaging device 110 acquires image data such as video. For example, the imaging device 110 is installed in a predetermined location such as the side of a road, and acquires time-series image data of a road, a sidewalk, or the like as a subject. The imaging device 110 may acquire information indicating the time when the image data was acquired along with the image data. The imaging device 110 also outputs the acquired image data and the like to the transmission device 200. The imaging device 110 may output the image data and the like to the transmission device 200 at any timing.

[0020] For example, the image capturing device 110 is a fixed device such as a surveillance camera, etc. The image capturing device 110 may also be a mobile device such as a drive recorder.

[0021] The transmission device 200 is an information processing device that transmits image data such as video captured by the imaging device 110 to the receiving device 300. Fig. 2 shows an example of the main configuration of the transmission device 200. Referring to Fig. 2, the transmission device 200 has, as main components, for example, a communication interface unit 210, a storage unit 220, and an arithmetic processing unit 230.

[0022] 2 illustrates an example in which the functions of the transmission device 200 are realized using one information processing device. However, at least some of the functions of the transmission device 200 may be realized using multiple information processing devices, for example, on a cloud. Furthermore, the transmission device 200 may not include some of the configurations illustrated above, or may have configurations other than those illustrated above.

[0023] The communication interface unit 210 is composed of a data communication circuit etc. The communication interface unit 210 performs data communication with an external device such as the receiving device 300 connected via a communication line.

[0024] The storage unit 220 is a storage device such as a hard disk or memory. The storage unit 220 stores processing information and programs 222 required for various processes in the arithmetic processing unit 230. The programs 222 are read into the arithmetic processing unit 230 and executed to realize various processing units. The programs 222 are read in advance from an external device or recording medium via a data input / output function such as the communication interface unit 210, and are stored in the storage unit 220. Main information stored in the storage unit 220 includes, for example, image data information 221.

[0025] The image data information 221 includes time-series image data acquired from the imaging device 110. In the image data information 221, the image data may be associated with information indicating the time when the imaging device 110 acquired the image data. The image data information 221 can be updated in response to the image data acquisition unit 231 acquiring the image data from the imaging device 110, for example.

[0026] The arithmetic processing unit 230 has an arithmetic device such as a CPU (Central Processing Unit) and its peripheral circuits. The arithmetic processing unit 230 reads and executes a program 222 from the storage unit 220, thereby realizing various processing functions by causing the above hardware and the program 222 to work together. Major processing units realized by the arithmetic processing unit 230 include, for example, an image data acquisition unit 231, a classification unit 232, a character information generation unit 233, a processing unit 234, a determination unit 235, and a transmission unit 236.

[0027] In addition, the arithmetic processing unit 230 may have a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), an MPU (Micro Processing Unit), an FPU (Floating point number Processing Unit), a PPU (Physics Processing Unit), a TPU (Tensor Processing Unit), a quantum processor, a microcontroller, or a combination thereof, instead of the above-mentioned CPU.

[0028] The image data acquisition unit 231 acquires image data from the imaging device 110. For example, the image data acquisition unit 231 acquires time-series image data such as video. The image data acquisition unit 231 also stores the acquired image data, etc. as image data information 221 in the storage unit 220.

[0029] The classification unit 232 classifies the image data included in the image data information 221 into a plurality of regions, such as a first region and a second region, based on a predetermined criterion. For example, the classification unit 232 classifies the image data into a first region, which is an important region or a region to be focused on, and a second region, which is a region other than the first region. The classification unit 232 may classify the image data into three or more types of regions.

[0030] For example, as shown in FIG. 3, the classification unit 232 identifies a first region, which is an important region in the image data, according to preset conditions or predetermined input content. As an example, the classification unit 232 identifies a predetermined region in the image data where a road, a sidewalk, or the like is present as the first region, which is an important region. In addition to the predetermined regions exemplified above, the classification unit 232 may identify as the first region a region that can be identified based on the detection results, such as a region corresponding to a person or vehicle detected using a detector, a region corresponding to a sign or road marking, a region located ahead in the direction of vehicle travel, or any other arbitrary region. Furthermore, the classification unit 232 identifies as the second region a region in the image data that is different from the identified first region. In this way, the classification unit 232 classifies the image data into first regions and second regions by identifying the first region and the second region.

[0031] The classification unit 232 may identify multiple first regions or multiple second regions for one image data. The classification unit 232 may also identify the second region based on the results of a detection process using any detector or the like. For example, when the classification unit 232 detects a region that satisfies a predetermined privacy condition, such as a person's face, in the image data, the classification unit 232 may identify the region that satisfies the privacy condition as the second region. The classification unit 232 may also identify the first region or the second region using a method other than the above-mentioned methods.

[0032] The character information generating unit 233 generates character information according to the image content of the second region of the image data, according to the result of classification by the classifying unit 232. For example, the character information generating unit 233 generates information indicating an object present in the second region and its position as character information, as shown in Fig. 4 .

[0033] As an example, the character information generation unit 233 generates character information according to the image content of the second region by inputting the image of the second region of the image data into a trained model such as VLM (Vision Language Mode). The character information generation unit 233 may generate character information by inputting the original image data and information indicating the second region of the image data into a model such as VLM. In addition to the above-mentioned methods, the character information generation unit 233 may perform object detection on the image of the second region using an arbitrary detector, and generate character information according to the image content of the second region, indicating the name of the detected object, the detected coordinates, etc. As described above, the character information generation unit 233 generates character information according to the image content of the second region by using a trained model such as VLM or an arbitrary detector.

[0034] The character information generating unit 233 may generate character information using a reference image prepared in advance in addition to the image of the second region. For example, the character information generating unit 233 may store, as the reference image, an image of the second region obtained by classifying image data acquired at a predetermined time in the past. In such a case, the character information generating unit 233 may be configured to generate character information indicating differences between the image of the second region for which character information is to be generated and the reference image. For example, the character information generating unit 233 may generate character information including the object name of an object that exists in the image of the second region for which character information is to be generated but does not exist in the reference image. The reference image may be shared in advance with the receiving device 300, etc.

[0035] The processing unit 234 generates a second-area processed image in which the amount of data for a portion of the image data corresponding to the second area has been reduced. For example, the processing unit 234 generates the second-area processed image by lowering the image quality of the portion corresponding to the second area, as shown in Fig. 5. The processing unit 234 may also generate the second-area processed image in which the amount of data for the corresponding portion has been reduced using a method other than those exemplified above.

[0036] The determination unit 235 selects the type of information to be transmitted depending on the load on the transmission path.

[0037] For example, the determination unit 235 acquires information indicating the load of the transmission path by measuring the traffic of the transmission path, etc. Then, when it is determined that the load of the transmission path indicated by the acquired information is higher than a predetermined standard, the determination unit 235 selects to transmit the image of the portion corresponding to the first region and the generated character information. On the other hand, when it is determined that the load of the transmission path is equal to or lower than the predetermined standard, the determination unit 235 selects to transmit the image of the portion corresponding to the first region, the generated character information, and the second region processed image. For example, as described above, the determination unit 235 selects the type of information to transmit depending on the load of the transmission path, etc., so that the transmission capacity can be reduced when it is determined that the load of the transmission path is higher than the predetermined standard.

[0038] Note that the determination unit 235 may be configured to perform more gradual selection by using a plurality of thresholds, etc. For example, the determination unit 235 may be configured to transmit the original image data as is when it is determined that the load on the transmission path is equal to or lower than a second standard that is lower than the above-mentioned standard.

[0039] The transmitting unit 236 transmits information according to the determination result by the determining unit 235 to the receiving device 300 .

[0040] For example, if the determination unit 235 determines that the load on the transmission path is higher than a predetermined standard, the transmission unit 236 transmits the image of the portion corresponding to the first region and the generated character information to the receiving device 300. On the other hand, if the determination unit 235 determines that the load on the transmission path is equal to or lower than the predetermined standard, the transmission unit 236 transmits the image of the portion corresponding to the first region, the generated character information, and the second-region processed image to the receiving device 300. At this time, the transmission unit 236 can transmit the image of the portion corresponding to the first region, the generated character information, and the second-region processed image as separate information to the receiving device 300. The transmission unit 236 may transmit the image of the portion corresponding to the first region, the generated character information, and the second-region processed image to the receiving device 300 while associating multiple pieces of information, such as associating an object name included in the character information with corresponding coordinates in the second-region processed image.

[0041] Even when the determining unit 235 performs more gradual selection as described above, the transmitting unit 236 can transmit information according to the determination result by the determining unit 235 to the receiving device 300.

[0042] The above is an example of the configuration of the transmission device 200. Note that the configuration of the transmission device 200 may be other than that illustrated in FIG. 2. For example, the transmission device 200 may not have the functions of the processing unit 234 or the determination unit 235. Furthermore, the processing unit 234 may be configured to generate a second region processed image according to the result of the determination by the determination unit 235.

[0043] The receiving device 300 is an information processing device that receives information transmitted by the transmitting device 200. The receiving device 300 can also perform restoration processing according to the received information. Fig. 6 shows an example of the main configuration of the receiving device 300. Referring to Fig. 6, the receiving device 300 has, as main components, a communication interface unit 310, a storage unit 320, and an arithmetic processing unit 330, for example.

[0044] 6 illustrates an example in which the functions of the receiving device 300 are realized using one information processing device. However, at least some of the functions of the receiving device 300 may be realized using multiple information processing devices, for example, on the cloud. Furthermore, the receiving device 300 may not include some of the configurations illustrated above, or may have configurations other than those illustrated above.

[0045] The communication interface unit 310 includes a data communication circuit, etc. The communication interface unit 310 performs data communication with an external device such as the transmission device 200 connected via a communication line.

[0046] The storage unit 320 is a storage device such as a hard disk or memory. The storage unit 320 stores processing information and programs 322 required for various processes in the arithmetic processing unit 330. The programs 322 are read into the arithmetic processing unit 330 and executed to realize various processing units. The programs 322 are read in advance from an external device or recording medium via a data input / output function such as the communication interface unit 310, and are stored in the storage unit 320. Main information stored in the storage unit 320 includes, for example, acquired information 321.

[0047] The acquired information 321 includes time-series information acquired from the transmission device 200. For example, the acquired information 321 includes an image of a portion corresponding to the first region and text information at each time. The acquired information 321 may also include an image of a portion corresponding to the first region, text information, and a processed image of the second region. The acquired information 321 can be updated in response to the acquisition unit 331 acquiring information from the transmission device 200, etc.

[0048] The arithmetic processing unit 330 has an arithmetic device such as a CPU and its peripheral circuits. The arithmetic processing unit 330 reads and executes a program 322 from the storage unit 320, thereby realizing various processing units by causing the above hardware and the program 322 to work together. Major processing units realized by the arithmetic processing unit 330 include, for example, an acquisition unit 331, a restoration unit 332, a synthesis unit 333, and an output unit 334.

[0049] The acquisition unit 331 acquires various types of information transmitted by the transmission device 200. For example, the acquisition unit 331 acquires image and text information of a portion corresponding to the first region. The acquisition unit 331 may acquire a processed image of the second region in addition to the above information. Furthermore, the acquisition unit 331 can store the acquired various types of information in the storage unit 320 as acquired information 321.

[0050] The restoration unit 332 restores the image of the portion corresponding to the second region using the character information.

[0051] For example, the restoration unit 332 restores the image in the second region from the character information by inputting the character information into a trained model such as a VLM. The restoration unit 332 may restore the image in the second region by inputting, in addition to the character information, at least one of an image of a portion corresponding to the first region and a processed image of the second region into the trained model. Furthermore, if a reference image or the like is shared in advance with the transmission device 200 or the like, the restoration unit 332 may perform the restoration process using the reference image or the like.

[0052] Note that the restoration unit 332 may restore images using a method other than those exemplified above. For example, the restoration unit 332 may restore images in the second area by searching for images of objects corresponding to object names included in the character information and associating the searched images with positions indicated by position information included in the character information. The restoration unit 332 may search for images corresponding to object names from a database prepared in advance in the storage unit 320, or may perform the above search from an arbitrary external database.

[0053] The composition unit 333 composes the image of the portion corresponding to the first region with the image in the second region restored by the restoration unit 332. For example, the composition unit 333 can perform the composition process by superimposing the image of the portion corresponding to the first region with the image in the second region restored by the restoration unit 332. The composition unit 333 may perform the composition process using any method other than those exemplified above.

[0054] The output unit 334 outputs the result of the composition performed by the composition unit 333. For example, the output unit 334 outputs the image resulting from the composition performed by the composition unit 333 to an external device or the like via the communication interface unit 310. The output unit 334 may output text information, a second-area processed image, and the like together with the image resulting from the composition performed by the composition unit 333. For example, the output unit 334 may be configured to associate and output the object name or the like included in the text information at corresponding coordinates on the image restored by the restoration unit 332 or the second-area processed image.

[0055] The transmission system 100 can include the transmission device 200 and the receiving device 300 having the configurations described above. Next, an example of the operation of the transmission device 200 and the receiving device 300 will be described with reference to Fig. 7 and Fig. 8. First, an example of the operation of the transmission device 200 will be described with reference to Fig. 7.

[0056] 7 is a flowchart showing an example of the operation of the transmission device 200. Referring to FIG. 7, the classification unit 232 classifies the image data into a plurality of areas such as a first area and a second area (step S101). For example, the classification unit 232 classifies the image data into a first area which is an important area or an area to be focused on, and a second area which is an area other than the first area.

[0057] The character information generating unit 233 generates character information according to the image content of the second region of the image data (step S102). For example, the character information generating unit 233 generates information indicating an object present in the second region and its position as character information in response to inputting an image of the second region or the like into the trained model.

[0058] The processing unit 234 generates a second area processed image in which the amount of data is reduced for a portion of the image data corresponding to the second area (step S103). For example, the processing unit 234 can generate the second area processed image by lowering the image quality of the portion corresponding to the second area.

[0059] The determination unit 235 selects the type of information to transmit depending on the load of the transmission path, etc. (step S104). For example, if the load of the transmission path is higher than a predetermined standard (step S104, YES), the determination unit 235 selects to transmit the image of the portion corresponding to the first region and the generated character information. In response, the transmission unit 236 transmits the image of the portion corresponding to the first region and the generated character information to the receiving device 300 (step S105). On the other hand, if the load of the transmission path is equal to or lower than the predetermined standard (step S104, NO), the determination unit 235 selects to transmit the image of the portion corresponding to the first region, the generated character information, and the second-region-processed image. In response, the transmission unit 236 transmits the image of the portion corresponding to the first region, the generated character information, and the second-region-processed image to the receiving device 300 (step S106).

[0060] The above is an example of the operation of the transmission device 200. Note that the operation of the transmission device 200 is not limited to the example shown in Fig. 7. For example, the processing of step S103 and step S104 may be omitted, or the processing of step S103 may be performed after the processing of step S104. The transmission device 200 may perform operations other than those exemplified above.

[0061] Next, an example of operation of the receiving device 300 will be described with reference to Fig. 8. Fig. 8 is a flowchart showing an example of operation of the receiving device 300. Referring to Fig. 8, the acquiring unit 331 acquires various information transmitted by the transmitting device 200 (step S201). For example, the acquiring unit 331 acquires an image or text information of a portion corresponding to the first region. In addition to the above information, the acquiring unit 331 may also acquire a processed image of the second region.

[0062] The restoration unit 332 restores the image of the portion corresponding to the second region using the character information (step S202). For example, the restoration unit 332 can restore the image in the second region from the character information by inputting the character information into a trained model such as a VLM.

[0063] The composition unit 333 combines the image of the portion corresponding to the first region with the image in the second region restored by the restoration unit 332 (step S203). For example, the composition unit 333 can perform the composition process by superimposing the image of the portion corresponding to the first region with the image in the second region restored by the restoration unit 332.

[0064] The above is an example of the operation of the receiving device 300. Note that the image synthesized by the synthesis unit 333 may be output to an external device by the output unit 334 or the like.

[0065] As described above, the transmission device 200 includes the classification unit 232, the character information generation unit 233, and the transmission unit 236. With this configuration, the character information generation unit 233 can generate character information corresponding to the image content of the second area, based on the classification result by the classification unit 232. As a result, the transmission unit 236 can transmit the image of the portion corresponding to the first area and the character information to the receiving device 300. This allows the transmission device 200 to reduce the transmission capacity while suppressing a decrease in the amount of information.

[0066] The transmission device 200 may also include a processing unit 234. With this configuration, the processing unit 234 can generate a second-region processed image. As a result, the transmission unit 236 can transmit the second-region processed image in addition to the image of the portion corresponding to the first region and the text information. Even with this configuration, the transmission device 200 can reduce the transmission capacity while suppressing a decrease in the amount of information.

[0067] Furthermore, the transmission device 200 can include a determination unit 235. With this configuration, the determination unit 235 can select the type of information to be transmitted depending on factors such as the load on the transmission path. As a result, the transmission device 200 can more appropriately reduce the transmission capacity while suppressing a decrease in the amount of information depending on factors such as the load on the transmission path.

[0068] As described above, the configuration of the transmission device 200 may be other than that exemplified in Fig. 2. Fig. 9 shows another example configuration of the transmission device 200. Referring to Fig. 9, the arithmetic processing unit 230 of the transmission device 200 can implement a verification unit 237 in addition to the configuration exemplified in Fig. 2 by reading and executing the program 222.

[0069] The verification unit 237 verifies whether an image can be appropriately restored from the generated character information.

[0070] For example, the verification unit 237 restores an image of a portion corresponding to the second region using character information. The verification unit 237 may restore the image in the second region from the character information by inputting the character information into a trained model such as a VLM. Then, the verification unit 237 compares the restored image with the image of the second region from which the character information was generated to verify whether the image can be properly restored from the generated character information. For example, the verification unit 237 calculates a restoration rate by calculating the similarity between the restored image and the image of the second region from which the character information was generated. As an example, the verification unit 237 can calculate the restoration rate by checking at least some of the following for the second region restored image, which is an image generated using character information: whether an object included in the second region is detected, the object's position, and attribute information of the object, such as its color and angle. Then, the verification unit 237 verifies whether the calculated restoration rate satisfies a predetermined condition, and whether the image can be properly restored from the generated character information. For example, if the calculated restoration rate satisfies the condition, the verification unit 237 determines that the image can be properly restored from the generated character information. In this case, verification unit 237 can instruct transmission unit 236 to transmit information according to the determination result of determination unit 235. On the other hand, if the calculated restoration rate does not satisfy the condition, verification unit 237 determines that the image cannot be properly restored from the generated character information. In this case, verification unit 237 instructs character information generation unit 233 to generate character information again. In response to this, character information generation unit 233 generates character information again.

[0071] For example, as described above, the verification unit 237 verifies whether an image can be appropriately restored from the generated character information by restoring the character information to an image. Note that the verification unit 237 may verify whether an image can be appropriately restored from the generated character information using a method other than the above-mentioned example. For example, the verification unit 237 can perform the above verification by checking whether an object name, etc. included in the character information is included in a database such as a dictionary prepared in advance. As an example, the verification unit 237 can determine that an image can be appropriately restored from the generated character information if the object name, etc. included in the character information is included in a database such as a dictionary prepared in advance.

[0072] Furthermore, at least a part of the configuration of the transmission device 200 described in the present disclosure may be included in the imaging device 110. For example, the transmission system 100 may be configured from the imaging device 110 having the functions of the transmission device 200 described in the present disclosure and the receiving device 300.

[0073] [Second embodiment] Next, a second embodiment of the present disclosure will be described with reference to Fig. 10 to Fig. 12. Fig. 10 is a diagram illustrating an example of a hardware configuration of a transmission device 400, which is a second transmission device in the present disclosure. Fig. 11 is a block diagram illustrating an example of a configuration of the transmission device 400. Fig. 12 is a block diagram illustrating an example of a configuration of a receiving device 500, which is a second receiving device in the present disclosure.

[0074] In the second embodiment of the present disclosure, a transmission device 400 that is a modified example of the transmission device 200 described in the first embodiment and a receiving device 500 that is a modified example of the receiving device 300 will be described. Fig. 10 shows an example of the hardware configuration of the transmission device 400. Referring to Fig. 10, the transmission device 400 has, as an example, the following hardware configuration. ·CPU(Central Processing Unit)401(Arithmetic unit) ROM (Read Only Memory) 402 (storage device) RAM (Random Access Memory) 403 (storage device) Programs 404 loaded into RAM 403 A storage device 405 for storing the program group 404 A drive device 406 that reads and writes data from a recording medium 410 outside the information processing device A communication interface 407 for connecting to a communication network 411 outside the information processing device Input / output interface 408 for inputting and outputting data Bus 409 connecting each component

[0075] 11 by the CPU 401 acquiring and executing the program group 404. The program group 404 is stored in advance in the storage device 405 or the ROM 402, for example, and is loaded into the RAM 403 or the like by the CPU 401 for execution as needed. The program group 404 may be supplied to the CPU 401 via the communication network 411, or may be stored in advance in the recording medium 410, with the drive device 406 reading out the programs and supplying them to the CPU 401.

[0076] 10 shows an example of the hardware configuration of the transmission device 400. The hardware configuration of the transmission device 400 is not limited to the above-described case. For example, the transmission device 400 may be configured with only a part of the above-described configuration, such as excluding the drive device 406. Furthermore, the CPU 401 may be a GPU or the like exemplified in the first embodiment.

[0077] The classification unit 421 classifies the image data into a first region and a second region. The classification unit 421 may classify the image data into three or more types of regions, such as a third region.

[0078] The generating unit 422 uses the image data to generate character information according to the image content of the second region of the image data. The generating unit 422 may generate the character information using any method, such as generating the character information using a trained model.

[0079] The transmission unit 423 transmits the image of the part of the image data corresponding to the first region and the character information generated by the generation unit 422 to an external device.

[0080] The above is an example of the configuration of the transmission device 400.

[0081] As described above, the transmission device 400 includes the classification unit 421, the generation unit 422, and the transmission unit 423. With this configuration, the generation unit 422 can generate text information corresponding to the image content of the second area based on the classification result by the classification unit 421. As a result, the transmission unit 423 can transmit the image of the portion corresponding to the first area and the text information to an external device. This allows the transmission device 400 to reduce the transmission capacity while suppressing a decrease in the amount of information.

[0082] The above-described transmission device 400 can be realized by incorporating a predetermined program into an information processing device such as the transmission device 400. Specifically, a program according to another aspect of the present invention is a program for causing an information processing device such as the transmission device 400 to realize processing of classifying image data into a first area and a second area, using the image data to generate character information corresponding to the image content of the second area of ​​the image data, and transmitting the image of the portion of the image data corresponding to the first area and the character information generated by the generation unit 422 to an external device.

[0083] In addition, a transmission method executed by an information processing device such as the above-mentioned transmission device 400 is a method in which the information processing device classifies image data into a first area and a second area, uses the image data to generate character information corresponding to the image content of the second area of ​​the image data, and transmits the image of the part of the image data corresponding to the first area and the character information generated by the generation unit 422 to an external device.

[0084] Even if the invention is a program having the above-mentioned configuration, or a computer-readable recording medium having the program recorded thereon, or a transmission method, it can achieve the same functions and effects as the above-mentioned transmission device 400, and therefore can achieve the above-mentioned objective of the present disclosure.

[0085] Furthermore, the above-described object of the present disclosure can be similarly achieved by a receiving device 500 that receives information from a transmission device 400 or the like. Fig. 12 shows an example configuration of the receiving device 500. Referring to Fig. 12, the receiving device 500 can realize functions as an acquisition unit 521, a restoration unit 522, and a synthesis unit 523 by having a CPU acquire and execute a group of programs. Note that the hardware configuration of the receiving device 500 may be the same as the hardware configuration of the transmission device 400 described with reference to Fig. 10.

[0086] The acquiring unit 521 acquires, from the image data classified at least into a first area and a second area, an image of a portion corresponding to the first area and character information according to the image content of the second area.

[0087] The restoration unit 522 restores the image of the second region according to the character information acquired by the acquisition unit 521.

[0088] The combining unit 523 combines the image of the portion corresponding to the first region acquired by the acquiring unit 521 with the image of the second region restored by the restoring unit 522.

[0089] The receiving device 500 has, for example, the configuration described above.

[0090] The above-described receiving device 500 can be realized by incorporating a predetermined program into an information processing device such as the receiving device 500. Specifically, a program according to another aspect of the present invention is a program for causing an information processing device such as the receiving device 500 to realize a process of acquiring, from image data classified at least into a first region and a second region, an image of a portion corresponding to the first region and character information according to the image content of the second region, restoring the image of the second region according to the acquired character information, and synthesizing the acquired image of the portion corresponding to the first region with the restored image of the second region.

[0091] Furthermore, a receiving method executed by an information processing device such as the above-mentioned receiving device 500 is a method in which the information processing device acquires an image of a portion corresponding to the first region and character information according to the image content of the second region from image data classified at least into a first region and a second region, restores the image of the second region according to the acquired character information, and synthesizes the image of the portion corresponding to the acquired first region with the restored image of the second region.

[0092] Inventions such as the receiving device 500, or a program, or a computer-readable recording medium having the program recorded thereon, or a receiving method, having the above-described configuration, can achieve the same functions and effects as the above-described transmission device 400, and therefore can achieve the above-described objective of the present disclosure.

[0093] <Additional Notes> A part or all of the above-described embodiments can be described as follows: The following provides an overview of the transmission device and the like according to the present invention. However, the present invention is not limited to the following configuration.

[0094] (Appendix 1) a classification unit that classifies the image data into a first region and a second region; a generating unit that generates character information corresponding to the image content of the second region of the image data using the image data; a transmission unit that transmits an image of a portion of the image data corresponding to the first region and the character information generated by the generation unit to an external device; have Transmission equipment. (Appendix 2) a processing unit that generates a second-area processed image by reducing the amount of data for a portion of the image data corresponding to the second area, The transmission unit transmits to an external device an image of a portion of the image data corresponding to the first region, the character information generated by the generation unit, and the second region processed image generated by the processing unit. 2. The transmission device of claim 1. (Appendix 3) the transmission unit has a determination unit that determines a load on a transmission path through which information corresponding to the image data is transmitted, The transmission unit transmits the second region processed image generated by the processing unit to the external device in accordance with the determination result by the determination unit. 3. The transmission device according to claim 2. (Appendix 4) a verification unit that verifies an image restoration rate of the character information generated by the generation unit, The generating unit generates character information according to the image content of the second region of the image data in accordance with the verification result by the verifying unit. 10. A transmission device according to claim 1, wherein the first and second transmission devices are connected to each other via a first interface. (Appendix 4-1) The verification unit verifies the image restoration rate for a second-area restored image, which is an image generated using the character information, based on at least one of whether an object included in the second area is detected, the position of the object, and attribute information of the object. 5. The transmission device according to claim 4. (Appendix 5) The classification unit classifies a portion of the image data that is determined to include privacy information as the second region, or classifies a region other than an important region set according to a predetermined criterion as the second region. A transmission device according to any one of claims 1 to 4. (Appendix 6) When the determination unit determines that a traffic value indicating a load on a transmission path is higher than a predetermined value, the transmission unit transmits an image of a portion of the image data corresponding to the first region and the character information generated by the generation unit to an external device, and when the determination unit determines that the traffic value is equal to or lower than the predetermined value, the transmission unit transmits an image of a portion of the image data corresponding to the first region, the character information generated by the generation unit, and a second region processed image generated by the processing unit to an external device. 4. The transmission device according to claim 3. (Appendix 6-1) The transmitting unit transmits the original image data when the determining unit determines that the traffic value is equal to or less than a second standard that is lower than a predetermined value. 7. The transmission device according to claim 6. (Appendix 7) The generating unit generates the character information for a portion of the image content of the second area that differs from a predetermined reference image content. 10. A transmission device according to any one of claims 1 to 6. (Appendix 8) The information processing device Classifying the image data into a first region and a second region; generating character information corresponding to the image content of the second region of the image data using the image data; An image of a portion of the image data corresponding to the first region and the generated character information are transmitted to an external device. Transmission method. (Appendix 9) In the information processing device, Classifying the image data into a first region and a second region; generating character information corresponding to the image content of the second region of the image data using the image data; An image of a portion of the image data corresponding to the first region and the generated character information are transmitted to an external device. A program to realize the processing. (Appendix 10) an acquisition unit that acquires, from image data classified at least into a first region and a second region, an image of a portion corresponding to the first region and character information corresponding to the image content of the second region; a restoration unit that restores an image of the second region in accordance with the character information acquired by the acquisition unit; a synthesis unit that synthesizes an image of a portion corresponding to the first region acquired by the acquisition unit and an image of the second region restored by the restoration unit; have Receiving device.

[0095] Note that some or all of the configurations described in Supplementary Notes 2 to 7 that are dependent on the transmission device described as Supplementary Note 1 may also be dependent in a similar dependent relationship on the transmission method described in Supplementary Note 8, the program described in Supplementary Note 9, the receiving method described in Supplementary Note 10, etc. Furthermore, not limited to Supplementary Notes 8, 9, and 10, some or all of the configurations described as Supplements may also be dependent on various hardware, software, various recording means for recording software, or systems within the scope of the above-mentioned embodiments.

[0096] The programs described in the above embodiments and appendices can be stored in various types of non-transitory computer-readable media and supplied to a computer. Non-transitory computer-readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, and semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (Random Access Memory)). The programs may also be supplied to a computer by various types of transitory computer-readable media. Examples of transitory computer-readable media include electrical signals, optical signals, and electromagnetic waves. The transitory computer-readable media can supply the programs to a computer via wired communication paths such as electric wires and optical fibers, or via wireless communication paths.

[0097] Although the present invention has been described above with reference to the above-mentioned embodiments, the present invention is not limited to the above-mentioned embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. [Explanation of symbols]

[0098] 100 Transmission Systems 110 Imaging device 200 Transmission Equipment 210 Communication interface unit 220 Storage section 221 Image data information 222 Program 230 Processing Unit 231 Image data acquisition unit 232 Classification Department 233 Character information generation section 234 Processing section 235 Judgment section 236 Transmission Unit 237 Verification Department 300 Receiving device 310 Communication interface unit 320 Storage section 321 Acquired information 322 Program 330 Processing Unit 331 Acquisition Department 332 Restoration Department 333 Synthesis Section 334 Output Section 400 Transmission Equipment 401 CPU 402 ROM 403 RAM 404 Programs 405 Storage device 406 Drive Unit 407 Communication Interface 408 Input / Output Interface 409 Bus 410 Recording Media 411 Communication Network 421 Classification Department 422 Generation part 423 Transmission Unit 500 receiving device 521 Acquisition Department 522 Restoration Department 523 Synthesis Section

Claims

1. a classification unit that classifies the image data into a first region and a second region; a generating unit that generates character information corresponding to the image content of the second region of the image data using the image data; a transmission unit that transmits an image of a portion of the image data corresponding to the first region and the character information generated by the generation unit to an external device; have Transmission equipment.

2. a processing unit that generates a second-area processed image by reducing the amount of data for a portion of the image data corresponding to the second area, The transmission unit transmits to an external device an image of a portion of the image data corresponding to the first region, the character information generated by the generation unit, and the second region processed image generated by the processing unit. The transmission device according to claim 1 .

3. the transmission unit has a determination unit that determines a load on a transmission path through which information corresponding to the image data is transmitted, The transmission unit transmits the second region processed image generated by the processing unit to the external device in accordance with the determination result by the determination unit.

3. The transmission device according to claim 2.

4. a verification unit that verifies an image restoration rate of the character information generated by the generation unit, The generating unit generates character information according to the image content of the second region of the image data in accordance with the verification result by the verifying unit. The transmission device according to claim 1 .

5. The classification unit classifies a portion of the image data that is determined to include privacy information as the second region, or classifies a region other than an important region set according to a predetermined criterion as the second region. The transmission device according to claim 1 .

6. When the determination unit determines that a traffic value indicating a load on a transmission path exceeds a predetermined value, the transmission unit transmits an image of a portion of the image data corresponding to the first region and the character information generated by the generation unit to an external device, and when the determination unit determines that the traffic value is equal to or less than the predetermined value, the transmission unit transmits an image of a portion of the image data corresponding to the first region, the character information generated by the generation unit, and a second region processed image generated by the processing unit to an external device.

4. The transmission device according to claim 3.

7. The generating unit generates the character information for a portion of the image content of the second area that differs from a predetermined reference image content. The transmission device according to claim 1 .

8. The information processing device Classifying the image data into a first region and a second region; generating character information corresponding to the image content of the second region of the image data using the image data; An image of a portion of the image data corresponding to the first region and the generated character information are transmitted to an external device. Transmission method.

9. In the information processing device, Classifying the image data into a first region and a second region; generating character information corresponding to the image content of the second region of the image data using the image data; An image of a portion of the image data corresponding to the first region and the generated character information are transmitted to an external device. A program to realize the processing.

10. an acquisition unit that acquires, from image data classified at least into a first region and a second region, an image of a portion corresponding to the first region and character information corresponding to the image content of the second region; a restoration unit that restores an image of the second region in accordance with the character information acquired by the acquisition unit; a synthesis unit that synthesizes an image of a portion corresponding to the first region acquired by the acquisition unit and an image of the second region restored by the restoration unit; have Receiving device.

Images