Semiconductor device

The semiconductor device addresses the limited data transfer efficiency in existing technologies by using flip-flops and a switching controller to enable bidirectional data transfer, enhancing processing capabilities and system simplicity.

WO2024228323A1PCT designated stage expired Publication Date: 2024-11-07SONY SEMICON SOLUTIONS CORP
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/014695
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-02
Filing Date
2024-04-11
Publication Date
2024-11-07

AI Technical Summary

Technical Problem

Existing pixel ADC type imaging devices and semiconductor devices with multiple arithmetic units are limited in data transfer efficiency due to restricted directional data transfer, which hampers complex arithmetic processing and system configuration simplicity.

Method used

A semiconductor device is designed with multiple first and second flip-flops arranged in intersecting directions, a switching controller for dynamic data routing, and arithmetic units performing operations based on output signals from these flip-flops, allowing data transfer in two or more arbitrary directions.

Benefits of technology

This configuration enhances data transfer efficiency and flexibility, enabling complex arithmetic processing and simplifying the imaging system configuration by allowing data to be transferred in various directions, thereby improving the performance of semiconductor devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024014695_07112024_PF_FP_ABST
    Figure JP2024014695_07112024_PF_FP_ABST
Patent Text Reader

Abstract

[Problem] To transfer data in two or more directions. [Solution] This semiconductor device includes: a plurality of first data transfer groups each including a plurality of first flip-flops for transferring data in a first direction and arranged in a second direction intersecting the first direction; a plurality of second data transfer groups each including a plurality of second flip-flops for transferring data in the second direction and arranged in the first direction; and a switching controller that performs control for individually switching connection destinations of output terminals of the plurality of first flip-flops in the plurality of first data transfer groups and connection destinations of output terminals of the plurality of second flip-flops in the plurality of second data transfer groups.
Need to check novelty before this filing date? Find Prior Art

Description

Semiconductor Devices

[0001] The present disclosure relates to semiconductor devices.

[0002] There is known an imaging device using a pixel ADC system that performs analog-to-digital conversion (hereinafter referred to as AD conversion) at each pixel (see, for example, Patent Document 1). In Patent Document 1, a time code transfer unit is arranged in the column direction of a pixel array unit, and a time code is transferred from the time code transfer unit to each pixel, and the time code is held as an AD conversion value at the timing when the pixel signal matches a reference signal.

[0003] International Publication No. 2018 / 037902

[0004] However, existing pixel ADC imaging devices transfer time codes only in a predetermined direction, and the AD conversion values ​​of each pixel can also only be transferred in a predetermined direction. This makes transfer efficiency poor. Furthermore, because the data transfer direction is limited, the arithmetic processing that can be performed in the pixel array is also limited, and complex arithmetic processing must be performed on a chip separate from the imaging device. This makes it difficult to simplify the configuration of an imaging system equipped with an imaging device.

[0005] Furthermore, not only in imaging devices, but also in semiconductor devices having multiple arithmetic units, no configuration has been proposed that allows the results of the arithmetic units to be transferred in two or more arbitrary directions as needed.

[0006] Therefore, the present disclosure provides a semiconductor device capable of transferring data in two or more directions.

[0007] In order to solve the above problems, according to the present disclosure, there is provided a semiconductor device comprising: a plurality of first data transfer groups, each including a plurality of first flip-flops that transfer data in a first direction and arranged in a second direction intersecting the first direction; a plurality of second data transfer groups, each including a plurality of second flip-flops that transfer data in the second direction and arranged in the first direction; and a switching controller that individually switches and controls connection destinations of output terminals of the plurality of first flip-flops and the plurality of second flip-flops in each of the plurality of first data transfer groups and the plurality of second data transfer groups.

[0008] The propagation order of the clock signal input to the plurality of first flip-flops and the propagation order of the data input to the plurality of first flip-flops may be opposite to each other, and the propagation order of the clock signal input to the plurality of second flip-flops and the propagation order of the data input to the plurality of second flip-flops may be opposite to each other.

[0009] The data transfer device may further include a plurality of arithmetic units provided corresponding to at least one of the plurality of first data transfer groups or the plurality of second data transfer groups and arranged along the first direction and the second direction, and each of the plurality of arithmetic units may perform arithmetic processing based on an output signal of the corresponding first flip-flop or second flip-flop.

[0010] The plurality of computing units may perform at least one of four arithmetic operations and analog-to-digital conversion.

[0011] Each of the plurality of arithmetic units may input the calculation result to the first flip-flop or the second flip-flop in the next stage of the first data transfer group or the second data transfer group, which is the same as the first flip-flop or the second flip-flop that output the output signal.

[0012] Each of the plurality of arithmetic units may input the calculation result to the first flip-flop or the second flip-flop of either the first data transfer group or the second data transfer group that is different from the first flip-flop or the second flip-flop that output the output signal.

[0013] The switching controller may individually control switching between transferring the calculation results of the plurality of arithmetic units in the first direction by the plurality of first data transfer groups and transferring the calculation results of the plurality of arithmetic units in the second direction by the plurality of second data transfer groups.

[0014] The circuit may further include a plurality of switches that switch the output signal paths of the plurality of first flip-flops and the plurality of second flip-flops in each of the plurality of first data transfer groups and the plurality of second data transfer groups in accordance with switching control by the switching controller.

[0015] The plurality of switches may be connected between input nodes of the plurality of first flip-flops and output nodes of the plurality of arithmetic units, and may also be connected between input nodes of the plurality of second flip-flops and output nodes of the plurality of arithmetic units.

[0016] The switching controller may include a plurality of first output buffers that output the operation results of the plurality of arithmetic units in the first direction or the second direction, and a plurality of second output buffers that output the operation results of the plurality of arithmetic units in the direction opposite to the first direction or the second direction, and the switching controller may input the operation results of the plurality of arithmetic units to the plurality of first flip-flops or the plurality of second flip-flops via the plurality of first output buffers or the plurality of second output buffers.

[0017] The first data transfer groups, the second data transfer groups, and the arithmetic units may be arranged in one semiconductor layer, or may be divided and arranged across a plurality of semiconductor layers.

[0018] The plurality of first data transfer groups and the plurality of second data transfer groups may transfer data including at least one of the opcodes, operands, calculated time codes, identification information of the next input arithmetic unit, or calculation end information of the plurality of arithmetic units.

[0019] The plurality of first data transfer groups may transfer data in parallel up to one end in the first direction, and the plurality of second data transfer groups may transfer data in parallel up to one end in the second direction.

[0020] Data transferred to a first end in the first direction by some of the plurality of first data transfer groups may be transferred to a second end in the opposite direction to the first direction by other first data transfer groups of the plurality of first data transfer groups, and the plurality of second data transfer groups may transfer data in parallel to one end in the second direction.

[0021] The plurality of first data transfer groups may transfer data in parallel to one end of the first direction, and the data transferred to the first end of the second direction by some of the plurality of second data transfer groups may be transferred in the opposite direction of the second direction to the second end by other second data transfer groups of the plurality of second data transfer groups.

[0022] Data transferred to a first end in the first direction by some of the plurality of first data transfer groups may be transferred to a second end in the opposite direction of the first direction by other first data transfer groups of the plurality of first data transfer groups, and data transferred to a third end in the second direction by some second data transfer groups of the plurality of second data transfer groups may be transferred to a fourth end in the opposite direction of the second direction by other second data transfer groups of the plurality of second data transfer groups.

[0023] The plurality of first data transfer groups may alternately transfer data in the first direction and data in a direction opposite to the first direction in the order arranged in the second direction.

[0024] The plurality of second data transfer groups may alternately transfer data in the second direction and data in a direction opposite to the first direction in the order of arrangement in the first direction.

[0025] Each of the plurality of first flip-flops and the plurality of second flip-flops may output a signal of the same logic as the input signal from an output node when the clock signal is of a first logic, and may set the output node to high impedance when the clock signal is of a second logic.

[0026] Each of the plurality of first flip-flops and the plurality of second flip-flops may take in the input signal when the clock signal is at the second logic level, and then output from the output node a signal of the same logic level as the input signal taken in when the clock signal transitions to the first logic level.

[0027] 4 is a block diagram showing a schematic configuration of a semiconductor device 1 according to an embodiment. A circuit diagram showing a connection configuration of a plurality of first flip-flops in a first data transfer group. A diagram showing the state of each transistor of a dynamic FF when a clock signal is low. A diagram showing the state of each transistor of a dynamic FF when a clock signal is high. A block diagram showing a schematic configuration of a semiconductor device according to a modified example of the embodiment. A diagram showing an example of a plurality of switches provided for each arithmetic unit. A diagram showing an example in which a total of nine arithmetic units are arranged, three in a first direction and three in a second direction. A diagram showing a normal output sequence of arithmetic results. A diagram showing a transposed output sequence of arithmetic results. A block diagram of a semiconductor device according to a modified example of FIG. 4. A diagram showing an arrangement of a plurality of arithmetic units. A diagram showing an example in which arithmetic results of a plurality of arithmetic units are read row by row in a plurality of first data transfer groups 2. A diagram showing a storage area of ​​a frame memory. A diagram showing an example in which arithmetic results are read from a frame memory. A block diagram showing a more detailed configuration of a plurality of first data transfer groups and a plurality of second data transfer groups shown in FIG. 4. 16A and 16B are diagrams showing an example in which a plurality of first data transfer groups transfer data in a first direction and a plurality of second data transfer groups transfer data in a second direction. FIG. 17A shows an example in which the data transfer directions of odd-numbered rows and even-numbered rows among the plurality of first data transfer groups are reversed. FIG. 17B shows an example in which the data transfer directions of odd-numbered rows and even-numbered columns among the plurality of second data transfer groups are reversed. FIG. 17C shows an example in which the data transfer directions of odd-numbered rows and even-numbered rows among the plurality of first data transfer groups are reversed, and the data transfer directions of odd-numbered columns and even-numbered columns among the plurality of second data transfer groups are reversed. A schematic perspective view of a semiconductor device with a stacked structure according to the present embodiment. A block diagram of a first semiconductor substrate. A block diagram of a second semiconductor substrate. A block diagram of a second semiconductor substrate according to a modification of FIG. 16A. A block diagram showing a first example of the internal configuration of a computing unit. A block diagram showing a second example of the internal configuration of a computing unit when the semiconductor device is a pixel ADC type imaging device. A block diagram showing an example of a schematic configuration of a vehicle control system. FIG. 4 is an explanatory diagram showing an example of the installation positions of an outside-vehicle information detection unit and an imaging unit.

[0028] Hereinafter, an embodiment of a semiconductor device will be described with reference to the drawings. The following description will focus on the main components of the semiconductor device, but the semiconductor device may include components and functions that are not shown or described. The following description does not exclude components and functions that are not shown or described.

[0029] Fig. 1 is a block diagram showing a schematic configuration of a semiconductor device 1 according to an embodiment. The semiconductor device 1 in Fig. 1 is a device disposed on one or more semiconductor substrates (not shown). The semiconductor device 1 in Fig. 1 includes a plurality of first data transfer groups 2, a plurality of second data transfer groups 3, and a controller (switching controller) 4.

[0030] The multiple first data transfer groups 2 are arranged in a second direction (e.g., vertical direction) Y that intersects with a first direction (e.g., horizontal direction) X. Each of the multiple first data transfer groups 2 has multiple first flip-flops 5 that transfer data in the first direction X. The multiple first flip-flops 5 are connected in series. The number of first flip-flops 5 connected in series is arbitrary.

[0031] A raw data generator 6 is connected to the data input terminal D of the first flip-flop 5 in the first stage in each of the multiple first data transfer groups 2. The raw data generator 6 generates data to be input to the data input terminal D of the first flip-flop 5 in the first stage in each first data transfer group 2. A raw output circuit 7 is connected to the data output terminal Q of the first flip-flop 5 in the last stage in each first data transfer group 2. The raw output circuit 7 is a circuit that outputs data output from the data output terminal Q of the first flip-flop 5 in the last stage in each first data transfer group 2 to the outside of the semiconductor device 1. As will be described later, a memory (a frame memory as a more specific example) may be connected to the raw output circuit 7 to store the data output from the data output terminal Q of the first flip-flop 5 in the last stage inside the semiconductor device 1.

[0032] The multiple second data transfer groups 3 are arranged in the first direction X. Each of the multiple second data transfer groups 3 has multiple second flip-flops 8 that transfer data in the second direction Y. The multiple second flip-flops 8 are connected in series. The number of second flip-flops 8 connected in series is arbitrary.

[0033] A column data generator 9 is connected to the data input terminal D of the first flip-flop 5 in the first stage in each second data transfer group 3. A column output circuit 10 is connected to the data output terminal Q of the second flip-flop 8 in the last stage in each second data transfer group 3. The column output circuit 10 is a circuit that outputs data output from the data output terminal Q of the second flip-flop 8 in the last stage in each second data transfer group 3 to the outside of the semiconductor device 1. A memory may be connected to the column output circuit 10 to store the data output from the data output terminal Q of the second flip-flop 8 in the last stage inside the semiconductor device 1.

[0034] The row data generator 6 and the column data generator 9 are controlled by the controller 4. The controller 4 also controls the switching of connection destinations of the output terminals of the plurality of first flip-flops 5 and the plurality of second flip-flops 8 in each of the plurality of first data transfer groups 2 and the plurality of second data transfer groups 3, individually.

[0035] In this way, the semiconductor device 1 according to this embodiment can switch the data transfer direction to the first direction X or the second direction Y as needed by arbitrarily combining a plurality of first data transfer groups 2 and a plurality of second data transfer groups 3. Therefore, data can be transferred not only in the first direction X or the second direction Y but also in any direction.

[0036] 2 is a circuit diagram showing the connection configuration of the plurality of first flip-flops 5 in the first data transfer group 2. The connection configuration of the plurality of second flip-flops 8 in the second data transfer group 3 is also expressed in a circuit diagram similar to that of FIG. 2, so the following will describe the connection configuration of the plurality of first flip-flops 5, and a detailed description of the connection configuration of the plurality of second flip-flops 8 will be omitted.

[0037] 2 , the data output terminal Q of each first flip-flop 5 is connected to the data input terminal D of the first flip-flop 5 in the next stage. Furthermore, a clock signal CLK output from a corresponding clock buffer 11 is input to the clock terminal of each first flip-flop 5. The multiple clock buffers 11 corresponding to the multiple first flip-flops 5 are connected in series, with a first-stage clock buffer 11 provided corresponding to the last-stage first flip-flop 5, and a last-stage clock buffer 11 provided corresponding to the first-stage first flip-flop 5. That is, the clock signal CLK is input to the clock terminal of the last-stage first flip-flop 5 at the earliest timing, and the clock signal CLK is input to the clock terminal of the first-stage first flip-flop 5 at the latest timing.

[0038] In this way, the propagation order of the clock signal CLK input to the plurality of first flip-flops 5 is opposite to the propagation order of the data input to the plurality of first flip-flops 5. Similarly, the propagation order of the clock signal CLK input to the plurality of second flip-flops 8 is opposite to the propagation order of the data input to the plurality of second flip-flops 8.

[0039] By reversing the propagation order of the clock signal CLK and the propagation order of the data, each of the first flip-flops 5 and each of the second flip-flops 8 can capture input data using the clock signal CLK while ensuring sufficient setup and hold times for the input data. This prevents input data capture errors and stabilizes the operations of the first flip-flops 5 and the second flip-flops 8. Furthermore, there is no need to devise circuitry to ensure the setup and hold times for the first flip-flops 5 and the second flip-flops 8, which simplifies the circuit configuration.

[0040] The first flip-flop 5 and the second flip-flop 8 according to this embodiment may be dynamic flip-flops (hereinafter referred to as dynamic FFs) having a TSPC (True Single Phase Clock).

[0041] 3A and 3B are diagrams showing the circuit configuration of a dynamic FF and the states of each transistor. The dynamic FF having the circuit configuration of FIG. 3A and FIG. 3B can be applied to the first flip-flop 5 and the second flip-flop 8.

[0042] FIG. 3A shows the on or off state of each transistor when the clock signal CLK is low, and FIG. 3B shows the on or off state of each transistor when the clock signal CLK is high.

[0043] The dynamic FF of FIGS. 3A and 3B includes a PMOS transistor Q1 and an NMOS transistor Q2 connected between a power supply voltage node and a ground node, PMOS transistors Q3 and Q4 and an NMOS transistor Q5 cascode-connected between the power supply voltage node and the ground node, a PMOS transistor Q6 and NMOS transistors Q7 and Q8 cascode-connected between the power supply voltage node and the ground node, and a PMOS transistor Q9 and NMOS transistors Q10 and Q11 cascode-connected between the power supply voltage node and the ground node.

[0044] The gates of transistors Q1 and Q2 are connected to data input terminal D. The drains of transistors Q1 and Q2 are connected to the gates of transistors Q3 and Q5. A clock signal CLK is input to the gate of transistor Q4. A clock signal CLK is input to the gates of transistors Q6 and Q8. A gate of transistor Q7 is connected to the drains of transistors Q4 and Q5. The gates of transistors Q9 and Q11 are connected to the drains of transistors Q6 and Q7. A clock signal CLK is input to the gate of transistor Q10. The drains of transistors Q9 and Q10 are connected to data output terminal Q.

[0045] When the clock signal CLK is at a low level, the transistor Q4 is turned on. Inverted data of the input data input to the data input terminal D is input to the gates of the transistors Q3 and Q5, and since the transistor Q4 is on, the drains of the transistors Q4 and Q5 (the gate of the transistor Q7) have the same logic as the input data.

[0046] When the clock signal CLK is low, the transistor Q6 is on and the transistor Q8 is off, so the drains of the transistors Q6 and Q7 are high. As a result, the transistor Q9 is off and the transistor Q11 is on. Also, because the clock signal CLK is low, the transistor Q10 is off.

[0047] In this way, when the clock signal CLK is at a low level, both the transistors Q9 and Q10 are turned off, and the drains of the transistors Q9 and Q10 are at a high impedance.

[0048] As described above, when the clock signal CLK is at a low level, the input data input to the data input terminal is taken into the dynamic FF, and the drains of the transistors Q4 and Q5 have a logic level corresponding to the input data. However, since both the transistors Q9 and Q10 are turned off, the data output terminals connected to the drains of the transistors Q9 and Q10 have a high impedance.

[0049] 3B, when the clock signal CLK goes high, transistor Q4 is off, transistor Q6 is off, transistor Q8 is on, and transistor Q10 is on. Since the drains of transistors Q4 and Q5 have the same logic as the input data and the drains of transistors Q6 and Q7 have the inverted logic of the input data, the data output terminals connected to the drains of transistors Q9 and Q10 have the same logic as the input data.

[0050] 3A and 3B , each of the first flip-flops 5 and the second flip-flops 8 outputs a signal of the same logic as the input signal from its output node when the clock signal is of the first logic, and sets the output node to high impedance when the clock signal is of the second logic. Each of the first flip-flops 5 and the second flip-flops 8 internally receives an input signal when the clock signal is of the second logic, and then outputs a signal of the same logic as the internally received input signal from its output node when the clock signal transitions to the first logic.

[0051] 3A and 3B, while the clock signal CLK is at a low level, the dynamic FF takes in input data, but the output is at a high impedance. When the clock signal CLK is at a high level, data of the same logic as the input data is output from the data output terminal without delay.

[0052] 1, the semiconductor device 1 according to this embodiment includes a plurality of arithmetic units 12. The plurality of arithmetic units 12 are provided corresponding to at least one of the plurality of first data transfer groups 2 or the plurality of second data transfer groups 3, and are arranged along the first direction X and the second direction Y. In a more specific example, the number of the arithmetic units 12 is one less than the number of first flip-flops 5 in each first data transfer group 2. In the example of FIG. 1, each first data transfer group 2 has five first flip-flops 5, while four arithmetic units 12 are provided.

[0053] The specific number and location of the computing units 12 are arbitrary and are not necessarily limited to the number and location shown in Fig. 1. The computing units 12 perform, for example, arithmetic operations or analog-to-digital conversion (AD conversion) processing. The computing units 12 may also perform arithmetic operations other than arithmetic operations or AD conversion.

[0054] 1 , four arithmetic units 12 arranged in the first direction X are grouped into one arithmetic unit group 12g, and a plurality of arithmetic unit groups 12g are arranged in the second direction Y. Each arithmetic unit group 12g is associated with a respective first data transfer group 2. An input buffer 13 and an output buffer 14 are arranged between each arithmetic unit 12 and the corresponding first data transfer group 2. When the enable signal WEN is at a high level, for example, the input buffer 13 inputs the output data of the corresponding first flip-flop 5 to the arithmetic unit 12. When the enable signal REN is at a high level, for example, the output buffer 14 inputs the calculation result of the arithmetic unit 12 to the first flip-flop 5 of the next stage or the corresponding second flip-flop 8.

[0055] In this way, each arithmetic unit 12 performs a predetermined arithmetic process based on the output data of the corresponding first flip-flop 5. The calculation result of each arithmetic unit 12 is transferred to the first data transfer group 2 including the first flip-flop 5 or the second data transfer group 3 including the second flip-flop 8.

[0056] 2, the first data transfer group 2 has a plurality of first flip-flops 5 and a plurality of clock buffers (first clock buffers) 11, and the second data transfer group 3 has a plurality of second flip-flops 8 and a plurality of clock buffers (second clock buffers) 11. By propagating the clock signal CLK through either the plurality of first clock buffers 11 or the plurality of second clock buffers 11, it is possible to switch between transferring the calculation result of the arithmetic unit 12 through the first data transfer group 2 or the second data transfer group 3.

[0057] In addition, enable terminals may be provided to the plurality of first flip-flops 5 and the plurality of second flip-flops 8, and the direction in which data is transferred may be switched between the first direction X and the second direction Y depending on a signal input to the enable terminal.

[0058] In FIG. 1, the first group of arithmetic units 12g is associated with the first data transfer group 2, and an input buffer 13 and an output buffer 14 are connected between each arithmetic unit 12 and the corresponding first flip-flop 5. However, the first group of arithmetic units 12g may be associated with the second data transfer group 3, and an input buffer 13 and an output buffer 14 may be connected between each arithmetic unit 12 and the corresponding second flip-flop 8.

[0059] In this way, each of the multiple arithmetic units 12 inputs the operation result to the first flip-flop 5 or second flip-flop 8 in the next stage of the first data transfer group 2 or second data transfer group 3, which is the same as the first flip-flop 5 or second flip-flop 8 that output the output signal. Alternatively, each of the multiple arithmetic units 12 inputs the operation result to the first flip-flop 5 or second flip-flop 8 in either the first data transfer group 2 or the second data transfer group 3, which is different from the first flip-flop 5 or second flip-flop 8 that output the output signal.

[0060] The controller 4 individually controls switching between transferring the calculation results of the multiple arithmetic units 12 in a first direction X using multiple first data transfer groups 2, and transferring the calculation results of the multiple arithmetic units 12 in a second direction Y using multiple second data transfer groups 3.

[0061] 4 is a block diagram showing a schematic configuration of a semiconductor device 1 according to a modification of the present embodiment. In the semiconductor device 1 according to the modification, a computing unit group 12g having a plurality of computing units 12 arranged in a first direction X corresponds to two first data transfer groups 2 adjacent to each other in a second direction Y, and an input buffer 13 and an output buffer 14 are connected between each computing unit 12 and the corresponding first flip-flop 5 of each first data transfer group 2.

[0062] As described above, in the semiconductor device 1 according to one modification, an input buffer 13 and an output buffer 14 are respectively arranged between each arithmetic unit 12 and the two first data transfer groups 2. The enable signals input to the enable terminals of these input buffers 13 and output buffers 14 can be controlled individually, so that the output data of the first flip-flop 5 of either one of the two first data transfer groups 2 is taken into the arithmetic unit 12 for arithmetic processing, and the result of this arithmetic processing can be output from either one of the two output buffers 14 and transferred via the first data transfer group 2 or the second data transfer group 3.

[0063] This makes it possible to reverse the data transfer direction between odd-numbered rows and even-numbered rows, or between odd-numbered columns and even-numbered columns, for example.

[0064] The semiconductor device 1 according to this embodiment can output the results of operations performed by the multiple arithmetic units 12 in the order in which the multiple arithmetic units 12 are arranged, using multiple first data transfer groups 2, or in the order in which the arrangement of the multiple arithmetic units 12 is permuted, using multiple first data transfer groups 2 and multiple second data transfer groups 3. In this way, switching the order in which the results of operations performed by the multiple arithmetic units 12 are output can be easily achieved by providing multiple switchers for each arithmetic unit 12.

[0065] 5 is a diagram showing an example of the functions of the multiple switches SW1 and SW2 provided for each arithmetic unit 12. The semiconductor device 1 according to this embodiment includes, for each arithmetic unit 12, a first switch SW1 arranged between the corresponding arithmetic unit 12 and the first data transfer group 2, and a second switch SW2 arranged between the corresponding arithmetic unit 12 and the second data transfer group 3.

[0066] The first switch SW1 and the second switch SW2 are exclusively switched on and off, with one being closed and the other being open. For example, when the first switch SW1 is closed, the calculation result of the calculator 12 is transferred in the first direction X via the first data transfer group 2. When the second switch SW2 is closed, the calculation result of the calculator 12 is transferred in the second direction Y via the second data transfer group 3.

[0067] The first switch SW1 and the second switch SW2 in Fig. 5 can be configured using the input buffer 13 and the output buffer 14 of Fig. 1 etc. The multiple output buffers 14 include multiple first output buffers that output the operation results of the multiple arithmetic units 12 in a first direction X or a second direction Y, and multiple second output buffers that output the operation results of the multiple arithmetic units 12 in the direction opposite to the first direction X or the second direction Y. The controller 4 inputs the operation results of the multiple arithmetic units 12 to the multiple first output buffers or the multiple second output buffers via the multiple first output buffers or the multiple second output buffers.

[0068] 6A is a diagram showing an example in which a total of nine arithmetic units 12 are arranged, three in a first direction X (e.g., the row direction) and three in a second direction Y (e.g., the column direction). The calculation results of the nine arithmetic units 12 are normally transferred and output in sequence in the first direction X, as shown in FIG. 6B. In this case, the first switch SW1 in FIG. 5 is closed and the second switch SW2 is opened. As a result, as shown in FIG. 6B, the calculation results a11, a12, and a13 of the first row are output in sequence, then the calculation results a21, a22, and a23 of the second row are output in sequence, and finally the calculation results a31, a32, and a33 of the third row are output in sequence.

[0069] When the operation results of the nine operation units 12 in Fig. 6A are to be transposed and output, the first switch SW1 in Fig. 5 is opened and the second switch SW2 is closed. As a result, as shown in Fig. 6C, the operation results a11, a21, and a31 in the first column are output in order, then the operation results a12, a22, and a32 in the second column are output in order, and finally the operation results a13, a23, and a33 in the third column are output in order.

[0070] In this way, by providing a first switch SW1 between each arithmetic unit 12 and the first data transfer group 2, and a second switch SW2 between each arithmetic unit 12 and the second data transfer group 3, it is possible to easily switch between outputting multiple arithmetic units 12 sequentially by row or by column.

[0071] In Figure 5, an example has been described in which a first switch SW1 and a second switch SW2 are provided for each calculator 12 to switch the transfer order, but instead of providing a first switch SW1 and a second switch SW2 for each calculator 12, it is also possible to store the calculation results of multiple calculators 12 transferred for each first data transfer group 2 in a frame memory, and after the calculation results of multiple calculators 12 transferred in multiple first data transfer groups 2 are stored in the frame memory, switch the order in which the calculation results are read out from the frame memory, thereby selecting whether to output the calculation results row by row or column by column.

[0072] Fig. 7 is a block diagram of a semiconductor device 1 according to a modification of Fig. 4. The semiconductor device 1 of Fig. 7 includes a frame memory 15 connected to the row output circuit 7 and an output order switching circuit 16.

[0073] The frame memory 15 stores the calculation results for each row transferred in each of the plurality of first data transfer groups 2 in order.

[0074] The output order switching circuit 16 selects either row-by-row or column-by-column and sequentially reads out the calculation results of the multiple calculators 12 stored in the frame memory 15. The frame memory 15 and the output order switching circuit 16 may be connected to the column output circuit 10.

[0075] 8A is a diagram showing an arrangement of a plurality of arithmetic units 12. Similar to Fig. 6A, Fig. 8A shows an example in which a total of nine arithmetic units 12 are arranged, three in a first direction X (e.g., the row direction) and three in a second direction Y (e.g., the column direction). These nine arithmetic units 12 output operation results a11, a12, a13, a21, a22, a23, a31, a32, and a33.

[0076] 8B is a diagram showing an example in which the calculation results of a plurality of calculation units 12 are read row by row in a plurality of first data transfer groups 2. The calculation results a11, a12, and a13 of the calculation units 12 in the (1) row of FIG. 8A are read, then the calculation results a21, a22, and a23 in the (2) row are read, and finally the calculation results a31, a32, and a33 in the (3) row are read.

[0077] 8C is a diagram showing storage areas of the frame memory 15. The frame memory 15 stores the calculation results of each calculator 12, which are read row by row, in order column by column. More specifically, the frame memory 15 stores the calculation results a11, a21, and a31 of the (4)th column ((4)-1, (4)-2, and (4)-3) in FIG. 8C), then stores the calculation results a12, a22, and a32 of the (5)th column ((5)-1, (5)-2, and (5)-3) in FIG. 8C), and finally stores the calculation results a13, a23, and a33 of the (6)th column ((6)-1, (6)-2, and (6)-3) in FIG. 8C).

[0078] 8D is a diagram showing an example of reading out the calculation results from the frame memory 15. By reading out the calculation results in an order different from the order in which they were stored in the frame memory 15, it is possible to read out the calculation results with rows and columns swapped.

[0079] In this way, when the calculation results of the multiple calculators 12 are stored in the frame memory 15, the rows and columns are interchanged and stored, so that when the frame memory 15 is read in address order, the rows and columns can be interchanged and read.

[0080] FIG. 9 is a block diagram showing a more detailed configuration of the plurality of first data transfer groups 2 and the plurality of second data transfer groups 3 shown in FIG.

[0081] As shown in FIG. 9 , each of the multiple first data transfer groups 2 includes multiple first flip-flops 5 connected in series in a first direction X (e.g., the row direction) and multiple first clock buffers 11 a connected in the opposite direction to the transfer order of the multiple first flip-flops 5.

[0082] Each of the multiple second data transfer groups 3 has multiple second flip-flops 8 connected in series in the second direction Y (e.g., the column direction) and multiple second clock buffers 11b connected in the opposite direction to the transfer order of the multiple second flip-flops 8.

[0083] Of the multiple first flip-flops 5 constituting each first data transfer group 2, the data output terminals of the first flip-flops 5 except for the final stage are connected to a computing unit 12 via an input buffer 13 and an output buffer 14. Two sets of input buffers 13 and output buffers 14, one above the other in the column direction, are connected to each computing unit 12. The upper input buffer 13 inputs the output signal of the corresponding first flip-flop 5 in the upper first data transfer group 2 to the computing unit 12 when the enable signal REN_U is, for example, at a high level. The upper output buffer 14 outputs the calculation result of the computing unit 12 to the upper first data transfer group 2 when the enable signal WEN_U is, for example, at a high level. The lower input buffer 13 inputs the output signal of the corresponding first flip-flop 5 in the lower first data transfer group 2 to the computing unit 12 when the enable signal REN_D is, for example, at a high level. The lower output buffer 14 outputs the calculation result of the arithmetic unit 12 to the lower first data transfer group 2 when the enable signal WEN_D is at a high level, for example.

[0084] The calculation result of each arithmetic unit 12 is input via the output buffer 14 to the data input terminal of the corresponding first flip-flop 5 in the first data transfer group 2 and to the data input terminal of the corresponding second flip-flop 8 in the second data transfer group 3. When the clock signal CLK is propagated by the plurality of first clock buffers 11a that supply the clock signal CLK to the plurality of first flip-flops 5, the calculation result of each arithmetic unit 12 is transferred in the first direction X via the first data transfer group 2. When the clock signal CLK is propagated by the plurality of second clock buffers 11b that supply the clock signal CLK to the plurality of second flip-flops 8, the calculation result of each arithmetic unit 12 is transferred in the second direction Y via the second data transfer group 3.

[0085] In this way, the transfer direction of the calculation results of the plurality of arithmetic units 12 can be switched depending on whether the clock signal CLK is propagated through the plurality of first clock buffers 11a or the plurality of second clock buffers 11b.

[0086] The multiple first data transfer groups 2 do not necessarily need to transfer data in the same direction, and some of the first data transfer groups 2 may transfer data in the opposite direction to the other first data transfer groups 2. Similarly, the multiple second data transfer groups 3 do not necessarily need to transfer data in the same direction, and some of the second data transfer groups 3 may transfer data in the opposite direction to the other second data transfer groups 3.

[0087] 10 to 13 are diagrams showing variations in typical data transfer directions for a plurality of first data transfer groups 2 and a plurality of second data transfer groups 3. Arrows in Fig. 10 to 13 indicate the data transfer directions.

[0088] 10 shows an example in which a plurality of first data transfer groups 2 all transfer data in a first direction X, and a plurality of second data transfer groups 3 all transfer data in a second direction Y. In Fig. 10, the plurality of first data transfer groups 2 transfer data in parallel up to one end in the first direction X. The plurality of second data transfer groups 3 transfer data in parallel up to one end in the second direction Y.

[0089] 11 shows an example in which the data transfer directions of the odd-numbered rows and the even-numbered rows among the plurality of first data transfer groups 2 are reversed. The plurality of second data transfer groups 3 all transfer data in the second direction YY. In FIG. 11 , data transferred to a first end in the first direction X by some of the plurality of first data transfer groups 2 is transferred to a second end in the opposite direction to the first direction X by the remaining first data transfer groups 2 among the plurality of first data transfer groups 2. The plurality of second data transfer groups 3 transfer data in parallel to one end in the second direction Y.

[0090] 12 shows an example in which the data transfer directions are reversed between odd-numbered columns and even-numbered columns among the plurality of second data transfer groups 3. All of the plurality of first data transfer groups 2 transfer data in the first direction X. In FIG. 12, the plurality of first data transfer groups 2 transfer data in parallel to one end in the first direction X. Data transferred to the first end in the second direction Y by some of the plurality of second data transfer groups 3 is then transferred in the opposite direction of the second direction Y by the remaining second data transfer groups 3 among the plurality of second data transfer groups 3 to the second end.

[0091] 13 shows an example in which the data transfer directions are reversed between odd-numbered rows and even-numbered rows among the plurality of first data transfer groups 2, and the data transfer directions are reversed between odd-numbered columns and even-numbered columns among the plurality of second data transfer groups 3. In Fig. 13, data transferred to a first end in the first direction X by some of the plurality of first data transfer groups 2 is transferred to a second end in the opposite direction to the first direction X by other first data transfer groups 2 among the plurality of first data transfer groups 2, and data transferred to a third end in the second direction Y by some second data transfer groups 3 among the plurality of second data transfer groups 3 is transferred to a fourth end in the opposite direction to the second direction Y by other second data transfer groups 3 among the plurality of second data transfer groups 3.

[0092] 11 and 13, the plurality of first data transfer groups 2 alternately transfer data in the first direction X and in the direction opposite to the first direction X in the order of arrangement in the second direction Y. In Figures 12 and 13, the plurality of second data transfer groups 3 alternately transfer data in the second direction Y and in the direction opposite to the first direction X in the order of arrangement in the first direction X.

[0093] (Stacked Structure) The semiconductor device 1 according to this embodiment can be disposed on one semiconductor substrate, or can have a stacked structure in which two or more semiconductor substrates are stacked.

[0094] 14 is a schematic perspective view of a semiconductor device 1 having a stacked structure according to this embodiment. Fig. 14 shows an example in which the semiconductor device 1 is configured by stacking two semiconductor substrates 21 and 22. A plurality of arithmetic units 12, a plurality of first data transfer groups 2, a row data generator 6, and a row output circuit 7 are arranged on the first semiconductor substrate 21. A plurality of arithmetic units 12, a plurality of second data transfer groups 3, a column data generator 9, and a column output circuit 10 are arranged on the second semiconductor substrate 22.

[0095] Signal transmission between the first semiconductor substrate 21 and the second semiconductor substrate 22 is performed using, for example, a copper-copper connection (CCC), a via, a bump, etc. Either the first semiconductor substrate 21 or the second semiconductor substrate 22 may be disposed on top.

[0096] FIG. 15 is a block diagram of the first semiconductor substrate 21, and FIG. 16 is a block diagram of the second semiconductor substrate 22. As shown in FIG.

[0097] 15 , a plurality of first data transfer groups 2 arranged in the second direction Y and a plurality of arithmetic unit groups 12g arranged in the first direction X are arranged on a first semiconductor substrate 21. Each of the plurality of first data transfer groups 2 has a plurality of first flip-flops 5 connected in series in the first direction X.

[0098] 16 , a plurality of second data transfer groups 3 arranged in the first direction X and a plurality of arithmetic unit groups 12g arranged in the first direction X are arranged on the second semiconductor substrate 22. Each of the plurality of second data transfer groups 3 has a plurality of second flip-flops 8 connected in series in the second direction Y.

[0099] The plurality of arithmetic units 12 on the first semiconductor substrate 21 and the plurality of arithmetic units 12 on the second semiconductor substrate 22 may be arranged so as not to overlap when viewed in a plane, or may be arranged so as to overlap.

[0100] 16 shows an example in which the calculation result of each arithmetic unit 12 is input to the data input terminal of the second flip-flop 8 in the next stage in the same second data transfer group 3 as the second flip-flop 8 that inputs data to each arithmetic unit 12. This is just one example, and the calculation result of each arithmetic unit 12 may also be input to the data input terminal of any second flip-flop 8 in a second data transfer group 3 different from the second flip-flop 8 in the same second data transfer group 3 that inputs data to each arithmetic unit 12.

[0101] Fig. 17 is a block diagram of a second semiconductor substrate 22 according to a modified example of Fig. 16. In Fig. 17, the calculation result of the arithmetic unit 12 is input to the data input terminal of the corresponding second flip-flop 8 in a second data transfer group 3 different from the second data transfer group 3 including the second flip-flop 8 that inputs data to the arithmetic unit 12.

[0102] In this way, the calculation result of the calculator 12 may be input to the corresponding first flip-flop 5 or second flip-flop 8 of a first data transfer group 2 or second data transfer group 3 that is different from the first data transfer group 2 or second data transfer group 3 that input data to the calculator 12.

[0103] (Specific Configuration Example of Arithmetic Unit 12) There is no restriction on the specific content of the arithmetic processing performed by the multiple arithmetic units 12 included in the semiconductor device 1 according to this embodiment. Each arithmetic unit 12 can perform various types of arithmetic processing, and the content of the arithmetic processing to be performed may be switched depending on the time and situation.

[0104] The plurality of first data transfer groups 2 and the plurality of second data transfer groups 3 transfer data including at least one of the operation codes, operands, calculated time codes, identification information of the next input arithmetic unit 12, or operation end information of the plurality of arithmetic units 12.

[0105] Fig. 18 is a block diagram showing a first example of the internal configuration of the arithmetic unit 12. The arithmetic unit 12 shown in Fig. 18 has an internal configuration similar to that of a processor, and includes an input / output control unit 23, a register group 24, a plurality of arithmetic units (ALUs: Arithmetic Logic Units) 25, and a program counter 26. The register group 24 includes a general-purpose register, an instruction register, an index register, etc.

[0106] 19 is a block diagram showing a second example of the internal configuration of the arithmetic unit 12 when the semiconductor device 1 is a pixel ADC type imaging device. The arithmetic unit 12 has at least one pixel unit 27 having an ADC, at least one memory unit 28, and an input / output control unit 29.

[0107] As described above, the semiconductor device 1 according to this embodiment includes a plurality of first data transfer groups 2, each of which transfers data in a first direction X, and a plurality of second data transfer groups 3, each of which transfers data in a second direction Y, and individually switches and controls the connection destinations of the output terminals of the plurality of first flip-flops 5 and the plurality of second flip-flops 8. This allows the data transfer direction to be switched as needed. For example, it is easy to transpose and output the results of an operation performed in the row direction using the plurality of arithmetic units 12 in the column direction.

[0108] <<Application Examples>> The technology according to the present disclosure can be applied to various products. For example, the technology according to the present disclosure may be realized as a device mounted on any type of moving body, such as an automobile, an electric vehicle, a hybrid electric vehicle, a motorcycle, a bicycle, personal mobility, an airplane, a drone, a ship, a robot, construction machinery, or agricultural machinery (tractor).

[0109] 20 is a block diagram showing a schematic configuration example of a vehicle control system 7000, which is an example of a mobile object control system to which the technology according to the present disclosure can be applied. The vehicle control system 7000 includes a plurality of electronic control units connected via a communication network 7010. In the example shown in FIG. 20 , the vehicle control system 7000 includes a drive system control unit 7100, a body system control unit 7200, a battery control unit 7300, an outside-vehicle information detection unit 7400, an inside-vehicle information detection unit 7500, and an integrated control unit 7600. The communication network 7010 connecting these multiple control units may be an in-vehicle communication network conforming to any standard, such as a Controller Area Network (CAN), a Local Interconnect Network (LIN), a Local Area Network (LAN), or FlexRay (registered trademark).

[0110] Each control unit includes a microcomputer that performs arithmetic processing according to various programs, a memory unit that stores the programs executed by the microcomputer or parameters used in various calculations, and a drive circuit that drives various controlled devices. Each control unit includes a network I / F for communicating with other control units via a communication network 7010, and a communication I / F for communicating with devices or sensors inside and outside the vehicle via wired or wireless communication. Figure 20 illustrates the functional configuration of the integrated control unit 7600, including a microcomputer 7610, a general-purpose communication I / F 7620, a dedicated communication I / F 7630, a positioning unit 7640, a beacon receiving unit 7650, an in-vehicle device I / F 7660, an audio / video output unit 7670, an in-vehicle network I / F 7680, and a memory unit 7690. The other control units also include a microcomputer, a communication I / F, a memory unit, and the like.

[0111] The drivetrain control unit 7100 controls the operation of devices related to the drivetrain of the vehicle in accordance with various programs. For example, the drivetrain control unit 7100 functions as a control device for a drive force generating device for generating drive force for the vehicle, such as an internal combustion engine or a drive motor, a drive force transmission mechanism for transmitting drive force to the wheels, a steering mechanism for adjusting the steering angle of the vehicle, and a braking device for generating braking force for the vehicle. The drivetrain control unit 7100 may also function as a control device for an ABS (Antilock Brake System) or an ESC (Electronic Stability Control), etc.

[0112] A vehicle state detection unit 7110 is connected to the drivetrain control unit 7100. The vehicle state detection unit 7110 includes at least one of a gyro sensor that detects the angular velocity of the axial rotational motion of the vehicle body, an acceleration sensor that detects the acceleration of the vehicle, or a sensor that detects the amount of operation of the accelerator pedal, the amount of operation of the brake pedal, the steering angle of the steering wheel, the engine rotation speed, the rotation speed of the wheels, etc. The drivetrain control unit 7100 performs arithmetic processing using signals input from the vehicle state detection unit 7110, and controls the internal combustion engine, the drive motor, the electric power steering device, the brake device, etc.

[0113] The body system control unit 7200 controls the operation of various devices equipped in the vehicle body according to various programs. For example, the body system control unit 7200 functions as a control device for a keyless entry system, a smart key system, a power window device, or various lamps such as headlamps, backup lamps, brake lamps, turn signals, and fog lamps. In this case, radio waves transmitted from a portable device that serves as a key or signals from various switches can be input to the body system control unit 7200. The body system control unit 7200 receives these radio waves or signals and controls the vehicle's door lock device, power window device, lamps, etc.

[0114] The battery control unit 7300 controls the secondary battery 7310, which is the power supply source for the drive motor, in accordance with various programs. For example, information such as battery temperature, battery output voltage, or remaining battery capacity is input to the battery control unit 7300 from a battery device equipped with the secondary battery 7310. The battery control unit 7300 performs arithmetic processing using these signals, and controls the temperature regulation of the secondary battery 7310 or a cooling device or the like equipped in the battery device.

[0115] The outside vehicle information detection unit 7400 detects information outside the vehicle equipped with the vehicle control system 7000. For example, at least one of an imaging unit 7410 and an outside vehicle information detection unit 7420 is connected to the outside vehicle information detection unit 7400. The imaging unit 7410 includes at least one of a time-of-flight (ToF) camera, a stereo camera, a monocular camera, an infrared camera, and other cameras. The outside vehicle information detection unit 7420 includes at least one of an environmental sensor for detecting the current weather or climate, or a surrounding information detection sensor for detecting other vehicles, obstacles, pedestrians, etc. around the vehicle equipped with the vehicle control system 7000.

[0116] The environmental sensor may be, for example, at least one of a raindrop sensor that detects rain, a fog sensor that detects fog, a sunshine sensor that detects the degree of sunshine, and a snow sensor that detects snowfall. The surrounding information detection sensor may be at least one of an ultrasonic sensor, a radar device, and a LIDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging) device. The imaging unit 7410 and the outside vehicle information detection unit 7420 may each be provided as an independent sensor or device, or may be provided as a device in which multiple sensors or devices are integrated.

[0117] 21 shows an example of the installation positions of the imaging unit 7410 and the vehicle exterior information detection unit 7420. The imaging units 7910, 7912, 7914, 7916, and 7918 are provided, for example, at least one of the front nose, side mirrors, rear bumper, back door, and upper part of the windshield inside the vehicle cabin of the vehicle 7900. The imaging unit 7910 provided on the front nose and the imaging unit 7918 provided on the upper part of the windshield inside the vehicle cabin mainly acquire images of the front of the vehicle 7900. The imaging units 7912 and 7914 provided on the side mirrors mainly acquire images of the sides of the vehicle 7900. The imaging unit 7916 provided on the rear bumper or back door mainly acquires images of the rear of the vehicle 7900. The imaging unit 7918 provided on the upper part of the windshield inside the vehicle cabin is mainly used to detect leading vehicles, pedestrians, obstacles, traffic lights, traffic signs, lanes, etc.

[0118] 21 shows an example of the imaging ranges of the imaging units 7910, 7912, 7914, and 7916. Imaging range a indicates the imaging range of the imaging unit 7910 provided on the front nose, imaging ranges b and c indicate the imaging ranges of the imaging units 7912 and 7914 provided on the side mirrors, respectively, and imaging range d indicates the imaging range of the imaging unit 7916 provided on the rear bumper or back door. For example, by overlaying the image data captured by the imaging units 7910, 7912, 7914, and 7916, a bird's-eye view image of the vehicle 7900 viewed from above can be obtained.

[0119] The outside vehicle information detection units 7920, 7922, 7924, 7926, 7928, and 7930 provided on the front, rear, sides, corners, and above the windshield inside the vehicle cabin of the vehicle 7900 may be, for example, ultrasonic sensors or radar devices. The outside vehicle information detection units 7920, 7926, and 7930 provided on the front nose, rear bumper, back door, and above the windshield inside the vehicle cabin of the vehicle 7900 may be, for example, LIDAR devices. These outside vehicle information detection units 7920 to 7930 are mainly used to detect preceding vehicles, pedestrians, obstacles, etc.

[0120] Returning to FIG. 20 , the explanation will be continued. The outside-vehicle information detection unit 7400 causes the imaging unit 7410 to capture an image outside the vehicle and receives the captured image data. The outside-vehicle information detection unit 7400 also receives detection information from the connected outside-vehicle information detection unit 7420. If the outside-vehicle information detection unit 7420 is an ultrasonic sensor, a radar device, or a LIDAR device, the outside-vehicle information detection unit 7400 emits ultrasonic waves or electromagnetic waves and receives information on the received reflected waves. Based on the received information, the outside-vehicle information detection unit 7400 may perform object detection processing or distance detection processing for people, vehicles, obstacles, signs, text on the road, etc. Based on the received information, the outside-vehicle information detection unit 7400 may also perform environment recognition processing for recognizing rainfall, fog, road conditions, etc. Based on the received information, the outside-vehicle information detection unit 7400 may also calculate the distance to an object outside the vehicle.

[0121] The outside vehicle information detection unit 7400 may also perform image recognition processing or distance detection processing to recognize people, vehicles, obstacles, signs, or characters on the road surface based on the received image data. The outside vehicle information detection unit 7400 may perform processing such as distortion correction or alignment on the received image data, and may also generate an overhead image or a panoramic image by combining image data captured by different image capturing units 7410. The outside vehicle information detection unit 7400 may also perform viewpoint conversion processing using image data captured by different image capturing units 7410.

[0122] The interior information detection unit 7500 detects information inside the vehicle. A driver state detection unit 7510 that detects the driver's state is connected to the interior information detection unit 7500, for example. The driver state detection unit 7510 may include a camera that captures an image of the driver, a biosensor that detects the driver's biometric information, or a microphone that collects sound from within the vehicle cabin. The biosensor is provided, for example, on the seat or steering wheel, and detects the biometric information of a passenger sitting in the seat or the driver gripping the steering wheel. The interior information detection unit 7500 may calculate the driver's level of fatigue or concentration based on the detection information input from the driver state detection unit 7510, or may determine whether the driver is dozing off. The interior information detection unit 7500 may perform processing such as noise canceling on the collected audio signal.

[0123] The integrated control unit 7600 controls the overall operation of the vehicle control system 7000 according to various programs. An input unit 7800 is connected to the integrated control unit 7600. The input unit 7800 may be implemented by a device that can be operated by a passenger, such as a touch panel, a button, a microphone, a switch, or a lever. Data obtained by voice recognition of a voice input through a microphone may be input to the integrated control unit 7600. The input unit 7800 may be, for example, a remote control device using infrared or other radio waves, or an externally connected device such as a mobile phone or a personal digital assistant (PDA) that can operate the vehicle control system 7000. The input unit 7800 may be, for example, a camera, in which case the passenger can input information using gestures. Alternatively, data obtained by detecting the movement of a wearable device worn by the passenger may be input. Furthermore, the input unit 7800 may include, for example, an input control circuit that generates an input signal based on information input by the passenger using the input unit 7800 and outputs the input signal to the integrated control unit 7600. Passengers and the like operate this input unit 7800 to input various data to the vehicle control system 7000 and to instruct processing operations.

[0124] The storage unit 7690 may include a ROM (Read Only Memory) that stores various programs executed by the microcomputer, and a RAM (Random Access Memory) that stores various parameters, calculation results, sensor values, etc. The storage unit 7690 may also be realized by a magnetic storage device such as an HDD (Hard Disc Drive), a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like.

[0125] The general-purpose communication I / F 7620 is a general-purpose communication I / F that mediates communication with various devices present in the external environment 7750. The general-purpose communication I / F 7620 may implement a cellular communication protocol such as GSM (Global System of Mobile communications), WiMAX (registered trademark), LTE (Long Term Evolution), or LTE-Advanced (LTE-A), or other wireless communication protocols such as a wireless LAN (also referred to as Wi-Fi (registered trademark)) or Bluetooth (registered trademark). The general-purpose communication I / F 7620 may connect to a device (e.g., an application server or a control server) present on an external network (e.g., the Internet, a cloud network, or an operator-specific network) via, for example, a base station or an access point. In addition, the general-purpose communication I / F 7620 may connect to a terminal located near the vehicle (e.g., a terminal of a driver, pedestrian, or store, or an MTC (Machine Type Communication) terminal) using, for example, P2P (Peer To Peer) technology.

[0126] The dedicated communication I / F 7630 is a communication I / F that supports a communication protocol designed for use in vehicles. The dedicated communication I / F 7630 may implement a standard protocol such as WAVE (Wireless Access in Vehicle Environment), which is a combination of a lower layer IEEE 802.11p and an upper layer IEEE 1609, DSRC (Dedicated Short Range Communications), or a cellular communication protocol. The dedicated communication I / F 7630 typically performs V2X communication, which is a concept including one or more of vehicle-to-vehicle communication, vehicle-to-infrastructure communication, vehicle-to-home communication, and vehicle-to-pedestrian communication.

[0127] The positioning unit 7640 performs positioning by receiving, for example, GNSS signals from GNSS (Global Navigation Satellite System) satellites (for example, GPS signals from GPS (Global Positioning System) satellites), and generates position information including the latitude, longitude, and altitude of the vehicle. Note that the positioning unit 7640 may identify the current position by exchanging signals with a wireless access point, or may obtain position information from a terminal such as a mobile phone, PHS, or smartphone that has a positioning function.

[0128] The beacon receiving unit 7650 receives, for example, radio waves or electromagnetic waves transmitted from radio stations or the like installed on the road, and acquires information such as the current location, congestion, road closures, required travel time, etc. The function of the beacon receiving unit 7650 may be included in the dedicated communication I / F 7630 described above.

[0129] The in-vehicle device I / F 7660 is a communication interface that mediates connections between the microcomputer 7610 and various in-vehicle devices 7760 present in the vehicle. The in-vehicle device I / F 7660 may establish wireless connections using wireless communication protocols such as wireless LAN, Bluetooth (registered trademark), NFC (Near Field Communication), or WUSB (Wireless USB). Furthermore, the in-vehicle device I / F 7660 may establish a wired connection such as USB (Universal Serial Bus), HDMI (High-Definition Multimedia Interface), or MHL (Mobile High-Definition Link) via a connection terminal (and a cable, if necessary) not shown. The in-vehicle device 7760 may include, for example, at least one of a mobile device or a wearable device owned by a passenger, or an information device carried into or attached to the vehicle. The in-vehicle device 7760 may also include a navigation device that searches for a route to an arbitrary destination. The in-vehicle device I / F 7660 exchanges control signals or data signals with these in-vehicle devices 7760.

[0130] The in-vehicle network I / F 7680 is an interface that mediates communication between the microcomputer 7610 and the communication network 7010. The in-vehicle network I / F 7680 transmits and receives signals in accordance with a predetermined protocol supported by the communication network 7010.

[0131] The microcomputer 7610 of the integrated control unit 7600 controls the vehicle control system 7000 in accordance with various programs based on information acquired via at least one of the general-purpose communication I / F 7620, the dedicated communication I / F 7630, the positioning unit 7640, the beacon receiving unit 7650, the in-vehicle device I / F 7660, and the in-vehicle network I / F 7680. For example, the microcomputer 7610 may calculate control target values ​​for the driving force generating device, the steering mechanism, or the braking device based on the acquired information inside and outside the vehicle, and output control commands to the drivetrain control unit 7100. For example, the microcomputer 7610 may perform cooperative control aimed at realizing functions of an Advanced Driver Assistance System (ADAS), including vehicle collision avoidance or impact mitigation, following driving based on the following distance, vehicle speed maintenance driving, vehicle collision warning, vehicle lane departure warning, etc. In addition, the microcomputer 7610 may perform cooperative control for the purpose of autonomous driving, in which the vehicle travels autonomously without relying on driver operation, by controlling a driving force generating device, a steering mechanism, a braking device, etc. based on information acquired about the vehicle's surroundings.

[0132] The microcomputer 7610 may generate three-dimensional distance information between the vehicle and objects such as surrounding structures and people, and create local map information including information about the vicinity of the vehicle's current location, based on information acquired via at least one of the general-purpose communication I / F 7620, the dedicated communication I / F 7630, the positioning unit 7640, the beacon receiving unit 7650, the in-vehicle device I / F 7660, and the in-vehicle network I / F 7680. Furthermore, the microcomputer 7610 may predict dangers, such as a vehicle collision, the approach of a pedestrian, or entry into a closed road, based on the acquired information, and generate a warning signal. The warning signal may be, for example, a signal for generating a warning sound or turning on a warning lamp.

[0133] The audio / image output unit 7670 transmits at least one audio and / or image output signal to an output device capable of visually or audibly notifying the vehicle occupants or the outside of the vehicle of information. In the example of FIG. 20 , an audio speaker 7710, a display unit 7720, and an instrument panel 7730 are illustrated as examples of the output devices. The display unit 7720 may include, for example, at least one of an on-board display and a head-up display. The display unit 7720 may have an AR (Augmented Reality) display function. The output device may also be other devices, such as headphones, a wearable device such as an eyeglass-type display worn by the occupant, a projector, or a lamp. When the output device is a display device, the display device visually displays results obtained by various processes performed by the microcomputer 7610 or information received from other control units in various formats, such as text, images, tables, and graphs. When the output device is an audio output device, the audio output device converts audio signals, such as reproduced audio data or acoustic data, into analog signals and audibly outputs the analog signals.

[0134] In the example shown in FIG. 20 , at least two control units connected via the communication network 7010 may be integrated into a single control unit. Alternatively, each control unit may be composed of multiple control units. Furthermore, the vehicle control system 7000 may include another control unit not shown. In addition, in the above description, some or all of the functions performed by one of the control units may be assigned to another control unit. In other words, as long as information is transmitted and received via the communication network 7010, predetermined arithmetic processing may be performed by one of the control units. Similarly, a sensor or device connected to one of the control units may be connected to another control unit, and multiple control units may transmit and receive detection information to each other via the communication network 7010.

[0135] In the vehicle control system 7000 described above, the semiconductor device 1 according to the present embodiment described using FIG. 1 etc. can be applied to the integrated control unit 7600 of the application example shown in FIG.

[0136] 1 and the like may be realized in a module (for example, an integrated circuit module configured on a single die) for the integrated control unit 7600 shown in Fig. 20. Alternatively, the semiconductor device 1 described using Fig. 1 and the like may be realized by a plurality of control units of the vehicle control system 7000 shown in Fig. 20.

[0137] The present technology can be configured as follows:

[0138] (1) A semiconductor device comprising: a plurality of first data transfer groups each including a plurality of first flip-flops that transfer data in a first direction and arranged in a second direction intersecting the first direction, a plurality of second data transfer groups each including a plurality of second flip-flops that transfer data in the second direction and arranged in the first direction, and a switching controller that individually switches and controls connection destinations of output terminals of the plurality of first flip-flops and the plurality of second flip-flops in each of the plurality of first data transfer groups and the plurality of second data transfer groups. (2) The semiconductor device according to (1), wherein a propagation order of a clock signal input to the plurality of first flip-flops and a propagation order of data input to the plurality of first flip-flops are opposite to each other, and a propagation order of a clock signal input to the plurality of second flip-flops and a propagation order of data input to the plurality of second flip-flops are opposite to each other. (3) The semiconductor device according to (1) or (2), comprising a plurality of arithmetic units provided corresponding to at least one of the plurality of first data transfer groups or the plurality of second data transfer groups and arranged along the first direction and the second direction, wherein each of the plurality of arithmetic units performs arithmetic processing based on an output signal of the corresponding first flip-flop or second flip-flop. (4) The semiconductor device according to (3), wherein the plurality of arithmetic units perform at least one of four arithmetic operations or analog-to-digital conversion. (5) The semiconductor device according to (3) or (4), wherein each of the plurality of arithmetic units inputs a result of its operation to the first flip-flop or the second flip-flop in the next stage in the first data transfer group or the second data transfer group that is the same as the first flip-flop or the second flip-flop that output the output signal. (6) The semiconductor device according to (3) or (4), wherein each of the plurality of arithmetic units inputs an operation result to the first flip-flop or the second flip-flop of either the first data transfer group or the second data transfer group that is different from the first flip-flop or the second flip-flop that output the output signal.(7) The semiconductor device according to any one of (3) to (6), wherein the switching controller individually controls switching between transferring the operation results of the plurality of arithmetic units in the first direction by the plurality of first data transfer groups and transferring the operation results of the plurality of arithmetic units in the second direction by the plurality of second data transfer groups. (8) The semiconductor device according to (7), further comprising a plurality of switchers that switch output signal paths of the plurality of first flip-flops and the plurality of second flip-flops in each of the plurality of first data transfer groups and the plurality of second data transfer groups in accordance with switching control by the switching controller. (9) The semiconductor device according to (8), wherein the plurality of switchers are connected between input nodes of the plurality of first flip-flops and output nodes of the plurality of arithmetic units, and between input nodes of the plurality of second flip-flops and output nodes of the plurality of arithmetic units. (10) The semiconductor device according to any one of (3) to (9), comprising: a plurality of first output buffers that output operation results of the plurality of arithmetic units in the first direction or the second direction, and a plurality of second output buffers that output operation results of the plurality of arithmetic units in a direction opposite to the first direction or the second direction, wherein the switching controller inputs the operation results of the plurality of arithmetic units to the plurality of first flip-flops or the plurality of second flip-flops via the plurality of first output buffers or the plurality of second output buffers. (11) The semiconductor device according to any one of (3) to (10), wherein the plurality of first data transfer groups, the plurality of second data transfer groups, and the plurality of arithmetic units are arranged on a single semiconductor layer or are divided and arranged on a plurality of semiconductor layers. (12) The semiconductor device according to any one of (3) to (11), wherein the plurality of first data transfer groups and the plurality of second data transfer groups transfer data including at least one of opcodes, operands, calculated time codes, identification information of a next input arithmetic unit, or operation end information of the plurality of arithmetic units. (13) The semiconductor device according to any one of (1) to (12), wherein the plurality of first data transfer groups transfer data in parallel up to one end in the first direction, and the plurality of second data transfer groups transfer data in parallel up to one end in the second direction.(14) The semiconductor device according to any one of (1) to (12), wherein data transferred to a first end in the first direction by some of the plurality of first data transfer groups is transferred to a second end in a direction opposite to the first direction by other first data transfer groups of the plurality of first data transfer groups, and the plurality of second data transfer groups transfer data in parallel to one end in the second direction. (15) The semiconductor device according to any one of (1) to (12), wherein the plurality of first data transfer groups transfer data in parallel to one end in the first direction, and data transferred to a first end in the second direction by some second data transfer groups of the plurality of second data transfer groups is transferred to a second end in a direction opposite to the second direction by other second data transfer groups of the plurality of second data transfer groups. (16) The semiconductor device according to any one of (1) to (12), wherein data transferred to a first end in the first direction by some of the plurality of first data transfer groups is transferred to a second end in a direction opposite to the first direction by other first data transfer groups of the plurality of first data transfer groups, and data transferred to a third end in the second direction by some second data transfer groups of the plurality of second data transfer groups is transferred to a fourth end in the direction opposite to the second direction by other second data transfer groups of the plurality of second data transfer groups. (17) The semiconductor device according to any one of (1) to (9), wherein the plurality of first data transfer groups alternately transfer data in the first direction and data in a direction opposite to the first direction in an order arranged in the second direction. (18) The semiconductor device according to any one of (1) to (12), wherein the plurality of second data transfer groups alternately transfer data in the second direction and data in a direction opposite to the first direction in an order arranged in the first direction. (19) The semiconductor device according to any one of (1) to (18), wherein each of the plurality of first flip-flops and the plurality of second flip-flops outputs a signal of the same logic as an input signal from an output node when the clock signal is of a first logic, and makes the output node high impedance when the clock signal is of a second logic.(20) The semiconductor device described in (19), wherein each of the plurality of first flip-flops and the plurality of second flip-flops takes in the input signal when the clock signal is at the second logic, and then outputs a signal of the same logic as the input signal taken in from the output node when the clock signal transitions to the first logic.

[0139] The aspects of the present disclosure are not limited to the individual embodiments described above, but include various modifications that may be conceived by those skilled in the art, and the effects of the present disclosure are not limited to the above-described contents. In other words, various additions, modifications, and partial deletions are possible within the scope of the conceptual idea and spirit of the present disclosure, which is derived from the contents defined in the claims and their equivalents.

[0140] 1 semiconductor device, 2 first data transfer group, 3 second data transfer group, 4 controller, 5 first output buffer, 5 first flip-flop, 6 row data generator, 7 row output circuit, 8 second output buffer, 8 second flip-flop, 9 column data generator, 10 column output circuit, 11 clock buffer, 11a first clock buffer, 11b second clock buffer, 12 arithmetic unit, 12g arithmetic unit group, 13 input buffer, 14 output buffer, 15 frame memory, 16 output order switching circuit, 21 first semiconductor substrate, 22 second semiconductor substrate, 23 input / output control unit, 24 register group, 25 arithmetic unit, 26 program counter, 27 pixel unit, 28 memory unit, 29 input / output control unit

Claims

1. A semiconductor device comprising: a plurality of first data transfer groups, each including a plurality of first flip-flops that transfer data in a first direction, and arranged in a second direction intersecting the first direction; a plurality of second data transfer groups, each including a plurality of second flip-flops that transfer data in the second direction, and arranged in the first direction; and a switching controller that individually switches and controls the connection destinations of the output terminals of the plurality of first flip-flops and the plurality of second flip-flops in each of the plurality of first data transfer groups and the plurality of second data transfer groups.

2. The semiconductor device according to claim 1, wherein a propagation order of a clock signal input to said plurality of first flip-flops and a propagation order of data input to said plurality of first flip-flops are opposite to each other, and a propagation order of a clock signal input to said plurality of second flip-flops and a propagation order of data input to said plurality of second flip-flops are opposite to each other.

3. The semiconductor device according to claim 1, further comprising a plurality of arithmetic units arranged along the first direction and the second direction, the plurality of arithmetic units being provided corresponding to at least one of the plurality of first data transfer groups or the plurality of second data transfer groups, and each of the plurality of arithmetic units performing arithmetic processing based on an output signal of the corresponding first flip-flop or second flip-flop.

4. The semiconductor device according to claim 3, wherein said plurality of arithmetic units perform at least one of the four arithmetic operations or analog-to-digital conversion.

5. The semiconductor device according to claim 3, wherein each of the plurality of arithmetic units inputs an arithmetic result to the first flip-flop or the second flip-flop in the next stage of the first data transfer group or the second data transfer group that is the same as the first flip-flop or the second flip-flop that output the output signal.

6. The semiconductor device according to claim 3, wherein each of the plurality of arithmetic units inputs an arithmetic result to the first flip-flop or the second flip-flop of either the first data transfer group or the second data transfer group different from the first flip-flop or the second flip-flop that output the output signal.

7. The semiconductor device according to claim 3, wherein the switching controller individually controls switching between transferring the operation results of the plurality of arithmetic units in the first direction by the plurality of first data transfer groups, and transferring the operation results of the plurality of arithmetic units in the second direction by the plurality of second data transfer groups.

8. The semiconductor device according to claim 7, further comprising a plurality of switches that switch output signal paths of the plurality of first flip-flops and the plurality of second flip-flops in each of the plurality of first data transfer groups and the plurality of second data transfer groups in accordance with switching control by the switching controller.

9. The semiconductor device according to claim 8, wherein the plurality of switches are connected between input nodes of the plurality of first flip-flops and output nodes of the plurality of arithmetic units, and are connected between input nodes of the plurality of second flip-flops and output nodes of the plurality of arithmetic units.

10. The semiconductor device according to claim 3, comprising: a plurality of first output buffers which output the results of operation of the plurality of arithmetic units in the first direction or the second direction; and a plurality of second output buffers which output the results of operation of the plurality of arithmetic units in a direction opposite to the first direction or the second direction, wherein the switching controller inputs the results of operation of the plurality of arithmetic units to the plurality of first flip-flops or the plurality of second flip-flops via the plurality of first output buffers or the plurality of second output buffers.

11. The semiconductor device according to claim 3, wherein the plurality of first data transfer groups, the plurality of second data transfer groups, and the plurality of arithmetic units are arranged in one semiconductor layer, or are divided and arranged across a plurality of semiconductor layers.

12. The semiconductor device according to claim 3, wherein the plurality of first data transfer groups and the plurality of second data transfer groups transfer data including at least one of the opcodes, operands, time codes of operations performed, identification information of the next input operation unit, or operation end information of the plurality of operation units.

13. The semiconductor device according to claim 1, wherein the plurality of first data transfer groups transfer data in parallel up to one end in the first direction, and the plurality of second data transfer groups transfer data in parallel up to one end in the second direction.

14. The semiconductor device according to claim 1, wherein data transferred to a first end in the first direction in a portion of the plurality of first data transfer groups is transferred in a direction opposite to the first direction to a second end in a portion of the plurality of first data transfer groups other than the portion of the plurality of first data transfer groups, and the plurality of second data transfer groups transfer data in parallel to one end in the second direction.

15. The semiconductor device according to claim 1, wherein the plurality of first data transfer groups transfer data in parallel to one end in the first direction, and data transferred to the first end in the second direction by some of the plurality of second data transfer groups is transferred in a direction opposite to the second direction to a second end by other second data transfer groups than the some of the plurality of second data transfer groups.

16. The semiconductor device of claim 1, wherein data transferred to a first end in the first direction in a portion of the plurality of first data transfer groups is transferred to a second end in a direction opposite to the first direction in a portion of the plurality of first data transfer groups other than the portion, and data transferred to a third end in the second direction in a portion of the plurality of second data transfer groups is transferred to a fourth end in the direction opposite to the second direction in a portion of the plurality of second data transfer groups other than the portion.

17. The semiconductor device according to claim 1, wherein the plurality of first data transfer groups alternately transfer data in the first direction and data in a direction opposite to the first direction in the order of arrangement in the second direction.

18. The semiconductor device according to claim 1, wherein the plurality of second data transfer groups alternate between data transfer in the second direction and data transfer in a direction opposite to the first direction in the order of arrangement in the first direction.

19. The semiconductor device according to claim 1, wherein each of the plurality of first flip-flops and the plurality of second flip-flops outputs a signal of the same logic as an input signal from an output node when the clock signal is of a first logic, and sets the output node to a high impedance state when the clock signal is of a second logic.

20. The semiconductor device according to claim 19, wherein each of the plurality of first flip-flops and the plurality of second flip-flops internally takes in the input signal when the clock signal is at the second logic, and thereafter, when the clock signal transitions to the first logic, outputs from the output node a signal of the same logic as the input signal taken in.

Citation Information

Patent Citations

  • Series and parallel converting circuit

    JP1984072227A

  • Series-parallel interface element

    JP1984158436A

  • Serial / parallel conversion circuit and two-dimension shift register circuit

    JP1991121626A

  • Parallel / serial conversion circuit

    JP1992217121A

  • Two-dimension shift array for picture compression

    JP1993095486A