Quantum Circuit for Partially Observable Markov Decision Process

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

There is no specific quantum computer model proposed for implementing a partially observable Markov decision process, which is essential for solving optimization control problems where environmental information cannot be observed perfectly.

Innovation Solution

A quantum circuit and computation method involving a series of unitary gates applied to initial qubit states, followed by observation to set a final state, allowing for the solution of partially observable Markov decision processes by decomposing doubly stochastic matrices into linear combinations of permutation matrices, reducing computation time from classical O(2^n) to polynomial time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a classical algorithm is used to solve a partially observable Markov decision process, then the problem can be solved, but the computation time is exponentially long (O(2^n))

Engineering Contradiction:
Improvecomputation speedVSAvoidcomputation time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent replaces the classical computational system with a quantum computational system. Specifically, it uses quantum circuits with unitary gates to implement a quantum algorithm that solves the POMDP problem. The quantum algorithm leverages quantum parallelism and interference to achieve polynomial-time computation compared to the exponential time required by classical algorithms, directly substituting the mechanical classical computation with quantum mechanical processes.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If no specific quantum computer model is proposed for POMDP, then existing quantum algorithms cannot be applied, but a general quantum computing framework exists

Engineering Contradiction:
Improveapplicability to POMDPVSAvoidmodel specificity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the POMDP problem into components that can be represented and processed by quantum circuits. It decomposes the problem into state representations, transition models, and observation models that can be implemented using specific quantum gate operations. This segmentation allows the general quantum computing framework to be adapted to the specific requirements of POMDP without requiring a completely new quantum computer architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the parameters of the computational system from classical to quantum by introducing quantum states, unitary transformations, and measurement processes. It parameterizes the POMDP problem in terms of quantum circuit depth, number of qubits, and gate operations, allowing the problem to be solved within the existing quantum computing framework while maintaining adaptability to different POMDP instances.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20230334356A1Quantum circuit and quantum computation method
Publication Date: 2023.10.19 GRID INC
  • US20230334356A1 patent drawing
  • US20230334356A1 patent drawing
  • US20230334356A1 patent drawing

AI summary

Provided is a quantum circuit for solving a problem in a partially observable Markov decision process, which includes a plurality of first unitary gates U0, U1, ..., Uq applied to an initial state including n qubits in order, and a plurality of second unitary gates α0, α1, ..., aq+1 applied to one qubit in a |0>state in order, wherein Uq is controlled by a qubit output from αq, and after computation by the first unitary gates and the second unitary gates is performed, the states of the n qubits are observed to confirm the state of each qubit in order to set a final state.