Minimum degree algorithm

In numerical analysis the minimum degree algorithm is an algorithm used to permute the rows and columns of a symmetric sparse matrix before applying the Cholesky decomposition, to reduce the number of non-zeros in the Cholesky factor. This results in reduced storage requirements and means that the Cholesky factor, or sometimes an incomplete Cholesky factor used as a preconditioner (for example in the preconditioned conjugate gradient algorithm) can be applied with fewer arithmetic operations.

Minimum degree algorithms are often used in the finite element method where the reordering of nodes can be carried out depending only on the topology of the mesh, rather than the coefficients in the partial differential equation, resulting in efficiency savings when the same mesh is used for a variety of coefficient values.

Given a linear system

${\mathbf {A}}{\mathbf {x}}={\mathbf {b}}$

where A is an $n\times n$ real symmetric sparse square matrix the Cholesky factor L will typically suffer 'fill in', that is have more non-zeros than the upper triangle of A. We seek a permutation matrix P, so that the matrix ${\mathbf {P}}^{T}{\mathbf {A}}{\mathbf {P}}$, which is also symmetric, has the least possible fill in its Cholesky factor. We solve the reordered system

$\left({\mathbf {P}}^{T}{\mathbf {A}}{\mathbf {P}}\right)\left({\mathbf {P}}^{T}{\mathbf {x}}\right)={\mathbf {P}}^{T}{\mathbf {b}}.$

The problem of finding the best ordering is an NP-complete problem and is thus intractable, so heuristic methods are used instead. The minimum degree algorithm is derived from a method first proposed by Markowitz in 1959 for non-symmetric linear programming problems, which is loosely described as follows. At each step in Gaussian elimination row and column permutations are performed so as to minimize the number of off diagonal non-zeros in the pivot row and column. A symmetric version of Markowitz method was described by Tinney and Walker in 1967 and Rose later derived a graph theoretic version of the algorithm where the factorization is only simulated, and this was named the minimum degree algorithm. The graph referred to is the graph with n vertices, with vertices i and j connected by an edge when $a_{{ij}}\neq 0$, and the degree is the degree of the vertices. A crucial aspect of such algorithms is a tie breaking strategy when there is a choice of renumbering resulting in the same degree.

A version of the minimum degree algorithm was implemented in the MATLAB function symmmd (where MMD stands for multiple minimum degree), but has now been superseded by a symmetric approximate multiple minimum degree function symamd, which is faster. This is confirmed by theoretical analysis, which shows that for graphs on n vertices and m edges, MMD has a tight upper bound of $O(n^{2}m)$ on its run time, whereas for AMD a tight bound of $O(nm)$ holds.

References

• Markowitz, H. M. (1957). "The elimination form of the inverse and its application to linear programming". Management Science. 3 (3): 255–269. doi:10.1287/mnsc.3.3.255. JSTOR 2627454.
• George, Alan; Liu, Joseph (1989). "The evolution of the Minimum Degree Ordering Algorithm". SIAM Review. 31 (1): 1–19. doi:10.1137/1031001. JSTOR 2030845.
• Tinney, W. F.; Walker, J. W. (1967). "Direct solution of sparse network equations by optimally ordered triangular factorization". Proc. IEEE. 55 (11): 1801–1809. doi:10.1109/PROC.1967.6011.
• Rose, D. J. (1972). "A graph-theoretic study of the numerical solution of sparse positive definite systems of linear equations". In Read, R. C. Graph Theory and Computing. New York: Academic Press. pp. 183–217. ISBN 0-12-583850-6.
• Heggernes, P.; Eisenstat, S. C.; Kumfert, G.; Pothen, A. (December 2001), The Computational Complexity of the Minimum Degree Algorithm (Technical report), Institute for Computer Applications in Science and Engineering