Some algebra

  • Transposition:

\(\displaystyle \left( \underline{\underline M} \; \underline{x}\right)^T = \underline{x}^T\, \underline{\underline M}^T\) and \(\displaystyle \left( \underline{\underline M} \; \underline{\underline H} \right)^T = \underline{\underline H}^T\, \underline{\underline M}^T\)

  • Gradient computation:

    \(J(\underline{x})\)

    \(\underline{\rm grad\ }J(\underline{x})\)

    \(\underline{u}^T \, \underline{x}\)

    \(\underline{u}\)

    \(\underline{u}^T \, \underline{\underline M} \; \underline{x}\)

    \(\underline{\underline M}^T\, \underline{u}\)

    \(\underline{x}^T \, \underline{\underline M} \; \underline{x}\)

    \(\left(\underline{\underline M} +\,\underline{\underline M}^T \right)\, \underline{x}\)

    \(\underline{x}^T\,\underline{\underline H}^T\, \underline{\underline M} \; \underline{\underline H} \; \underline{x}\)

    \(\underline{\underline H} \; \left(\underline{\underline M}+\underline{\underline M}^T\right) \, \underline{\underline H}^T \, \underline{x}\)