Row reducing allows you to systematically manipulate a matrix into reduced row echelon form using elementary row operations. These operations include swapping two rows, multiplying a row by a non-zero constant, and adding a multiple of one row to another. The document provides an example of using row operations like choosing pivots to get zeros below and above the pivot entries. It also shows expressing the solution of a system of equations in terms of parameters when there are more unknowns than equations.