This paper reports a new numerical approach for numerically solving types of fractional variational problems. In our approach, we use the fractional integrals operational matrix, described in the sense of Riemann-Liouville, with the help of the Lagrange multiplier technique for converting the fractional variational problem into an easier problem that consisting of solving an algebraic equations system in the unknown coefficients. Several numerical examples are introduced, combined with their approximate solutions and comparisons with other numerical approaches, for confirming the accuracy and applicability of the proposed approach.