FEniCS doesn’t currently support GPUs, so I don’t believe you will experience any speedup by considering GPUs.
However it has been fundamentally designed for parallel processing using MPI.
The actual speedup you can get is highly dependent on a combination of factors, including the problem in hand, the solver, and preconditioner etc.