No.
The field lines give the direction of the force on a positive charge.
The direction of the electric field is always along the tangent. So electrostatic force on a charged particle will be along the tangential line.
However, due to initial velocity, it may move at an angle to the electric field.
but if the initial velocity is zero then we can say that a positively charged particle moves along the electric lines of forces.