Make a datum curve reference and put a point in the handle part that correlates to the curve.
In other words, you can make the handle follow a "curve" using constraints.
Your curve would likely be the centerline of the slot projected onto a cylinder.