Roadrunner were you using the sail also?
The "light winds" were actually light head winds -- sail wouldn't have been much help.
Your legs must be in better shape than mine for the two and a half mile course. With the June gloom upon us I have been on Lakes for fishing in the morning fog on my paddle kayak.
I will admit to riding a bicycle occasionally back in the old days (old as in "I ain't no spring chicken").
I was looking at your Turbofin tension adjustment. Just for fun, try tightening them up enough to seat them a little further in the groove (about 1/8 to 3/16 in total) and see if it makes a difference. I found if the clews were getting too close to the edge of the sproket guard, the fins got a little sloppy.
If you get down to Lake Hodges, let me know; it's in my back yard. Open Wed., Sat., Sun. Perfect lake for kayaking -- Some people even fish here!8)