There were two of us, and we made it to Anacapa and back in one day. It took us about 4.5 hours to get there, and 2.5 hours to get back. The way out was mostly peddling, with the direction of the wind providing little to no help on the way out.
There are websites that'll tell you its a 12 mile trip each way. My handheld gps logged me at a touch over 14 miles each way.
Frenchies cove is supposed to be about the only landing point, and it is near the midpoint of the island. We found an exposed stretch of beach to pull into that was, perhaps, a half mile closer. I am not certain this beach would always be accessible, depending on tides and such.
If you are thinking about making the trip, be sure to check the swell forecast:http://www.ndbc.noaa.gov/data/Forecasts/FZUS56.KLOX.html
We waited a long time for favorable conditions that coincided with days we had off work and free.
Also we carried 2 sets of flare guns, air horn, handheld gps, floating lanterns, whistle, NOAA weather radio.
On a clear day, you can see Anacapa island as soon as you get out of the harbor. There's also a oil platform that you can aim for, that is almost directly on course. I think it was around 4 miles out.
If I were to do this again, I'd probably aim for the next island out. Its further, but I believe it supports overnight camping. I don't think there's any beaches on Anacapa that you can pull into, and legally camp overnight. There and back was a really
long haul for one day.