If your routine is to fish a few hours in the morning, consider getting a motor. Depending on whether you already have a trolling motor & battery, you can spend a few $ on a DIY mount to over $2K on an evolve/torqueedo. There's MANY threads on this subject. A motor will probably also make the transition from a power boat seem a little more natural. The motor will not buy you that much speed over pedaling, but it will give you more range since it saves your energy from pedaling long distance and fighting wind & current.
Stating the obvious here, you're not going to be able to jump in a kayak & cover NEARLY as much water at 4 to 6 mph max (even with a motor) as you would with a power boat. Unless your fishing grounds are really close to where you dock you WILL be transporting the boat to fish, IMO. On the other hand, you may discover productive areas that were inaccessible to your boat.