Welcome! It's good to see Virginia sailors here. And I'm jealous; you live in a great place for sailing.
From what I've read, your best launch spots into the bay will probably be Willoughby Spit or Albemarle Street in VB. There is also a state boat ramp at First Landing State Park. To get into the ocean quickly I think you can use Rudy Inlet; I sailed from there many years ago.
On the James, a potentially interesting launch site that I have yet to check out is on the east shore of Hog Island, just downriver from Jamestown but on the Chesapeake side. You have to navigate a small estuary but after that you are in big, clear water. It will be best with an East or Southeast wind, less so with the more prevalent SSW wind.
I don't know what kind of sailing you're looking for, but if I lived there I'd probably find a way to get to the ocean pretty frequently. And you should hook up with the Fleet 32 folks if you haven't already.
_________________
'00 H16 #104691
'78 H16 #32692 ex-rental [gone]
Old Holsclaw trailer
My Hobie 16 pages