I do business casual in jeans almost every day. For me the key is dark washed jeans - faded jeans are far more difficult to dress up and they almost always ruin the look IMHO. Also, I like my jeans to fit. I'm in decent shape and wear a 32" waist, and I wear them fitted. I own lots of Gap slim fit and straight fit jeans which work well. Not loose or baggy, but not tight either. Just fitted, if that makes any sense. Japanese selvedge jeans also work extremely well, including button flys.
I wear almost exclusively Brooks Brothers button down shirts, both OCBD and shirts which might be considered dress shirts. Always button down collars. I don't wear white dress shirts with jeans, but almost anything short of that goes as far as I'm concerned. With this I'll pair either some Allen Edmonds shoes or a nice pair of Frye boots, with a nice matching belt, usually from AE or BB.
Variety is important in shoes/belts/shirts as I'm wearing jeans every day. I own every button down BB makes (well, almost every one) and I'm always looking for a new release!
I manage a luxury condominium in Tribeca, and this look works well for me.
ETA
Having a look at your photo I would substitute a BB half zip or 3 button sweater (or equivalent) for the fleece to dress it up a wee bit. Then again, fleece might be appropriate for going to visit a sub. Regardless, what you have looks sharp for a visit to the field.
ETA #2
Brown belts/shoes goes better with jeans IMHO - I agree 100%. Black works also when paired with the right stuff, but brown clicks effortlessly most of the time for me.
Good luck!