You are not far off the mark but forget the jeans and go with some black wool pleated pants with cuffs in conjunction with black loafers. I would stick with the White shirt, maybe even wear it open at the neck (no tie) and with a button down collar. I don't think the jacket sounds particularly formal but don't go with jeans, its too informal. As for an ascot ... I really don't see it!
If you go with a button down collar oxford in white that would serve to provide the informal bit of the look. If every other thing goes informal the coat gets abandoned as the sole piece of slightly formal kit.
If you go with a button down collar oxford in white that would serve to provide the informal bit of the look. If every other thing goes informal the coat gets abandoned as the sole piece of slightly formal kit.