I'd wear it with a white shirt, dark colored ascot, dark jeans, and brown or black shoes. Or perhaps black trousers and a pair of nifty velvet slippers with a crest on the vamp, but still wear an ascot with it too.
Addition: white linen pocket square in the squared off fold
Addition: white linen pocket square in the squared off fold