Day for night doesn’t work very well if there’s bright sunlight illuminating the background, so the best bet with this scene is probably to set it during the twilight hours. Here’s a quick mockup to show how that could look, with the open sky graded to approximate the previous dinner scene: http://screenshotcomparison.com/comparison/183078/picture:0 There’s some artifacting and it would need to be shot by shot to account for changes in luminosity, but it could theoretically work.
