Click "Render" above to enter the rendering interface. When your camera view is inclined (meaning the camera angle is not 0), you can calibrate the camera by clicking "Camera Settings-Camera Calibration" in the right property panel.
As explained in the hover window when you hover the question mark icon after the calibration option, turning on the calibration will bring all the originally vertical downward lines to vertical instead of diagonal.