Use qint64 when calculating memory usage for layer in "New" dialog
This prevents overflow when the layer will be larger than 2 GB or 2.1 gigapixels.