That is what I tend to do - a jug or two of water, probably less than tepid to be fair - straight over the windows, poured from the top.
Never caused me any issues and defrosts the car immediately
I would never use boiling water though!
Every winter morning, when frost covers the windows of the car, I pour warm water over from the kettle. Instant defrost, never had a single problem.......