I heard that I do not need to pay Medicare levy if I am covered by a private hospital insurance. Is it correct?

No. Generally speaking, in case you are covered by private hospital insurance, you may be exempt from Medicare levy surcharge but not Medicare levy.