Does a horror movie have to be scary to be good

No. There are elements of horror that have become staples, utilizing those staples to make a good film doesn’t always result in the effect of being scary, but it still falls under the horror umbrella.