@Bhushan-Bannur You can follow the instructions from here https://community.windy.com/topic/3952/how-to-set-up-a-windy-alert

Just enable rain in the alert and set your desired timeframes.