Kelsey Grammer -- Our Baby Partied ... Cause We Couldn't Find a Sitter!!!

Kelsey Grammer tells TMZ ... the reason he took his 3-month-old daughter to a raging Halloween party at the Playboy Mansion Saturday night is because he just couldn't find a good babysitter. Kelsey just sent us a statement ... explaining, "Kayte is…