Leonardo is denying the Diddy allegations of him being at the freak off parties