Matt Patricia defends his time management after tardiness report