Paul Whelan's brother: "I don’t think any of us thought it would be going on so long"