Raiders GM to absent Brown: Time to be ‘All in or all out’