Patriots quarterback Matt Cassel has left the team briefly after the death of his father. New England, who will play the Raiders in Oakland on Sunday, is unsure about when he will return to the team.