Paul is referring primarily to the leadership of Israel and also to the leadership of Rome, who did not recognize who Jesus truly was.
Watch the Teaching: What Does It Mean to Make Shipwreck of Your Faith?