Why didn't people automatically flock to Paul the way they do to charismatic leaders?

Les explains that Paul came from being an abject persecutor to the Apostle of the Risen Christ to the Gentiles. Paul said his authority was given by the Lord for edification, not for destruction—a flashback to his days as a persecutor, when he persecuted many lives as a religious Jew. Now his role was to edify the saints. He said he should not be ashamed, and in verse 9 he did not want to seem as if he would terrify them with letters. The Corinthians referred to his first letter, where he read them the riot act, correcting abuses, calling a spade a spade, and making no bones about it. He was quoting rumors that had come back to him, and he heard just about everything said. Yet there was something about the Apostle that did not automatically draw people to him like some charismatic men can do.