Is the 'power' Paul mentions in verse 11 referring to supernatural miracles?

No, the supernatural miracle is that idolatrous pagans believe the Gospel and are redeemed and transformed by God.

Watch the Teaching: Have You Missed the Rapture? Paul's Answer in 2 Thessalonians