The problem is, Earth has been hit many times by asteroids, and yes, out of all those that hit, only one was an Extinction Event.
But reality (and mathematics) both say "If it happened once, it can happen again."
Look at Tunguska in 1908. Now, it hit out back of the beyond, but shock wave were measured as far away as Germany, UK, and reportedly Washington DC. Natives 65miles from the blast center were knocked off their feet, and the shock wave knocked down houses.
Chelyabinsk Meteor was also an Air-burst, and it caused damage to over 7200 buildings. The shock wave had a total kinetic energy before atmospheric impact estimated from infrasound and seismic measurements to be equivalent to the blast yield of 400–500 kilotons of TNT (about 1.4–1.8 PJ) range – 26 to 33 times as much energy as that released from the atomic bomb detonated at Hiroshima.
It's estimated that the Tunguska meteor was twice the size of the Chelyabinsk Meteor.
We don't need a "Extinction Level" meteor to be worried.