It has nothing to do with endangered species. All native birds are protected, and you cannot disturb active nests without a federal (and possibly a state) permit. But you're right, there are exceptions for non-native birds including Domestic Pigeons, European Starlings and House Sparrows.
More...