You are right. It is the unrighteous who will be taken. However, if you are right about the catching up of the saints happening at the following coming of the lord Jesus then why does it say that those people will be left?:
"But as the days of Noe were, so shall also the coming of the Son of man be. For as in the days that were before the flood they were eating and drinking, marrying and giving in marriage, until the day that Noe entered into the ark, And knew not until the flood came, and took them all away; so shall also the coming of the Son of man be. Then shall two be in the field; the one shall be taken, and the other left. Two women shall be grinding at the mill; the one shall be taken, and the other left" (Mt.24:37-41).
How can they be "left" since, according to your view, they are going to be caught up to meet the Lord Jesus in the air at that coming?