When tax season comes around, the scammers also arrive in full force.

Recently, the Federal Trade Commission received thousands of reports regarding IRS imposters exploiting the phones, as per AJC.com.

Typically, these swindlers allegedly claim they are IRS officials and tell you that you still have taxes that you need to settle. They would also give threats should you not comply with their requests for payment. Some of these threats involve deportation, arrest, business shut down, or license cancellation.

What makes some of these scammers quite convincing is the fact that they know your social security number or, at least, part of it. Also, they can tweak things so that their caller ID makes it appear they really are calling from Washington, D.C. In fact, about 5,000 have fallen victim to this modus since October 2013, according to The Detroit News. The total involved reached $26.5 million, with immigrants and senior citizens pegged as the preferred targets as they are said to be easily intimidated.

"This scam has proven to be the largest of its kind that we have ever seen," revealed Treasury Department inspector general for tax administration J. Russell George. "It is critical that all taxpayers continue to be wary of unsolicited telephone calls and e-mails from individuals claiming to be IRS and Treasury employees."

"If someone unexpectedly calls claiming to be from the IRS and uses threatening language if you do not pay immediately, that is a sign that it is not the IRS calling, and your cue to hang up," he advised.

Meanwhile, Better Business Bureau's Manager of Communications Dottie Callina said that the IRS does not actually call taxpayers, much less threaten them.

If you do receive such a call, the Treasury Department recommended filling out an "IRS impersonation scam" form that can be secured from www.treasurytigta.gov. One can also call officials at (800) 366-4484.

If you suspect you do owe taxes, call the IRS instead at 800-829-1040 or check out its official website. While staff may answer questions regarding your taxes, they do not ask for credit card numbers over the telephone.

Generally, the IRS contacts taxpayers by mail about due taxes, not by phone, text, email, or even social media.

In October last year, the IRS issued an advisory against scammers in the wake of reported incidences of bogus calls about tax debts. However, despite these warnings, "people still readily give out personal data and fall into the traps of these scammers," according to CNBC's Jim Pavia.

WATCH: