Tax Controversy and Tax Defense: A Beginner’s Guide to IRS Audits, Tax Debt, Appeals, Tax Court, and Criminal Tax Risk
IRS audits, tax debt, or a surprise IRS notice can leave you unsure what your rights are and what happens next in a tax controversy. This guide explains tax defense basics—how cases move from audit to appeals to Tax Court or collections—and where criminal tax risk can start to matter. ReferU.AI can help you find an attorney with relevant experience in IRS audit defense and tax debt resolution for your situation.
An IRS letter can mean more than an audit. Tax controversy and tax defense cover a wide range of issues, from records requests and tax debt to appeals, Tax Court, and possible criminal tax risk. Most matters are civil, but some can become more serious when the IRS sees signs of fraud. The key point for beginners is that there is usually a process, and taxpayers have procedural rights along the way.
For more information, visit https://blog.referu.ai/legal-information-by-practice-area/tax-audits-defense.
#LegalAdvice #LegalHelp #TaxLaw #IRSAudits #TaxCourt
This post is for informational purposes only. ReferU.AI is not a law firm and does not provide legal advice.
Flat vector illustration of IRS audits explained with correspondence exams and field exams, showing records requests, proposed changes, and a taxpayer reviewing documents with a representative.
Tax Controversy and Tax Defense: A Beginner’s Guide to IRS Audits, Tax Debt, Appeals, Tax Court, and Criminal Tax Risk
Getting a letter from the IRS can feel like the floor just moved. For some people, it starts with a records request. For others, it starts with a balance-due notice, a bank levy, or questions about a past filing. In more serious situations, the concern shifts from civil tax problems to possible fraud or criminal exposure.
That larger landscape is often called tax controversy or tax defense. In general terms, it covers disputes with the IRS over examinations, proposed changes, unpaid tax, penalties, collection action, administrative appeals, Tax Court litigation, and in some cases criminal investigation.
If you’re new to this area, the good news is that there usually is a process. The IRS publishes rules, notices, and procedural rights for audits, appeals, collections, and hearings. Taxpayers also have protections under the Taxpayer Bill of Rights, including the right to be informed, the right to challenge the IRS’s position and be heard, and the right to appeal an IRS decision in an independent forum. The IRS also states that Appeals exists to resolve controversies “on a basis that is fair and impartial” to both the taxpayer and the government, while the U.S. Tax Court provides a prepayment forum for many deficiency disputes. IRS Publication 1, IRS collections overview, and the U.S. Tax Court’s petitioner guidance all reflect that structure.
In this post you’ll learn what tax controversy means, how an IRS matter often moves from audit to appeal to court or collections, where criminal tax risk can enter the picture, and why many people look for counsel with documented experience in highly similar matters.
💡
Scroll to the bottom for every post in this series.
What Is Tax Controversy?
Tax controversy is the broad category for disputes and defense work involving the IRS or, sometimes, state tax agencies. It can include:
audits and examinations
proposed tax adjustments
penalties and interest
unpaid assessed tax
liens and levies
payment plan or settlement requests
administrative appeals
Tax Court cases
refund disputes
civil fraud issues
criminal tax investigations
A controversy does not always mean criminal exposure. Most IRS matters are civil. But some civil cases can become more serious if the IRS sees signs of intentional concealment, false statements, fabricated records, nominee entities, offshore nonreporting, or payroll tax diversion. The IRS’s own Internal Revenue Manual discusses “badges of fraud” and the process for developing fraud indicators in examinations. See the IRS manual on recognizing and developing fraud.
What Usually Triggers A Tax Defense Problem?
Tax disputes often begin in ordinary ways. Common triggers include:
A Return Is Selected For Audit
The IRS conducts correspondence exams, office exams, and field exams. Some are narrow and document-based. Others are broader and can involve interviews, third-party records, and multiple tax years. The IRS publishes examination procedures and appeal rights in Publication 556 and related guidance.
A large number of tax controversies are really tax debt matters. The IRS reports that in fiscal year 2024 it collected $120.2 billion in unpaid assessments on returns filed with additional tax due, underscoring how common balance-due cases are in the system. See the IRS summary on collections, activities, penalties, and appeals.
Even when the underlying tax is not disputed, penalties and interest can turn a manageable problem into a much larger one. The IRS explains late-filing and late-payment penalties in Topic 653 materials and related publications, and some penalties continue to accrue until the issue is resolved. For some taxpayers, one of the first strategic questions is whether relief may be available through asking for penalty relief in the right circumstances.
Collection Action Begins
Once tax is assessed and remains unpaid, the IRS collection process can escalate to notices of federal tax lien, levies, wage garnishment, and account freezes. The IRS explains this framework in Publication 594, The IRS Collection Process. If you’re trying to understand the difference between those tools, this overview on liens, levies, frozen accounts, and wage garnishment can help.
A Filing Problem Gets More Serious
Some controversies start with amended returns, late foreign reporting, payroll tax problems, or joint return liability issues. Others start when a taxpayer realizes an old filing may be inaccurate and wonders whether correcting it will reduce risk or increase scrutiny. For example, this article on fixing past returns and thinking through audit issues covers one of the more common entry points into tax defense.
What Happens During An IRS Audit?
In beginner terms, an audit is the IRS asking: “Do the numbers on this return hold up?”
That sounds simple, but the stakes can vary a lot. A correspondence audit may focus on one deduction or credit. A field exam may involve books, bank records, interviews, and questions about multiple entities or years. If the IRS proposes changes, it may issue a report or formal notice explaining the additional tax, penalties, and interest it believes are due.
A few practical realities matter here:
the scope of the audit can expand
statements made early can shape the whole case
missing records can create separate problems from unfavorable records
certain facts can raise fraud concerns even before anyone says the word “fraud”
The IRS says taxpayers have the right to challenge proposed action and provide documentation, and the agency is expected to consider timely objections fairly. That appears in Publication 1 and related IRS guidance.
Not every disagreement goes straight to court. One of the most important parts of tax controversy practice is the administrative appeal.
The IRS states that its Independent Office of Appeals exists to resolve tax controversies without litigation and on a fair and impartial basis. See the IRS page on collections, activities, penalties, and appeals. The IRS also explains taxpayer appeal rights in Topic No. 151 and related publications.
Appeals often matters because it can create a structured setting to present:
legal arguments
factual corrections
additional records
hazards of litigation
settlement positions
collection alternatives in collection cases
That part of the process often feels less like an exam and more like dispute resolution. If you want a separate explanation of protests, conferences, and how Appeals evaluates settlement risk, here’s a guide to what usually happens in an IRS appeal.
When Does Tax Court Come Into The Picture?
The U.S. Tax Court is a federal court that hears many tax disputes, including deficiency cases, and one of its defining features is that in many cases a taxpayer can petition before paying the full disputed tax. The Tax Court’s own petitioner guidance says the court cannot extend the deadline for filing a petition in response to a notice of deficiency, which is one reason timing gets so much attention in tax defense work. See the court’s official page on starting a case.
Tax Court may become relevant when:
the IRS issues a notice of deficiency
an Appeals resolution does not happen
a Collection Due Process determination is challenged
a taxpayer wants judicial review in a qualifying case
The court also has a small tax case procedure for eligible disputes, though that route involves tradeoffs, including limits on appealability. The Tax Court explains those basics in its petitioner materials.
What If The Problem Is Tax Debt Rather Than An Audit?
A lot of people hear “tax defense” and picture an audit. In reality, many matters are about collections after assessment.
Once the IRS assesses tax and sends notices, the case can shift into a collections track. The IRS collection system may involve letters, automated notices, assignment to a revenue officer, lien filings, levies, and negotiations over how the debt might be resolved. The IRS’s Publication 594 describes that progression.
Depending on the facts, common options people explore include:
What Are Liens, Levies, And Collection Due Process Rights?
A federal tax lien is the government’s legal claim against property after assessment, notice, and failure to pay. A levy is the actual taking of property or rights to property, such as bank funds, wages, or certain payments. The IRS explains these tools in Publication 594.
When the IRS issues certain lien or levy notices, taxpayers may request a Collection Due Process (CDP) hearing. The IRS states that Letter 3172 generally provides 30 days to request a CDP hearing for a lien filing, and levy notices can carry similar hearing rights depending on the notice involved. See the IRS’s CDP FAQs and Publication 1660.
That hearing can be important because it may allow review of:
whether collection action is appropriate
possible alternatives like installment agreements or offers
Sometimes, yes. But the available path depends heavily on income, assets, filing compliance, the type of liability, and whether the IRS views the proposal as realistic.
Installment Agreements
Payment plans are one of the most common collection resolutions. They can help spread payment over time, but default risk and future compliance remain important parts of the picture. The IRS notes on its levy toolkit that if a taxpayer cannot pay in full, a payment plan may be available. See the IRS levy programs toolkit.
An offer in compromise is an agreement that settles qualifying tax liabilities for less than the full amount owed. The IRS Form 656 package and Internal Revenue Manual discuss eligibility, financial disclosure, initial payments in many cases, and exclusions. The current Form 656 remains the core document.
An important technical point: the IRS manual states that FBAR penalties are not accepted for compromise through the tax OIC process because they arise under Title 31, not ordinary Title 26 tax liability. See IRM 5.8.4.
In some cases, the tax may be owed but penalties are arguable. First-time relief and reasonable-cause arguments are common discussion points. This article on how penalty relief requests are usually evaluated goes deeper into that area.
What If The Tax Problem Involves A Spouse Or Ex-Spouse?
Joint returns create joint and several liability, which means the IRS can generally collect the full tax from either spouse unless relief applies. Taxpayers who believe only a spouse or former spouse should bear all or part of the liability may request innocent spouse relief using Form 8857. The IRS form page explains that the request can cover tax, penalties, and interest in qualifying circumstances.
In some controversies, innocent spouse issues overlap with audits, collections, or CDP hearings. If that’s part of the concern, this explainer on joint return liability and possible spouse-based relief may help frame the questions.
Why Are Payroll Tax Cases Treated So Seriously?
Employment tax cases often carry a different level of urgency because the IRS views withheld payroll taxes as trust fund money. Businesses may run into trouble after missed deposits, cash-flow strain, worker classification issues, or payroll provider failures.
The IRS warns that responsible persons can face the Trust Fund Recovery Penalty (TFRP), and states that the amount of that penalty is equal to the unpaid trust fund tax. See the IRS page on employment taxes and the TFRP and Publication 15.
When Does Civil Tax Trouble Become Criminal Tax Risk?
Most tax disputes stay civil. But criminal tax risk becomes a real concern when the government sees evidence suggesting intentional wrongdoing rather than mistake, negligence, or poor recordkeeping.
The IRS Criminal Investigation division is the law-enforcement arm of the IRS. In its FY 2025 annual report, IRS-CI said it identified $10.59 billion in financial crimes, with $4.5 billion linked to tax fraud, and reported increases in search warrants, prosecution referrals, and digital evidence seizures. See the IRS release on the FY 2025 IRS-CI annual report and the report itself here.
Potential warning signs can include:
false documents or altered books
nominee accounts or hidden ownership
unreported cash receipts
false payroll reporting
offshore concealment
misleading statements to the IRS
repeated filing of false returns
“ghost” preparer or scam-related filings
The IRS also continues to warn about false refund schemes, social media tax misinformation, and fabricated filing positions that can expose taxpayers to civil and criminal consequences. See the IRS pages on tax scams and fraud alerts and the Dirty Dozen tax scams for 2026.
Foreign account reporting is one of the areas where tax controversy and penalty exposure can become unusually severe. The IRS notes that a U.S. person generally must file an FBAR if the person has a financial interest in, or authority over, foreign financial accounts and the aggregate value exceeds $10,000 at any time during the calendar year. See IRM 8.11.6 on FBAR penalties.
FBAR penalties arise under Title 31, not the Internal Revenue Code, and they can be harsh. The National Taxpayer Advocate recently described the maximum FBAR penalty as among the harshest civil penalties the government can impose. See the 2025 Purple Book.
Not always. An amended return can be an important compliance step, but it is not a universal shield. In some situations it helps correct a genuine mistake. In others, timing, audit posture, and the facts behind the correction can matter a great deal.
The IRS says amended returns can be tracked through “Where’s My Amended Return,” and the instructions to Form 1040-X state that processing generally takes 8 to 12 weeks, though in some cases it can take up to 16 weeks. See the Instructions for Form 1040-X.
Tax controversy is broad, but the issues are often highly specific. An audit defense involving cash-intensive income is not the same as an offshore disclosure issue. A payroll tax case with possible TFRP exposure is not the same as a Tax Court deficiency case. A collections matter involving levies and CDP rights is not the same as a criminal tax investigation.
That’s why many people focus less on generic labels and more on demonstrable experience in highly similar matters:
audit defense vs. collection defense
civil fraud indicators vs. criminal referral risk
Tax Court petitions vs. Appeals negotiation
payroll tax cases vs. individual income tax disputes
offshore reporting exposure vs. domestic filing corrections
spouse relief claims vs. business tax liabilities
In practical terms, an attorney’s fit may depend on whether their documented experience lines up with the exact stage and risk profile of the matter.
Final Thoughts For Beginners
Tax controversy is the umbrella term for disagreements and defense work involving the IRS. It can begin with an audit, a notice of tax due, a lien, a levy, a payroll tax issue, a spouse-related liability question, an offshore reporting problem, or facts that raise fraud concerns. From there, the path may move through Appeals, collection negotiations, Tax Court, or in rare but serious cases, criminal investigation.
For many taxpayers, the hardest part is not knowing which kind of problem they really have. Is it an audit issue, a collections issue, a filing correction issue, a payroll issue, or potential criminal exposure? An attorney with relevant, documented experience may help sort out where the case actually sits and what process is most likely to control the next step.
Visit ReferU.AI to get matched with an attorney who has demonstrable experience in cases like yours — for free.