Honestly, if you saw a guy driving a different Ferrari every day of the month in Palm Beach Gardens, you’d probably think he was some tech genius or a hedge fund legend. You wouldn't immediately think, "Hey, that's the guy who handles my small business's tax withholdings."
But that was the reality for Matthew Brown.
For years, Matt Brown operated a company called Elite Payroll (officially Matthew Brown & Associates Inc.). On the surface, it was a boring, reliable utility for small businesses in South Florida—the kind of place that makes sure the IRS gets its cut so you don't have to worry about it. Except, as federal investigators eventually discovered, Brown was allegedly using those tax dollars to build one of the most absurd personal car collections in the country.
The scale of the Elite Payroll scheme is honestly hard to wrap your head around. We’re talking about $20 million in unpaid employment taxes.
How the Elite Payroll Scheme Actually Worked
Most people assume tax fraud is some complex, high-level accounting wizardry involving offshore shells and cryptic code. Sometimes it is. But in the case of Matt Brown and Elite Payroll, the mechanism was surprisingly, almost insultingly, simple.
Elite Payroll acted as a "middleman" for small businesses across Palm Beach, St. Lucie, and Martin counties. These businesses would send Elite the full amount of their employees' gross pay, which included the money meant for Social Security, Medicare, and federal income tax. Elite was then supposed to turn around and send that tax money to the IRS.
Instead, Brown basically just kept a huge chunk of it.
👉 See also: Facebook Business Support Chat: Why You Can't Find It and How to Actually Get Help
He’d charge the clients the full amount—say, $200,000 for a quarter's worth of taxes—but then file a false return with the IRS claiming the client only owed something like $30,000. He’d pay the $30k, pocket the $170k, and hope nobody noticed the math didn't add up.
It worked for a long time. Between 2014 and 2022, this cycle repeated over and over. You have to wonder how it stayed under the radar for eight years. Usually, the IRS is like a bloodhound when it comes to payroll taxes because that money "belongs" to the employees, not the business. But for nearly a decade, the Ferraris kept arriving at Brown’s doorstep.
The 27 Ferraris and the Luxury Life
It wasn't just the cars. Although, let’s be real, the cars are the part everyone remembers. We are talking about 27 Ferraris. That’s not a hobby; that’s a fleet. He also had Porsches, Rolls Royces, a Valhalla 55 Sport Yacht, and a Falcon 50 Aircraft.
Basically, if it moved fast and cost more than a suburban house, Matt Brown probably bought it using money that was supposed to fund someone's future Social Security check.
It’s a classic case of "conspicuous consumption." Most white-collar criminals try to look modest while they’re skimming. Brown did the opposite. He lived in a multi-million dollar home in Palm Beach Gardens and lived like a king while his clients—mostly small business owners just trying to stay afloat—had no idea their tax accounts were actually hemorrhaging.
The Legal Fallout and Sentencing
The clock finally ran out in early 2025.
✨ Don't miss: Why 444 West Lake Chicago Actually Changed the Riverfront Skyline
In April 2025, U.S. District Judge Aileen M. Cannon sentenced Matthew Brown to 50 months in prison. That’s a little over four years. For some, that feels light given the $20 million price tag, but the financial penalties are where the real sting is. Brown was ordered to pay **$22,401,585 in restitution**.
He also got hit with a $200,000 fine and two years of supervised release after he gets out of the federal pen.
One thing that’s really interesting about this case is the specific charge: filing a false tax return and failing to pay over employment taxes. In the eyes of the law, this isn't just "stealing from the government." It’s a violation of trust. When a business owner hands over payroll taxes to a provider like Elite Payroll, they are technically placing those funds in a "trust." Stealing them is a "Trust Fund Recovery Penalty" nightmare waiting to happen.
Why Small Businesses Got Burned
If you’re a business owner, this story is terrifying. You do everything right. You hire a professional. You pay your dues. And then you find out your "expert" was actually just buying Italian sports cars with your money.
The big takeaway here is that the IRS generally holds the employer responsible for the taxes, even if a third-party payroll company steals the money. While Brown was ordered to pay restitution, that doesn't always mean the money is there to be paid back immediately. Many of those businesses likely had to deal with years of audits and "Where's the money?" letters from the IRS because of Elite Payroll's fraudulent filings.
It’s a massive mess. It highlights a huge vulnerability in the "Employee Leasing" and PEO (Professional Employer Organization) industry. If the person at the top isn't ethical, the whole system collapses.
🔗 Read more: Panamanian Balboa to US Dollar Explained: Why Panama Doesn’t Use Its Own Paper Money
Actionable Steps to Protect Your Business
Look, you don't want to be the person who finds out their payroll provider is a fraudster through a Department of Justice press release. If you use a third-party service, you've got to be proactive.
First, verify your tax deposits directly with the IRS. You don't have to take your payroll provider's word for it. You can log into the Electronic Federal Tax Payment System (EFTPS) yourself. If you see that your provider said they paid $50,000 but the IRS only shows $5,000, you have a problem. Do this every single quarter. No exceptions.
Second, check for bonding and insurance. A reputable payroll company should have "Errors and Omissions" insurance and a "Fidelity Bond." This protects you if they go bust or, you know, decide to start a Ferrari collection with your withholdings.
Third, watch out for the "too good to be true" pricing. If a company like Elite Payroll offers rates that are significantly lower than ADP, Paychex, or Gusto, ask yourself how they're making money. In Brown's case, the "profit" wasn't coming from the service fees; it was coming from the tax skim.
Lastly, pay attention to the company's physical presence. Elite Payroll was a local Florida firm. While local is often good, you need to ensure they have a solid reputation and aren't just a "one-man show" operating out of a flashy office.
The story of Matt Brown is a wild one, but for the business owners involved, it was a nightmare that likely cost them their reputations and their peace of mind. The Ferraris are gone, the yacht is probably sold, and Brown is in a cell, but the lesson remains: in the world of payroll, trust but verify. Always.
Check your EFTPS account today. It takes ten minutes and could save you twenty million dollars.