Who Says I am Rich? The IRS

If someone had told me as a kid in Louisiana that my husband and I would have a combined income of $250,000 a year in our late twenties, I would have been pie-eyed. It sounds like a crazy amount of money. But after taking into account taxes, debt and living expenses in New York City, we’re actually finding it difficult to meet our financial goals.

Why Our Taxes Are Nearly Unmanageable

Last year, we paid $100,000 in taxes, which is almost exactly 40% of what we make. Even though we also paid $22,000 in student loan payments (we have about $145,000 in combined loans for my husband’s law school and my grad school), we don’t qualify for deductions–if you make more than $150,000 filing jointly, you can’t deduct student loan interest.

We also don’t get a deduction for home ownership–because we can’t afford to buy one. We’ve been saving for three years, and after another three years of diligent budgeting, we hope to have about $100,000, which would be enough for a 20% down payment on a home in a New York suburb with decent schools–the average “starter” home in these areas is about $500,000–plus an extra $20,000 for closing costs and incidentals.

We’re in a weird place: We don’t have enough money to invest in a house or the stock market, which would get us tax exemptions. So we pay the full 40% of our salary in city**, state and federal taxes. People who are much wealthier can take advantage of tax loopholes, capital gains preferential tax rates and a larger mortgage deduction, so they end up paying only about 20% in taxes. For instance, in 2011, Barack Obama paid 20.5% in taxes. Mitt Romney paid 14% in taxes.

We find it ironic that we’d have to make more . . . in order to pay less.

If we’re being honest, it’s not only taxes that are killing us. Living in Manhattan is expensive—up to three times the cost of living in other cities—but I work for a private equities firm and my husband is in securities litigation. This city is the industry hub for both of our careers.

RELATED: Why I Don’t Regret Walking Out On My Job

We’ve discussed moving, but it’s unlikely that we would both be able to get jobs elsewhere. We rent a one-bedroom apartment near our offices in a neighborhood where they go for $3,000 a month. We could move to a slightly cheaper outer borough, but we’re both called into our offices at odd hours and we also work long days. So we pay for the convenience of living near work.

How Things Could Get Harder for Us

We budget constantly. As an accountant, I’m always reviewing our spending, and trying to find ways to cut back. We take the subway. We don’t buy name-brand clothes, and we don’t buy anything unless it’s on sale. We take only one fun trip a year and the most we’ve ever spent on that is $1,600.

My husband isn’t even putting money in his 401(k), so we can save more for a house. (I contribute to mine, but we have diverted all of our emergency fund to our house savings.) It’s something we argue about, but these are the choices we have to make.

Don’t get me wrong–our lives are good. We work very hard, and enjoy what we do, but I’m tired of people saying that we’re not paying our fair share. How much more are we supposed to pay?

Why the Tax Code Needs to Change

We both come from middle-class families and were taught that if you go to school and work hard, you can live the American dream: own a house, have a family. It’s really all we want. We don’t live—or long for—an extravagant lifestyle.

Look, I know it’s relative. I realize there are families raising three kids on $50,000 that are just trying to put food on the table. My husband and I are very thankful for what we have. And we don’t begrudge paying taxes. We even understand why people think we’re rich. Compared to many people, we are.

RELATED: 5 Things to Ask Before Accepting a Job

We just can’t figure out how we’re supposed to make the American dream work for us while giving away half of our income in taxes.

The tax code needs to change, and if it were up to me, I’d like to see the following:

Adding a cost of living factor. The tax code should have a “factor” that takes into account location-specific costs, like average home price, the price of an equivalent bag of groceries, the average price of a car and the average cost of gas in a region. Once taxes are calculated, the factor would be applied to achieve greater geographic tax parity.

Phasing out deductions and loopholes. If we lowered tax rates across the board, and cut the deductions and loopholes in the system (there are plenty of them to pick from!), we would put everyone on a more level playing field. I know it’s a touchy subject, but capital gains rates probably also need to be increased from the current 15%–even if it’s just a bump to 20%.

RELATED: Which Is Better–An IRA or a 401(k)?

Broadening the tax base. Right now, deductions and loopholes mean that many people don’t pay certain federal taxes. If we eliminated them as described above, more people would pay taxes that they owe. By no means do I think that families in dire circumstances should be asked to dole out money to the government. But if more families could help chip in a small portion of their earnings, it would work toward generating more revenue–and a little bit, spread across a large number of people, could go a long way.

RELATED: Everything You Need to Know About Taxes

Lowering the tax rates. I’d be fine paying in the 30% range. And if my husband and I did make it to a point where we were making above $500,000, reasonable tax increases (35%-39%) for this income would be acceptable.

There’s something really wrong with a system that considers us “rich” and not paying our fair share at 40%–but billionaires are only paying 20% or less.

Something is obviously broken.

We just hope it gets fixed soon.

*The author’s name has been changed to protect her privacy. Money isn’t always easy to talk about, and the author has shared details about her finances and her life. When commenting, please give her the respect due to a member of the LearnVest community.

** New York City is one of the few cities in the United States with city taxes.

In our “Money Mic” series, we hand over the podium to someone with a strong opinion on a financial topic. Today, one woman shares what it’s like to be disproportionately taxed based on her income–and how it’s holding her back.