One of your opponents is kind of desperate. He is a nice guy, but he has not run a good campaign. He is taking increasingly bad advice from some stunted advisors.
You should continue putting your message out there. I think you are a great candidate. I have told you and your campaign more than once to break down your business career in a digestible manner so it is comprehensible to people. The presentation in your book is rather opaque.
People are concerned about your wealth. This goes back to your business career. Lay it out.
What have you done in the past to show that you are not just an agent for the rich? Show your bonafides to the public or at least to the Democratic base. Address the activist concerns.
Should you worry about the silly people being paid a fair bit of money to pursue a strategy of guilt by association against you? Should you be worried that one of your opponent's campaigns is populated by people who release the personal emails of a respected Virginia activist because he considered working for said opponent but ended up supporting you publicly? Should you be worried that an opponent's "strategist" (oooo tough guy fond of loyal attack dogs, be afraid, very afraid) is employing Harris Miller's '06 Senate primary strategy?
Mr. Miller is a nice man, but not many people know him.
You are the best candidate. You have not run for office before. Do a bit more to introduce yourself and you will win the primary going away.