The vile message was among several scrawled on the card and sent to the Richmond Park MP.
He posted an image of the sickening card on Twitter, writing: “Sweet Christmas message from a local Remain group… they’re definitely winning the arguments.
“Merry Christmas to you too.”
Some of the expletive-ridden messages included support for Sarah Olney, the Lib Dem MP he unseated at the election.
One person blasted: “Can we have Sarah Olney back please? You’re a total disgrace.”
Another raged: “You’re a nasty, racist man.”
And another simply wrote: “F*** you!”
Mr Goldsmith said he would not contact police about the hate mail because the abuse had become “the new norm” in politics.
The 42-year-old said he now only alerted the authorities if he received direct violent threats.
He said: “In the first two general elections I fought, this sort of thing never happened but politics locally has changed in the past two years.
“Almost all our posters in the election were defaced, many with swastikas, and lots of our campaigners were made to feel deeply uncomfortable.”
A Lib Dem spokesman said: “We utterly condemn this kind of abusive language that has no place in British politics.
“If Zac Goldsmith has any proof that these messages came from Liberal Democrat activists, we would advise him to make a formal complaint to the party which will be dealt with accordingly.”
Mr Goldsmith’s experience comes at a time when MPs on both sides of the House of Commons are facing an increase in abuse.
This week, Tory Brexit rebel Anna Soubry presented a dossier to the Speaker of threats she had received after inflicting Theresa May’s first Commons defeat.
Mrs May told the Commons this week: “There can never be a place for the threats of violence and intimidation against some members that we have seen in recent days.
“Our politics must be better than that.”
Home Secretary Amber Rudd said the Government would do more to tackle the “completely unacceptable torrents of abuse”.
And she vowed the actions of a “dark, unpleasant underbelly of our society” should “never be allowed to become the new normal”.