Dave Robinson, from Failsworth in Greater Manchester, took in the fox three months ago - after being contact on Facebook.
The 18-month-old fox was born into captivity, as were its parents, and has been reared by humans since birth.
With his wife Paula and son Harry, Dave had doted on the domesticated fox which they kept in a 12ft by 12ft enclosure, which was 6ft high.
Explaining his decision to take Scarlett the fox on, Mr Robinson said that he wanted to help house the fox because his family had plenty of room for her.
‘Over the last few months we grew really fond of her, she became like a family pet more than an animal we have rescued.
‘She was so comfortable around me and even took food from my hand.’
But now, the RSPCA have taken Scarlett off the family, in order for her to live at a sanctuary with other foxes.
The family have said they are ‘heartbroken’ by the move.
A spokesperson for the RSPCA said that the fox was given over voluntarily, and is now being cared for by a team of experts.
‘Foxes are wild animals, they are not domestic pets, and where possible the RSPCA believes they should be where they belong, in the wild.’