"All I know is you're very good at taking a beating."
"That part I got from my dad."

Whether or not there's anything else underlying it, based on the language ("got from" as opposed to something like "learned from") and the flashback, I believe Matt meant that the toughness was an inherited trait.