Jo was a famed player at Oldham, making 216 league appearances in a six year spell at the club. He notably had two spells with Everton too, one immediately after his failed attempt to break into the Newcastle United team in the 1905/1906 season.

He appeared three times for Scotland, scoring once, whilst his son (also Joe) played for Everton too.