Who invented the use of ''Red and Yellow'' cards in football games?

Team handball also use yellow and red cards - in addition the two minute penalty - I love handball!!

Player ccbkd, you can tell by the photo that it's not American football, can't you?