Handicaps are offered by Lilly Quinn at the start of some nights after you reach level 5, they usually give you a negative effect in being able to fight the matches, but, they give you a monetary bonus to each fight you win. There is no negative consequences to declining a handicap.
The first night Lilly is introduced, she will always offer the boxers-only handicap. After that, the handicap offered is random.