The Australian is known for his fiery temperament and fell foul of chair umpire Carlos Ramos after loudly asking a ballboy for a towel during his win Sunday over Italy's Marco Cecchinato.
Ramos ruled he had overstepped the mark with his demand but Krygios disagreed in an expletive-filled rant during a first set tiebreaker.
He drew attention to an incident involving world number one Novak Djokovic at the Rome Masters last week where the Serbian escaped sanction for an altercation with umpire Carlos Bernardes -- and accused Ramos of "unbelievable bias."
Still clearly seething, Kyrgios settled down to take the breaker 8-6 and it was the same margin in the second set tiebreak.
He eventually closed out a 7-6 7-6 6-4 victory on Court One at Roland Garros after two hours 21 minutes.
The 17th seed will next play Dutch lucky loser Igor Sisjling for a place in the last 32, the furthest he has reached in the clay court grand slam.
