He was awarded a Star on the Hollywood Walk of Fame for Recording at 1501 Vine Street in Hollywood, California.
Mathis has had a string of hits, all on Columbia records, stretching from the 1950s through the 1980s and beyond. Hit singles include "It's Not For Me to Say," "Chances Are," "Wonderful! Wonderful!," "A Certain Smile," "Misty," "Gina," "What Will Mary Say?," and "Too Much, Too Little, Too Late" (Duet with Denise Williams). Hit albums include "Wonderful! Wonderful!," "Open Fire, Two Guitars," "Johnny's Greatest Hits," "Heavenly," "Faithfully," "Warm," "Merry Christmas," and "Up, Up, and Away."
Just two years after his first recordings, his 1958 record album "Johnny's Greatest Hits" (Columbia Records) started the "Greatest Hits" trend for recording artists and record companies; every record company thereafter began to release "Greatest Hits" albums for their recording artists.
Jazz pianist and composer Vince Guaraldi, who composed the music for A Charlie Brown Christmas (1965) (TV) and many other "Charlie Brown" TV specials was the featured pianist and then-unknown talent on Mathis' demonstration recordings for Columbia Records in 1956.
Won a Lifetime Achievement Grammy Award on 23 February 2003.
As of 2004, he has had the longest stay of any popular artist with Columbia Records to date, having recorded for them almost exclusively since 1956.
Was a featured vocalist on the Grammy nominated (2004 awards) album "XXL" by Gordon Goodwin's Big Phat Band. Composer-arranger-pianist-saxophonist-band leader Gordon Goodwin has remained a longtime friend of Mathis and was once his former pianist.
An avid golfer, he hit his fifth hole-in-one at the 176 yard, 16th hole at the Riviera Country Club in April 2004.