Born in DeLand, Florida, Watts studied violin and trumpet in his youth, later switching to sax. He gained musical training at Florida A&M, where he played in the school’s marching band with future saxophonist Cannonball Adderley. Hired to play with The Griffin Brothers after college, Watts began his professional career. During the 1950s, he would work with Lionel Hampton, Paul “Hucklebuck” Williams, Dinah Washington, Jerry Lee Lewis, Buddy Holly, Chuck Berry, the Everly Brothers, and others. He also appeared on American Bandstand with Johnny Mathis in 1957, and performed in the house band at a Harlem club owned by boxer Sugar Ray Robinson.