Shorten, a fierce rival of Albanese for years before leaving politics last year, told the Inside Politics podcast that Albanese was growing in the job.