I was already a non-commercial pilot by the time I did my few years as a ramp worker and I didn’t see much overlap in the skillset between the two occupations. IOW, being a ramp worker would not give you much of a head start toward becoming a pilot. It would be interesting to see how many ramp workers also have an interest in aviation vs it’s just a job like any other.