"Hello, World!" was first used in the 1970s by Brian Kernighan in a Bell Labs internal memo to illustrate the syntax of the B programming language. It became a tradition in computer science as a simple, yet effective way for beginners to get acquainted with new programming languages. It's now a rite of passage for countless programmers.