The story of how the yellow first-down line in football telecasts was conceived in 1998 and almost immediately became an essential part of the viewing experience…

While the line looks simple on TV, the technology behind it is very complex. Sensors were placed on the three main game cameras (at midfield and the two 20 yard lines), capturing the pan, tilt and zoom movements of those cameras 30 times a second. A three-dimensional, virtual model of each field had to be constructed, with the exact measurements of the crown of the field (the center of the field is always higher, for drainage, than the sides and ends, but the precise levels vary in each venue). An exhaustive color palette had to be produced on the fly as the game progressed, so that the green pixels of grass the yellow line replaced would be exactly the “right greens” even as shadows crossed the field and changed the grass hues — an essential feature to assure replacing only the green blades of grass and not the green threads of a Packers or Eagles jersey.

The operation of the system was also extremely complex and had to integrate in a sophisticated and complete way with the TV broadcast. We were fortunate to have, in Jerry Gepner, the best person in the industry at pulling off this detailed integration and coordination, but it was an all or nothing proposition. Either the line would appear to stick like paint to the grass, and remain in the right spot throughout the play, or it would not go to air. Being a yard off, or having it appear on a player’s jersey, or shudder slightly — these were not options.

Our Sportvision road crew would have to arrive at the field three days before each game. Using a laser plane, they took measurements of the field and loaded them into the computers. They would run hundreds of yards of cables from the up cameras to the equipment in our truck, allowing our system to detect each camera movement so that, once inserted, we could keep the line in proper perspective as the play proceeded and the cameras panned and zoomed. They took swatches of grass at different times of day — both before and during the games — to enhance the color palette in each city (our crew came to love games in domed stadiums).

Read the whole story here.