I recently did an interview for an educational video about quantum physics. The filmmaker, who needed some cutaway shots to stitch the interview segments together, suggested a shot of me walking through the server room in my building. I complied, gazing with interest and concern as I strolled past the machines. But I felt very uncomfortable about the phoniness of this scene, because I had never been in the server room before and had no idea what I was looking at.
The experience reminded me, though, of the one time in my life when I felt like I was near the cutting edge of the digital revolution, nearly 20 years ago, as the World Wide Web was just emerging as the Next Big Thing.
A radical transformation in scientific communication had begun in 1991, when Paul Ginsparg launched what was then known as xxx.lanl.gov, and is now called arXiv.org. Back in those early days, a broadcast email would announce to the world the latest batch of papers received at the arXiv, and one could request a paper by sending an email with “get [paper number]” in the subject line. After receiving the TeX source file (not LaTeX back then) by return email, you could run “tex [filename]” from the command line of a dumb terminal, which would create the dvi file. Then you would say “dvips [filename]” to create the PostScript file, which you could print and recover from a room down the hall from your office. We all agreed that this system was wonderful compared to what had preceded it — preprints stuffed in Manila envelopes traveling by third class mail.
One day in spring of 1993, my colleague John Schwarz, having recently returned from a visit to Brown University, excitedly reported to me what he had witnessed there. At Brown, no one had to mail xxx.lanl.gov to request a preprint. Instead, the paper would miraculously appear on a computer monitor after just a push of a button on an optical mouse! John suggested we set up a similar system at Caltech, and I enthusiastically agreed. Grabbing the latest preprint and viewing it at your desk without even rising out of your chair? It seemed almost too good to be true!
Except, after a few minutes of sober reflection, I realized with a gulp that the responsibility for achieving this marvelous technological leap would fall upon me. Months of misery ensued, for though I had by that time somehow acquired an undeserved reputation as the “computer savvy” member of the Caltech particle theory faculty, I was actually way out of my depth.
I had about $40,000 to spend and needed to provide a GUI for about 30 users. Options were limited. After a lot of research, I decided to copy the configuration at Brown. The system administrator there was Paul Mende, a very good string theorist and a really great guy, who helped me immeasurably. (Later, Paul left physics to start a very successful hedge fund.)
The solution, which I copied from Paul, was to provide each user with a Sun 3/60 workstation (with 4 MB of RAM) and a 16″ Sony color monitor. By 1993, the Sun 3 was well past its prime, yet many used ones were still available for a reasonable price. Seth Robertson at Columbia had written a neat program called XKernel, which made the Sun 3 think it was an X terminal. The jewel of our system was a spanking new SPARCstation 10 from Sun Microsystems, which was pretty state-of-the-art and capable of serving all those X terminals. The Sun 3s devoted their paltry processing power and memory to displaying the graphics, while the SPARC 10 did everything else.
To avoid being a crybaby I won’t go into all the things that went wrong, many of which involved painful negotiations with sketchy vendors about worn-out used computing equipment, or getting those fussy Sun 3s to do what I wanted them to. My partner in suffering was Ming Lu, a graduate student in our group whose expertise I relied on, and who patiently put up with my many ignorant questions. A major hero of the story, aside from Paul Mende, was (then) Caltech undergrad Steven Fought, who knew everything about Unix and rescued me from disaster multiple times.
In the end there were rewards. On October 1, 1993, the particle theory group server www.theory.caltech.edu joined the burgeoning World Wide Web on planet earth. (The URL is still in use, but the pages have evolved a bit.) Ours may not have been the first publicly available web server on the Caltech campus, but it was among the first. I painstakingly wrote the html code for all the pages myself by hand, though I borrowed freely from the pages at Brown and elsewhere. The Mosaic web browser had just been released that year, setting the stage for the Internet boom. It was fun to feel like an early adopter as the technology surged.
Maybe the decisions I made were not the best possible ones (by a few years later there were much better options), but we got several years of decent use from those battered Sun 3/60s. The X Windows solution was appropriate for that era and the budget we had.
Looking back, though, what I remember most vividly are the days of despair and the sleepless nights when the whole project seemed doomed. In the end, I persevered by getting others like Paul Mende and Steven Fought to help me do what I couldn’t have done on my own.
Often, when one gets into trouble, the best way out is to ask other people for help. I have learned this lesson enough times, but still I forget and have to learn it over again. Why doesn’t it stick?