Extending Interactivity

In the early 1960s, interactive computing began to spread out from the few tender saplings nurtured at Lincoln Lab and MIT – spread in two different senses. First, the computers themselves sprouted tendrils, that reached out across buildings, campuses, and towns to allow users to interact at a distance, and to allow many users to do so at the same time. These new time-sharing systems blossomed, accidentally, into platforms for the first virtual, on-line societies. Second, the seeds of interactivity spread across the country, taking root in California. One man was responsible for sowing those first transplants, a psychologist named J.C.R. Licklider.

Joseph Appleseed

Joseph Carl Robnett Licklider — known to friends as “Lick” — specialized in psychoacoustics, a field that bridged the gap between imaginary states of mind and the measurable physiology and physics of sound. We met him briefly before, as a consultant in the 1950s FCC Hush-a-Phone hearings. He had honed his skills at the Psycho-Acoustics Laboratory at Harvard during the war, devising techniques to improve the audibility of radio transmissions inside noisy bombers.

J.C.R. Licklider, a.k.a, ‘Lick’

Like so many American scientists of his generation, he found ways to continue to meld his interests with military needs after the war, but not because he had a special interest in weaponry or national defense. The only major civilian sources of money for scientific research were two private institutes founded by the industrial titans of the turn of the century: the Rockefeller Foundation and Carnegie Institute. The National Institutes of Health had only a few million dollars to spend, and the National Science Foundation was created only in 1950, with a similarly modest budget. To get funding for interesting science and technology in the 1950s, your best bet was the Department of Defense.

So, in 1950, Licklider joined an acoustics lab at MIT directed by the physicists Leo Beranek and Richard Bolt, and funded almost entirely by the U.S. Navy.1 Once there, his expertise on the interface between the human senses and electronic equipment made him a natural early recruit to MIT’s new air defense project. As part of the Project Charles study group, tasked with figuring out how to implement the Valley Committee air defense report, Licklider pushed for the inclusion of human factors research, and got himself appointed co-director of radar-display development for Lincoln Laboratory.

There, at some point in the mid-1950s, he crossed paths with Wes Clark and the TX-2, and instantly caught the interactive computing bug. He was captivated by the idea of being in total control of a powerful machine that would instantly solve any problem addressed to it. He began to develop an argument for “man-computer symbiosis,” a partnership between human and computer that would amplify humankind’s intellectual power, in the same way that industrial machines had amplified its physical power. He noted that some 85% of his own work time2

…was devoted mainly to activities that were essentially clerical or mechanical: searching, calculating, plotting, transforming, determining the logical or dynamic consequences of a set of assumptions or hypotheses, preparing the way for a decision or an insight. Moreover, my choices of what to attempt and what not to attempt were determined to an embarrassingly great extent by considerations of clerical feasibility, not intellectual capability.  …the operations that fill most of the time allegedly devoted to technical thinking are operations that can be performed more effectively be machines than by men.

The overall concept did not stray too far from Vannevar Bush’s Memex, an intellectual amplifier that he sketched in his 1945 “As We May Think,” though Bush’s mix of electro-mechanical and electronic components gave way to a pure electronic digital computer as the central intellectual engine. That computer would use its immense speed to shoulder all the brute-force clerical work involved in any scientific or technical project. People would be unshackled from that drudgery, freed to spend all of their attention on forming hypotheses, building models, and setting goals for the computer to carry out. Such a partnership would provide tremendous benefit to researchers such as himself, of course, but also to national defense, by helping American scientists stay ahead of the Soviets.

Vannevar Bush’s Memex, an early concept for an automated information retrieval system to augment intellectual power

Soon after this Damascene encounter, Lick brought his new devotion to interactive computing to a new position, at a consulting firm run by his old colleagues, Bolt and Beranek. As a sideline from their academic physics work, the two had dabbled with consulting projects for years; reviewing, for instance, the acoustics of a movie house in Hoboken, New Jersey. Landing the acoustics analysis for the new United Nations building in New York City, however, brought them a slew of additional work, and so they decided to leave MIT and consult full-time. Having acquired a third partner in the meantime, architect Robert Newman, they now went by Bolt, Beranek and Newman (BBN). By 1957, having grown into a mid-sized firm with dozens of employees, Beranek felt that they risked saturating the market for acoustics work. He wanted to extend their expertise beyond sound to the full range of interaction between humans and the built environment, from concert halls to automobiles, across all the senses.

And, so, naturally, he sought out his old colleague Licklider, and recruited him on generous terms as the new vice-president of psychoacoustics. But Beranek had not reckoned with Licklider’s wild enthusiasm for interactive computing. Rather than a psycho-acoustics expert, he had acquired… not a computer expert, exactly, but a computer evangelist, eager to bring others to the light. Within the year, he had convinced Beranek to lay out tens of thousands of dollars buy a computer, a meager little thing called the LGP-30, made by a defense contractor called Librascope. Having no engineering expertise himself, he brought on another SAGE veteran, Edward Fredkin, to help configure the machine. Despite the fact that the computer did little but distract Licklider from his real work while he tried to learn to program it, he convinced the partners to put down still more money3 to buy a much better computer a year-and-half later: DEC’s brand new PDP-1. Licklider sold B, B, and N on the idea that digital computing was the future, and that somehow, sometime, their investment in building expertise in the field would pay off.

Shortly thereafter, Licklider, almost by accident, found himself in the perfect position for spreading the culture of interactivity across the country, as head of a new government computing office.

ARPA

In the Cold War, every action brought it’s reaction. Just as the first Soviet atomic bomb had spurred the creation of SAGE, so did the first Soviet satellite in orbit, launched in October 1957, trigger a flurry of responses from the American government. All the more so because, while the Soviets had trailed the U.S. by four years in exploding a fission weapon, in rocketry it seemed to have leaped ahead, beating the Americans to orbit (by about four months, as it turned out).

One of the responses to Sputnik to create, in early 1958, an Advanced Research Projects Agency (ARPA) within the Defense department. In contrast to the more modest sums available for civilian federal science funding, ARPA was given an initial budget of $520 million, three times the budget of the National Science Foundation, which had itself been tripled in size in response to Sputnik.

Though given a broad charter to work on any advanced projects deemed fit by the Secretary of Defense, it was initially intended to focus on rocketry and space – a vigorous answer to Sputnik. By reporting directly to the Secretary of Defense, ARPA was to rise above debilitating and counterproductive inter-service rivalries and develop a unified, rational plan for the American space program. But in fact, all of its projects in that field were soon stripped away by rival claimants4: the Air Force had no intention of giving up control over military rocketry, and the National Aeronautics and Space Act, signed in July 1958, created a new civilian agency to take over all non-weaponized ventures into space. Having been created, ARPA nonetheless found reasons to survive, acquiring major research projects in ballistic missile defense and nuclear test detection. But it also became a general workshop for pet projects that the various armed services wanted investigated. Intended to be the dog, it had instead become the tail.

The first foray by ARPA into computing was, in a sense, busy work. In 1961, the Air Force had two idle assets on its hands and needed something for them to do. As the first SAGE direction centers neared deployment, the Air Force had brought on, RAND Corporation, based in Santa Monica, California, to train personnel and prepare the twenty-odd computerized air defense centers with operational software. RAND spun off a whole new entity, System Development Corporation (SDC), just to handle this task. SDC’s newly acquired software expertise was a valuable resource for the Air Force, but SAGE was winding down and they were running out of work to do. The Air Force’s second idle asset was a (very expensive) surplus AN/FSQ-32 computer which had been requisitioned from IBM for SAGE but turned out to be unneeded. The Department of Defense solved both problems by assigning ARPA new research task of command-and-control, to be inaugurated with a $6 million grant to SDC to study command-and-control problems using the Q-32.

ARPA soon decided to regularized this research program as part of a new information processing research office. Around the same time, it had also received a new assignment to create a program in behavioral science. For reasons that are now obscure, ARPA leadership decided to recruit J.C.R. Licklider to oversee both programs. The idea may have come from Gene Fubini, director of research for the Department of Defense, who would have known Lick from his time working on SAGE.

Like Beranek, Jack Ruina, then head of ARPA, had no idea what he was in for when he brought Lick in for an interview. He thought he was getting a behavioral science expert with a dash of computing knowledge on the side. Instead he got the full force of the man-computer symbiosis vision. Computerized command-and-control required interactive computing, Licklider argued, and thus the primary thrust of ARPA’s command-and-control research program should be to push forward the cutting edge of interactive computing. And to Lick that meant time-sharing.

Time-Sharing

Time-sharing systems originated with the same basic principle as Wes Clark’s TX series: computers should be convenient for the user. But unlike Clark, the proponents of time-sharing believed that a single computer could not be used efficiently by a single person. A researcher might sit for several minutes pondering the output of a program before making a slight change and re-running it. During that interval the computer would have nothing to do, its great power going to waste, at great expense. Even the hundred-millisecond intervals between keystrokes loomed as vast gulfs of wasted time for the computer, in which thousands of computations could have been performed.

All of this processing power need not go to waste, if it could instead be shared among many users. By slicing up the computer’s attention so that it could serve each user in turn, the computer designer could have his cake and eat it – provide the illusion of an interactive computer completely at the user’s command, without wasting most of the capacity of a very expensive piece of hardware.

The concept was latent in SAGE itself, which could serve dozens of different operators simultaneously, each monitoring his own sub-sector of airspace. After meeting Clark, Licklider immediately saw the potential to combine the shared user base of SAGE with the interactive freedom of the TX-0 and TX-2 into a potent new mix, and this formed the basis of his advocacy for man-computer symbiosis, which he proposed to the Department of Defense in a 1957 paper entitled “The Truly Sage System, or Toward Man-Machine System for Thinking.” In that paper described a computer system for scientists very similar in structure to SAGE, with a light-gun input, and “simultaneous (rapid time-sharing) use of the machine computing and storage facilities by many people.”

Licklider, though, lacked the engineering chops to actually design or build such a system. He managed to learn the basics of programming at BBN, but that was as far as his skills went. The first person to reduce time-sharing theory to practice was John McCarthy, an MIT mathematician. McCarthy wanted constant access to a computer in order to craft his tools and models for manipulating mathematical logic, the first steps, he believed, towards artificial intelligence. He put together a prototype 1959, consisting  an interactive module bolted onto the university’s batch-processing IBM 704 computer. Ironically, this first “time-sharing” installation had only one interactive console, a single Flexowriter teleprinter.

By the early 1960s, however, the MIT engineering faculty as a whole had become convinced that they should invest wholesale in interactive computing. Every student and faculty member with an interest in programming who got their hands on it, got hooked. Batch-processing made very efficient use of the computer’s time, but could be hugely wasteful of the researcher’s – the average turnaround time for a job on the 704 was over a day.

A university-wide committee formed to study the long-term solution for the growing demand for computing resources at MIT, and time-sharing advocates predominated. Clark fought a fierce rearguard action, arguing that the move to interactivity should not mean time-sharing. As a practical matter, he argued that time-sharing meant sacrificing interactive video displays and real-time interaction, crucial features of the projects he had been working on with the MIT biophysics lab. But more fundamentally, Clark seemed to have a deep philosophical resistance to the idea of sharing his workspace. As late as 1990, he refused to connect his computer into the Internet, and stated outright that networks “are a mistake” and “don’t work.”5

He and his disciples formed a sub-sub-culture, a tiny offshoot within the already eccentric academic culture of interactive computing. But their arguments in favor of small, un-shared computer workstations did not find purchase with their colleagues.6 Given the cost of even the smallest individual computer at the time, such an approach seemed economically infeasible to the other engineering faculty. Moreover, most assumed at that time that computers – the intellectual power plants of a dawning information age – would benefit from economies of scale, in the same way that physical power plants did. In the spring of 1961, the final report of the long-range study committee sanctioned large-scale time-sharing systems as the way of the future at MIT.

By that time, Fernando Corbató, known to colleagues as “Corby,” was already working to expand the scope of McCarthy’s little experiment. A physicist by training, he learned about computers while working on Whirlwind in 1951, while a grad student at MIT. 7 After completing his doctorate he became an administrator for MIT’s newly formed Computation Center, built around the IBM 704. Corbató and his team (initially Marge Merwin and Bob Daley, two of the best programmers in the Center) called their time-sharing system CTSS, for Compatible Time-Sharing System – so-called because it could run simultaneously with the 704’s normal batch-processing operations, seamlessly snatching computer cycles for users as needed. Without this compatibility the project would indeed have been impossible, because Corby had no funding for a new computer on which to build a time-sharing system, and shutting down the existing batch-processing operation was not an option.

At the end of 1961, CTSS could support four terminals. By 1963, MIT hosted two instances of CTSS on 3.5 million dollar transistorized IBM 7094 machines, with roughly ten times the memory capacity and processing power of their 704 predecessor. The system’s supervisor software passed through the active users in a roughly round-robin fashion8, servicing each for a fraction of a second before moving on to the next. Users could store programs and data in their own private, password-protected area in the computer’s disk storage, for later use.9

Corbató in his trademark bow-tie, in the IBM 7094 computer room

Each computer could serve roughly twenty terminals. That was enough to not only support a couple of small terminal rooms, but also to begin spreading access to the computer out across Cambridge. Corby and other key individuals had office terminals, and, at some point, MIT began providing home terminals to technical personnel so that they could do system maintenance at odd hours without having to come on-campus. All of these early terminals consisted of a typewriter with some modifications to support reading from and writing to a telephone line, plus a continuous feed of perforated paper instead of individual sheets. Modems connected the terminals via the telephone system to a private exchange on the MIT campus, via which they could reach the CTSS computer. The computer thus extended its sensory apparatus over the telephone, with signals that went from digital to analog and back. This was the first stage in the integration of computers into the telecommunications network. The mixed state of AT&T with respect to regulation facilitated this integration. The core network was still regulated, and required to provide private lines at fixed rates, bu a series of FCC decisions had eroded its control over the periphery, and thus it had very little say over what was attached to those lines. MIT needed no permission for its terminals.

A typical mid-1960s computer terminal, the IBM 2741.

The desired goal of Licklider, McCarthy, and Corbató had been to increase the availability of computing power to individual researchers. They had chosen the means, time-sharing, for purely economic reasons – no one could imagine buying and maintaining a computer for every single researcher at MIT. But this choice had produced unintended side-effects, which could never have been realized within Clark’s “one man, one machine” paradigm. A common file area and cross-links between users accounts allowed users to share, collaborate, and build on each other’s work. In 1965, Noel Morris and Tom Van Vleck facilitated this collaboration and communication, with a MAIL program that allowed users to exchange messages. When a user sent a message, the program appended it to a special mailbox file in the recipient’s file area. If a user’s mailbox file had any contents, the LOGIN program would indicate it with the message “YOU HAVE MAIL BOX.” The contents of the machine itself were becoming an expression of the community of users, and this social aspect of time-sharing became just as prized at MIT as the initial premise of one-on-one interactive use.

Seeds Planted

Lick, having accepted ARPA’s offer and left BBN to take command of ARPA’s new Information Processing Techniques Office (IPTO) in 1962, quickly set about doing exactly what he had promised – focusing ARPA’s computing research efforts on spreading and improving time-sharing hardware and software. He bypassed the normal process of waiting for research proposals to arrive on his desk, to be authorized or rejected, instead going into the field himself and soliciting the research proposals he wanted to authorize.

His first step was to reconfigure the existing SDC command-and-control research project in Santa Monica. Word came down to SDC from Lick’s office that they should curtail their work on command-and-control research, and instead focus their efforts on turning their surplus SAGE computer into a time-sharing system. According to Lick, the basic substrate of time-shared man-machine interaction must come first, and command-and-control would follow. That this prioritization aligned with his own philosophical interests was a happy coincidence. Jules Schwartz, a SAGE veteran, architected the new time-sharing system. Like its contemporary, CTSS, it became a virtual social space, including among its commands a DIAL function for direct text messaging between on-line users, as can be seen in this example exchange between John Jones and a user identified by the number 9:

DIAL 9 THIS IS JOHN JONES, I NEED 20K IN ORDER TO LOAD MY PROG
FROM 9 WE CAN GET YOU ON IN 5 MINUTES.
FROM 9 GO AHEAD AND LOAD

Next, to provide funding for the further development of time-sharing at MIT, Licklider found Robert Fano to lead his flagship effort: Project MAC, which lasted into the 1970s.10 Though the designers initially hoped that the new MAC system would support 200 simultaneous users or more, they had not reckoned with the ever-escalating sophistication and complexity of user software, which easily consumed all improvements in hardware speed and efficiency. When launched to MIT in 1969, the system could support about 60 users on its two central processing units (CPUs), roughly the same number per CPU as CTSS. However, the total community of users was much larger than the maximum active load at any given time, with 408 registered users in June 1970.11

Project MAC’s Multics system software also embodied several major advances in design, some of which are still considered advanced features in today’s operating systems: a hierarchical file system with folders that could contain other folders in a tree structure; a hardware-enforced distinction between execution in user and system mode; dynamically linked programs that could pull in software modules as needed during execution; and the ability to add or remove CPUs, memory banks, or disks without bringing down the system. Ken Thompson and Dennis Ritchie, programmers on the Multics project, later created Unix (a pun on the name of its predecessor) to bring some of these concepts to simpler, smaller-scale computer systems.

Lick planted his final seed in Berkeley, at the University of California. Project Genie12, launched in 1963, begat the Berkeley Timesharing System, a smaller-scale, more commercially-oriented complement to the grandiose Project MAC. Though nominally overseen by certain Cal faculty members, it was graduate student Mel Pirtle who really led the time-sharing work, aided by other students such as Chuck Thacker, Peter Deutsch, and Butler Lampson. Some of them had already caught the interactive computing bug in Cambridge before arriving at Berkeley. Deutsch, son of an MIT physics professor and the prototypical computer nerd, implemented the Lisp programming language on a Digital PDP-1 as a teenager before arriving at Cal as an undergrad. Lampson, for his part, had programmed on a PDP-1 at the Cambridge Electron Accelerator as a Harvard student. Pirtle and his team built their time-sharing system on a SDS 930, made by Scientific Data Systems, a new computer company founded in 1961 in Santa Monica.13

SDS back-integrated the Berkeley software into a new product, the SDS 940. It became one of the most widely used time-sharing systems of the late 1960s. Tymshare and Comshare, companies that commercialized time-sharing by selling remote computer services to others, bought dozens of SDS 940s for their customers to use. Pirtle and his team also decided to try their hand in the commercial market, founding Berkeley Computer Corporation (BCC) in 1968, but BCC fell into bankruptcy in the 1969-1970 recession. Much of Pirtle’s team ended up at Xerox’s new Palo Alto Research Center (PARC), where Thacker, Deutsch and Lampson contributed to landmark projects such as the Alto personal workstation, local networking, and the laser printer.

Mel Pirtle, center, with the Berkeley Timesharing System

Of course, not every time-sharing project of the early 1960s sprung from Licklider’s purse. News of what was happening at MIT and Lincoln Labs spread through the technical literature, conferences, academic friendships, and personnel transfers. Through these channels other, windblown, seeds took root. At the University of Illinois, administrators of the Control Systems Lab pivoted out of their reliance on classified defense work by developing the PLATO interactive education system. Clifford Shaw created the JOHNNIAC Open Shop System (JOSS), which the Air Force funded in order to improve the ability of RAND employees to perform quick numerical analyses.14 The Dartmouth Time-Sharing System had a direct connection to events at nearby MIT, but was otherwise the most exceptional, being a purely civilian-funded effort sponsored by the National Science Foundation, on the basis that experience with computers would be a necessary part of a general education for the next generation American leaders.

By the mid-1960s, time-sharing had not taken over the computing ecosystem. Far from it. Traditional batch-processing shops predominated in sales and use, especially outside university campuses. But it had found a niche.

Taylor’s Office

In the summer of 1964, some two years after arriving at ARPA, Licklider moved on again, this time to IBM’s research center north of New York City. For IBM, shocked to have lost the Project MAC contract to rival computer maker General Electric after years of good relations with MIT, Lick would provide some in-house expertise in a trend that seemed to be passing it by. For Lick, the new job offered an opportunity to convert the ultimate bastion of conventional batch computing to the new gospel of interactivity.15

He was succeeded as head of IPTO by Ivan Sutherland, a young computer graphics expert, who was succeeded in turn, in 1966, by Robert Taylor. Licklider’s own 1960 “Man-Machine Symbiosis” paper had made Taylor a convert to interactive computing, and he came to ARPA at Lick’s recommendation, after a stint running a computer research program at NASA. His personality and background formed him in Licklider’s mold, rather than Sutherland’s. A psychologist by training and no technical expert in computer engineering, he compensated with enthusiasm and clear-sighted leadership.

One day in his office, shortly after taking over the IPTO, a thought dawned on Taylor. There he sat, with three different terminals, through which he could connect to the three ARPA-funded time-sharing systems in Cambridge, Berkeley, and Santa Monica. Yet they did not actually connect to one other – he had to intervene physically, with his own mind and body, to transfer information from one to the other. 16

The seeds sewn by Licklider had borne fruit. He had created a social community of IPTO grantees, that spanned many computing sites, each with its own small society of technical experts, gathered around the hearth of a time-sharing computer. The time had come, Taylor thought, to network those sites together. Their individual social and technical structures, once connected, would form a kind of super-organism, whose rhizomes would span the entire continent, reproducing the social benefits of time-sharing on the next higher scale. With that thought began the technical and political struggle that would give birth to ARPANET.

[previous] [next]

Further Reading

Richard J. Barber Associates, The Advanced Research Projects Agency, 1958-1974 (1975)

Katie Hafner and Matthew Lyon, Where Wizards Stay Up Late: The Origins of the Internet (1996)

Severo M. Ornstein, Computing in the Middle Ages: A View From the Trenches, 1955-1983 (2002)

M. Mitchell Waldrop, The Dream Machine: J.C.R. Licklider and the Revolution That Made Computing Personal (2001)

The Era of Fragmentation, Part 4: The Anarchists

Between roughly 1975 and 1995, access to computers accelerated much more quickly than access to computer networks. First in the United States, and then in other wealthy countries, computers became commonplace in the homes of the affluent, and nearly ubiquitous in institutions of higher education. But if users of those computers wanted to connect their machines together – to exchange email, download software, or find a community where they could discuss their favorite hobby, they had few options. Home users could connect to services like CompuServe. But, until the introduction of flat monthly fees in the late 1980s, they charged by the hour at rates relatively few could afford. Some university students and faculty could connect to a packet-switched computer network, but many more could not. By 1981, only about 280 computers had access to ARPANET. CSNET and BITNET would eventually connect hundreds more, but they only got started in the early 1980s. At that time the U.S. counted more than 3,000 institutions of higher education, virtually all of which would have had multiple computers, ranging from large mainframes to small workstations. Both communities, home hobbyists and those academics who were excluded from the big networks, turned to the same technological solution to connect to one another. They hacked the plain-old telephone system, the Bell network, into a kind of telegraph, carrying digital messages instead of voices, and relaying messages from computer to computer across the country and the world. These were among the earliest peer-to-peer computer networks. Unlike CompuServe and other such centralized systems, onto which home computers latched to drink down information like so many nursing calves, information spread through these networks like ripples on a pond, starting from anywhere and ending up everywhere. Yet they still became rife with disputes over politics and power. In the late 1990s, as the Internet erupted into popular view, many claimed that it would flatten social and economic relations. By enabling anyone to connect with anyone, the middle men and bureaucrats who had dominated our lives would find themselves cut out of the action. A new era of direct democracy and open markets would dawn, where everyone had an equal voice and equal access. Such prophets might have hesitated had they reflected on what happened on Usenet and Fidonet in the 1980s. Be its technical substructure ever so flat, every computer network is embedded within a community of human users. And human societies, no matter how one kneads and stretches, always seem to keep their lumps. Usenet In the summer of 1979, Tom Truscott was living the dream life for a young computer nerd. A grad student in computer science at Duke University with an interest in computer chess, he landed an internship at Bell Labs’ New Jersey headquarters, where he got to rub elbows with the creators of Unix, the latest craze to sweep the world of academic computing. The origins of Unix, like those of the Internet itself, lay in the shadow of American telecommunications policy. Ken Thompson and Dennis Ritchie of Bell Labs decided in the late 1960s to build a leaner, much pared-down version of the massive MIT Multics system to which they had contributed as software developers. The new operating system quickly proved a hit within the labs, popular for its combination of low overhead (allowing it to run on even inexpensive machines) and high flexibility. However, AT&T could do little to profit from their success. A 1956 agreement with the Justice Department required AT&T to license non-telephone technologies to all comers at a reasonable rate, and to stay out of all business sectors other than supplying common carrier communications. So AT&T began to license Unix to universities for use in academic settings on very generous terms. These early licensees, who were granted access to the source code, began building and selling their own Unix variants, most notably the Berkeley Software Distribution (BSD) Unix created at the the University of California’s flagship campus. The new operating system quickly swept academia. Unlike other popular operating systems, such as the DEC TENEX / TOPS-20, it could run on hardware from a variety of vendors, many of them offering very low-cost machines. And Berkeley distributed the software for only a nominal fee, in addition to the modest licensing fee from AT&T.1 Truscott felt that he sat at the root of all things, therefore, when he got to spend the summer as Ken Thompson’s intern, playing a few morning rounds of volleyball before starting work at midday, sharing a pizza dinner with his idols, and working late into the night slinging code on Unix and the C programming language. He did not want to give up the connection to that world when his internship ended, and so as soon as he returned to Duke in the fall, he figured out how to connect the computer science department’s Unix-equipped PDP 11/70 back to the mothership in Murray Hill, using a program written by one of his erstwhile colleagues, Mike Lesk. It was called uucp – Unix to Unix copy – and it was one of a suite of “uu” programs new to the just-released Unix Version 7, which allowed one Unix system to connect to another over a modem. Specifically, uucp allowed one to copy files back and forth between the two connected computers, which allowed Truscott to exchange email with Thompson and Ritchie. Undated photo of Tom Truscott It was Truscott’s fellow grad student, Jim Ellis, who had installed the new Version 7 on the Duke computer, but even as the new upgrade gave with one hand, it took away with the other. The news program that was distributed by the Unix users’ group, USENIX, which would broadcast news items to all users of a given Unix computer system, no longer worked on the new operating ssytem. Truscott and Ellis decided they would replace it with their own 7-compatible news program, with more advanced features, and return their improved software back to the community for a little bit of prestige. At this same time, Truscott was also using uucp to connect with a Unix machine at the University of North Carolina ten miles to the southwest in Chapel Hill, and talking to a grad student there named Steve Bellovin.2 Bellovin had also started building his own news program, which notably included the concept of topic-based newsgroups, to which one could subscribe, rather than only having a single broadcast channel for all news. Bellovin, Truscot and Ellis decided to combine their efforts and build a networked news system with newsgroups, that would use uucp to share news between sites. They intended to distributed provide Unix-related news for USENIX members, so they called their system Usenet.  Duke would serve as the central clearinghouse at first, using its auto-dialer and uucp to connect to each other site on the network at regular intervals, in order to pick up it local news updates and deposit updates from its peers. Bellovin wrote the initial code, but it used shell scripts that operated very slowly, so Stephen Daniel, another Duke grad student, rewrote the program in C. Daniel’s version became know as A News. Ellis promoted the program at the January 1980 Usenix conference in Boulder, Colorado, and gave away all eighty copies of the software that he had brought with him. By the next Usenix conference that summer, the organizers had added A News to the general software package that they distributed to all attendees. The creators described the system, cheekily, as a “poor man’s ARPANET.” Though one may not be accustomed to thinking of Duke as underprivileged, it did not have the clout in the world of computer science necessary at the time to get a connection to that premiere American computer network. But access to Usenet required no one’s permission, only a Unix system, a modem, and the ability to pay the phone bills for regular news transfers, requirements that virtually any institution of higher education could meet by the early 1980s. Private companies also joined up with Usenet, and helped to facilitate the spread of the network. Digital Equipment Corporation (DEC) agreed to act as an intermediary between Duke and UC Berkeley, footing the long-distance telephone bills for inter-coastal data transfer. This allowed Berkeley to become a second, west-coast hub for Usenet, connecting up UC San Francisco, UC San Diego, and others, including Sytek, an early LAN business. The connection to Berkeley, an ARPANET site, also enabled cross-talk between ARPANET and Usenet (after a second re-write by Mark Horton and Matt Glickman to create B News). ARPANET sites began picking up Usenet content and vice versa, though ARPA rules technically forbid interconnection with other networks. The network grew rapidly, from fifteen sites carrying ten posts a day in in 1980, to 600 sites and 120 posts in 1983, and 5000 sites and 1000 posts in 1987.3 Its creators had originally conceived Usenet as a way to connect the Unix user community and discuss Unix developments, and to that end they created two groups, net.general and net.v7bugs (the latter for discussing problems with the latest version of Unix). However they left the system entirely open for expansion. Anyone was free to create a new group under “net”, and users very quickly added non-technical topics such as net.jokes. Just as one was free to send whatever one chose, recipients could also ignore whatever groups they chose, e.g. a system could join Usenet and request data only for net.v7bugs, ignoring the rest of the content. Quite unlike the carefully planned ARPANET, Usenet self-organized, and grew in an anarchic way overseen by no central authority. Yet out of this superficially democratic medium a hierarchical order quickly emerged, with a certain subset of highly-connected, high-traffic sites recognized as the “backbone” of the system. This process developed fairly naturally. Because each transfer of data from one site to the next incurred a communications delay, each new site joining the network had a strong incentive to link itself to an already highly-connected node, to minimize the number of hops required for their messages to span the network. The backbone sites were a mix of educational and corporate sites, usually led by one headstrong individual willing to take on the thankless tasks involved in administering all the activity crossing their computer. Gary Murakami at Bell Labs’ Indian Hills lab in Illinois, for example, or Gene Spafford at Georgia Tech. The most visible exercise of the power held by this backbone administrators came in 1987, when they pushed through a re-organization of the newsgroup namespace into seven top-level buckets. comp, for example, for computer-related topics, and rec for recreational topics. Sub-topics continued to be organized hierarchically underneath the “big seven”, such as comp.lang.c for discussion of the C programming language, and rec.games.board for conversations about boardgaming. A group of anti-authoritarians, who saw this change as a coup by the “Backbone Cabal,” created their own splinter hierarchy rooted at alt, with its own parallel backbone. It included topics that were considered out-of-bounds for the big seven, such as sex and recreational drugs (e.g. alt.sex.pictures)4, as well as quirky groups that simply rubbed the backbone admins the wrong way (e.g. alt.gourmand; the admins preferred the anodyne rec.food.recipes). Despite these controversies, by the late 1980s, Usenet had become the place for the computer cognoscenti to find trans-national communities of like-minded individuals. In 1991 alone, Tim Berners-Lee announced the creation of the World Wide Web on alt.hypertext; Linus Torvalds solicited comp.os.minix for feedback on his new pet project, Linux; and Peter Adkison, due to a post on rec.games.design about his game company, connected with Richard Garfield, a collaboration that would lead to the creation of the card game Magic: The Gathering. FidoNet But even as the poor man’s ARPANET spread across the globe, microcomputer hobbyists,  with far fewer resources than even the smallest of colleges, were still largely cut off from the experience of electronic communication. Unix, a low-cost, bare-bones option by the standards of academic computing, was out of reach for hobbyists with 8-bit microprocessors, running an operating system called CP/M that barely did anything beyond managing the disk drive. But they soon began their own shoe-string experiments in low-cost peer-to-peer networking, starting with something called bulletin boards. Given the simplicity of the idea and the number of computer hobbyists in the wild at the time, it seems probable that the computer bulletin board was invented independently several times. But tradition gives precedence to the creation of Ward Christensen and Randy Suess of Chicago, launched during the great blizzard of 1978.  Christensen and Suess were both computer hobbyists in their early thirties, and members of their local computer club. For some time they had been considering creating a server where computer club members could upload news articles, using the modem file transfer software that Christensen had written for CP/M – the hobbyist equivalent of uucp. The blizzard, which kept them housebound for several days, gave them the impetus to actually get started on the project, with Christensen focusing on the software and Suess on the hardware. In particular, Suess devised a circuit that automatically rebooted the computer into the BBS software each time it detected an incoming caller, a necessary hack to ensure the system was in a good state to receive the call, given the flaky state of hobby hardware and software at the time. They called their invention CBBS, for Computerized Bulletin Board System, but most later system operators (or sysops) would drop the C and call their service a BBS.5 They published the details of what they had built in a popular hobby magazine, Byte, and a slew of imitators soon followed. Another new piece of technology, the Hayes Modem, fertilized this flourishing BBS scene. Dennis Hayes was another computer hobbyist, who wanted to use a modem with his new machine, but the existing commercial offerings fell into two categories: devices aimed at business customers that were too expensive for hobbyists, and acoustically-coupled modems. To connect a call on an acoustically-coupled modem you first had to dial or answer the phone manually, and then place the handset onto the modem so they could communicate. There was no way to automatically start a call or answer one. So, in 1977, Hayes designed, built, and sold his own 300 bit-per-second modem that would slot into the interior of a hobby computer. Suess and Christensen used one of these early-model Hayes modems in their CBBS. Hayes’ real breakthrough product, though, was the 1981 Smartmodem, which sat in its own external housing with its own built-in microprocessor and connected to the computer through its serial port. It sold for $299, well within reach of hobbyists who habitually spent a few thousand dollars on their home computer setups. The 300 baud Hayes Smartmodem One of those hobbyists, Tom Jennings, set in motion what became the Usenet of BBSes. A programmer for Phoenix Software in San Francisco, Jennings decided in late 1983 to write his own BBS software, not for CP/M, but for the latest and greatest microcomputer operating system, Microsoft DOS. He called it Fido, after a computer he had used at his work, so-named for its mongrel-like assortment of parts. John Madill, a salesman at ComputerLand in Baltimore, learned about Fido and called all the way across the country to ask Jennings for help in tweaking Fido to make it run on his DEC Rainbow 100 microcomputer. The two began a cross-country collaboration on the software, joined by another Rainbow enthusiast, Ben Baker of St. Louis. All three racked up substantial long-distance phone bills as they logged into one another’s machines for late-night BBS chats. With all of this cross-BBS chatter, an idea began to buzz forward from the back of Jennings’ mind, that he could create a network of BBSes that would exchange messages late at night, when long-distance rates were low. The idea was not new. Many hobbyists had imagined that BBSes could route messages in this way, all the way back to Christensen and Suess’ Byte article. But they generally had assumed that for the scheme to work, you would need very high BBS density and complex routing rules, to ensure that all the calls remained local, and thus toll-free, even when relaying messages from coast to coast. But Jennings did some back-of-the-envelope math and realized that, given increasing modem speeds (now up to 1200 bits per second for hobby modems) and falling long-distance costs, no such cleverness was necessary. Even with substantial message traffic, you could pass text between systems for a few bucks per night. Tom Jennings in 2002 (still from the BBS documentary) So he added a new program to live alongside Fido. Between one to two o’clock in the morning, Fido would shut down and FidoNet would start up. It would check Fido’s outgoing messages against a file called the node list. Each outgoing message had a node number, and each entry in the list represented a network node – a Fido BBS – and provided the phone number for that node number. If there were pending outgoing messages, FidoNet would dial up each of the corresponding BBSes on the node list and transfer the messages over to the FidoNet program waiting on the other side. Suddenly Madill, Jennings and Baker could collaborate easily and cheaply, though at the cost of higher latency – they wouldn’t receive any messages sent during the day until the late night transfer began. Formerly, hobbyists rarely connected with others outside their immediate area, where they could make toll-free calls to their local BBS. But if that BBS connected into FidoNet, users could suddenly exchange email with others all across the country. And so the scheme proved immensely popular, and the number of FidoNet nodes grew rapidly, to over 200 within a year. Jennings’ personal curation of the node list thus became less and less manageable. So during the first “FidoCon” in St. Louis, Jennings and Baker met in the living room of Ken Kaplan, another DEC Rainbow fan who would take an increasingly important role in the leadership of FidoNet. They came up with a new design that divided North America into nets, each consisting of many nodes. Within each net, one administrative node would take on the responsibility of  managing its local nodelist, accepting inbound traffic to its net, and forwarding those messages to the correct local node. Above the layer of nets were zones, which covered an entire continent. The system still maintained one global nodelist with the phone numbers of every FidoNet computer in the world, so any node could theoretically directly dial any other to deliver messages. This new architecture allowed the system to continue to grow, reaching almost 1,000 nodes by 1986 and just over 5,000 by 1989. Each of these nodes (itself a BBS) likely averaged 100 or so active users. The two most popular applications were the basic email service that Jennings had built into FidoNet and Echomail, created by Jeff Rush, a BBS sysop in Dallas. Functionally equivalent to Usenet newsgroups, Echomail allowed the thousands of users of FidoNet to carry out public discussions on a variety of topics. Echoes, the term for individual groups, had mononyms rather than the hierarchical names of Usenet, ranging from AD&D to MILHISTORY to ZYMURGY (home beer brewing). Jennings, philosophically speaking, inclined to anarchy, and wanted to build a neutral platform governed only by its technical standards6: I said to the users that they could do anything they wanted …I’ve maintained that attitude for eight years now, and I have never had problems running BBSs. It’s the fascist control freaks who have the troubles. I think if you make it clear that the callers are doing the policing–even to put it in those terms disgusts me–if the callers are determining the content, they can provide the feedback to the assholes. Just as with Usenet, however, the hierarchical structure of FidoNet made it possible for some sysops to exert more power than others, and rumors swirled of a powerful cabal (this time headquartered in St. Louis), seeking to take control of the system from the people. In particular, many feared that Kaplan or others around him would try to take the system commercial and start charging access to FidoNet. Of particular suspicion was the International FidoNet Association (IFNA), a non-profit that Kaplan had founded to help defray some of the costs of administering the system (especially the long-distance telephone charges). In 1989 those suspicions seemed to be realized when a group of IFNA leaders pushed through a referendum to make every FidoNet sysop a member of IFNA and turn it into the official governing body of the net, responsible for its rules and regulations. The measure failed, and IFNA was dissolved instead. Of course, the absence of any symbolic governing body did not eliminate the realities of power; the regional nodelist administrators instead enacted policy on an ad hoc basis. The Shadow of Internet From the late 1980s onward, FidoNet and Usenet gradually fell under the looming shadow of the Internet. By the second half of that same decade, they had been fully assimilated by it. Usenet became entangled within the webs of the Internet through the creation of NNTP – Network News Transfer Protocol – in early 1986. Conceived by a pair of University of California students (one in San Diego and the other in Berkeley), NNTP allowed TCP/IP network hosts on the Internet to create Usenet-compatible news servers. Within a few years, the majority of Usenet traffic flowed across such links, rather than uucp connections over the plain-old telephone network. The independent uucp network gradually fell into disuse, and Usenet became just another application atop TCP/IP transport. The immense flexibility of the Internet’s layered architecture made it easy to absorb a single-application network in this way.  Although by the early 1990s, several dozen gateways between FidoNet and Internet existed, allowing the two networks to exchange messages, FidoNet was not a single application, and so its traffic did not migrate onto the internet in the same way as Usenet. Instead, as people outside academia began looking for Internet access for the first time in the second half of the 1990s, BBSes gradually found themselves either absorbed into the Internet or reduced to irrelevance. Commercial BBSes generally fell into the first category. These mini-CompuServes offered BBS access for a monthly fee to thousands of users, and had multiple modems for accepting simultaneous incoming connections. As commercial access to the Internet became possible, these businesses connected their BBS to the nearest Internet network and began offering access to their customers as part of a subscription package. With more and more sites and services becoming available on the burgeoning World Wide Web, fewer and fewer users signed on to the BBS per se, and thus these commercial BBSes gradually became pure internet service providers, or ISPs. Most of the small-time hobbyist BBSes, on the other hand, became ghost towns, as users wanting to tap into the Internet flocked to their local ISPs, as well as to larger, nationally known outfits such as America Online. That’s all very well, but how did the Internet become so dominant in the first place? How did an obscure academic system, spreading gradually across elite universities for years while systems like Minitel, CompuServe and Usenet were bringing millions of users online, suddenly explode into the foreground, enveloping like kudzu all that had come before it? How did the Internet become the force that brought the era of fragmentation to an end? [Previous] [Next] Further Reading / Watching Ronda Hauben and Michael Hauben, Netizens: On the History and Impact of Usenet and the Internet, (online 1994, print 1997) Howard Rheingold, The Virtual Community (1993) Peter H. Salus, Casting the Net (1995) Jason Scott, BBS: The Documentary (2005)

Read more
The Pursuit of Efficiency and the Science of Steam

On April 19th, 1866, Alfred Holt, a Liverpudlian engineer who had apprenticed on the Liverpool & Manchester railroad before taking up steamship design in the 1850s, launched a singular ship that he dubbed the Agamemnon. As the third soon of a prosperous banker, cotton broker, and insurer, he had access to far more personal capital to launch this new enterprise than the typical engineer. This was a lucky thing for him, because the typical investor of the time considered his ambition—to enter the China tea trade on the basis of steam power—foolhardy. A typical oceangoing steamship used five pounds of coal per horsepower per hour and could not compete with sail over such long distances: they would either have to fill most of their potential cargo space with coal or make repeated, costly stops to refuel.[1] A contemporary photograph of Holt’s SS Agamemnon. Yet, in the end, Holt pulled off his gamble. He benefited from good timing (perhaps a mix of luck and foresight): the opening of the Suez Canal in 1869 give steamships a tremendous leg up in trade between Europe to the Indian and Pacific Oceans. But in designing ships dainty enough in their coal consumption to pay their way to the Pacific, he also benefited from the late convergence of two complementary developments that had each begun in the early 1800s but did not intersect until the 1850s. First was a series of incremental, empirical improvements to steam engine design: After the massive leap forward from Newcomen to Watt, further increases in steam engine efficiency would be less dramatic. Simultaneously, a theory of heat gradually developed that could explain what made engines more or less efficient, and thus point engineers in the most fruitful direction. Double-Cylinder Engines Boulton & Watt erected most of its early pumping engines in Cornwall. Trevithick developed his high-pressure “puffer” there. So, it is only fitting that the last major architectural innovation in piston steam engine design—featuring an entirely new structural component—was Cornish, too. In that region, an ample supply of British engineering talent met an always-eager demand for efficient engines. The ever-deeper mines for extracting metal ore needed ever more pumping power, despite significantly higher coal prices than the coal-rich North. Joseph Hornblower, born in the 1690s, was one of the first engineers to build Newcomen engines for the mines of Cornwall in the 1720s. Sixty years later, his grandson Jonathan built the first known double-cylinder engine (later called a compound engine). Cornwall’s homegrown natural philosopher, Davies Giddy (later Gilbert), served in the same office he later served for Richard Trevithick, as Hornblower’s scientific advisor. In principle, the idea was quite simple: instead of immediately condensing the remaining steam after the expansion cycle of the piston, the still-warm steam was fed into another cylinder to let it do still more work. However, this added friction, complexity, and cost to the machine. In practice, therefore, Hornblower’s attempted improvement provide no more efficient than a traditional Watt engine.[2] Hornblower double-cylinder engine from Robert Thurston, A History of the Growth of the Steam-Engine, p. 136. A generation later, however, another Cornishman took up the idea and carried it further. Arthur Woolf, like many eighteenth-century engineers, got his start as a millwright, but by 1797 was working for the firm of Jabez Carter Hornblower (brother to Jonathan), at a brewery in London, erecting a steam engine. He continued to serve as engineer for the brewery for a decade afterward, and witnessed the operation of Trevithick’s steam carriage in the city in 1803. Woolf realized that he could combine the double-cylinder engine of his former employer’s brother with Trevithick’s truly high-pressure engines (operating at forty pounds per-square-inch or more). The higher-pressure steam, still quite hot after expanding in the first cylinder, would be able to do more work in the second cylinder rather than simply “puffing” out into the atmosphere. Both Watt and Trevithick had (from opposite points-of-view) seen low- and high-pressure steam as rivals, but in Woolf’s machine they complemented one another.[3] But, as Hornblower had already learned, the path did not always run straight and easy from idea to execution. Woolf led himself astray with an entirely unsound theoretical model for the inner workings of his engine: he believed that steam at twenty pounds per square inch (psi) would expand to twenty times its volume before equaling the pressure of the atmosphere, steam at thirty psi would expand thirty times, and so on ad infinitum. This turned out to be a substantially exaggerated expectation, and led him to begin with a drastically undersized high-pressure cylinder, which let off far too little steam to effectively work its low-pressure mate. Rather than leading him to doubt his theory, the failure of this engine led him into a wild goose chase for a non-existent leak in his pistons.[4] Woolf’s double-cylinder engine, unlike Hornblower’s, did at last succeed, after years of trial and error, in achieving better efficiency than a Watt engine. But because it was more expensive to build (and thus buy), and more complex to operate, it found favor only in markets without easy access to other, cheaper options. One such example was France, to which Woolf’s erstwhile partner Humphrey Edwards, decamped in 1815: there he sold at least fifteen engines and licensed twenty-five more to a French mining company.  Woolf meanwhile returned to Cornwall in 1811, where he found the advantages of his double-cylinder engine soon surpassed by the incremental improvements made by other local engineers to the Boulton and Watt design. He abandoned it after 1824 and built single-cylinder engines until 1833, when he retired to the island of Guernsey.[5] Meanwhile, steam engine builders carried on with tweaks to get yet one more increment of efficiency out of their engines. They extracted advantages from adjustments to the regulatory machinery of the engine: elements like “release mechanisms,” “dashpots,” and “wrist plates.” The Corliss engine, designed by George Corliss in 1849, became an icon of American industrial design after his company produced a gargantuan specimen to power the 1876 Centennial Exhibition in Philadelphia. Mighty as it was, however, it did not represent a great leap forward in steam engine architecture. Corliss’ design drew its relative advantages over prior engines from a clever combination of previous innovations in the valves that allowed steam to enter and leave the cylinder, and especially in the valve gear that controlled them.[6] Corliss engine valve gear from H.W. Dickinson, A Short History of the Steam Engine, p. 140. In the meantime, the double-cylinder engine, having failed to prove itself in the 1810s and 1820s, lay dormant. It would be restored to life decades later, by the engineers most desperate to eke as much power as possible out of every ounce of coal: the designers of ocean steamships. But to facilitate the consummation of that match, a solid theory of the steam engine was wanted, one that would dispel, once and for all, the confusions like Woolf’s that continued to trip up engineers’ efforts at improvement. Measuring Power The lack of a sound theoretical basis for steam power is evident in the fitful history of cylinder “lagging,” or insulation. Steam engineers borrowed the term lag (a barrel stave) from coopers, because they often insulated early steam boilers with such timbers, held in place with metal straps (this is evident in images of early locomotives like Rocket, with their distinctive wooden cladding). A contemporary lithograph of Robert Stephenson’s engine Northumbrian. Note the wooden lagging on the boiler. As early as 1769, Watt had recognized the value of insulating not just the boiler, but also the working cylinder of the engine (emphasis mine): My method of lessening the consumption of steam, and consequently fuel, in fire-engines, consists of the following principles:—First, That vessel in which the powers of steam are to be employed to work the engine, which is called the cylinder in common fire-engines, and which I call the steam-vessel, must, during the whole time the engine is at work, be kept as hot as the steam that enters it; first by enclosing it in a case of wood, or any other materials that transmit heat slowly; secondly, by surrounding it with steam or other heated bodies; and, thirdly, by suffering neither water nor any other substance colder than the steam to enter or touch it during that time.[7] Yet, despite Watt’s imprimatur, steam engine builders lagged their cylinders sporadically throughout the first half of the nineteenth century; it was a matter of whim, not principle.[8] In this era, engineers tended to think of the steam engine as analogous to its predecessor, the water wheel. Steam replaced liquid water as the mechanical working fluid, but just as water drove the wheel by pushing on its vanes, in their minds steam performed work by expanding and pushing on the piston. A typical description of the time stated that “[t]he force of the steam-engine is derived from the property of water to expand itself, in an amazing degree, when heated above the temperature at which it becomes steam.”[9] Engineers knew that the cylinder ought to be kept hot to prevent condensation of the steam inside, but within this framework it was not obvious that it ought to be kept as hot as possible. Watt, emphasizing the contrast between the hot cylinder and the cool condenser, had drawn attention to the role of heat in the engine, but the introduction and success of high-pressure engines with no condenser, where the primary factor seemed to be the expansive force of steam, muddled matters once again. The gradual development of a new, more robust theory began with a practical problem: how to measure the amount of power an engine generates. This became a particularly pressing problem for Boulton & Watt in the late eighteenth century, as they expanded from the traditional business of pumping engines into the new market of driving cotton mills. The traditional way of measuring the output of a steam engine, in terms of “duty” (the pounds of water lifted by one foot per bushel of coal burned) had gradually been supplemented with the concept of “power,” typically expressed in horsepower: pounds lifted over a given distance, but over a given period of time rather than with a given amount of fuel. Thomas Savery had begun to grope towards the concept in his 1702 book on the virtues of his steam pump, The Miner’s Friend: I have only this to urge, that water, in its fall from any determinate height, has simply a force answerable and equal to the force that raises it. So that an engine which will raise as much water as two horses working together at one time in such a work can do, and for which there must be constantly kept ten or twelve horses for doing the same, then, I say, such an engine will do the work or labour of ten or twelve horses…[10] Note here that Savery proposes to measure the muscular equivalent of the engine not in terms of the output of just the pair of horses running the machinery, but in terms of the total stock of horses that a mine owner would require to maintain the same power over a long period of time. This model of horsepower in terms of economic equivalency did not stick, however, and by the late eighteenth century horsepower became fixed to Watt’s figure of 33,000 foot-pounds per minute. Yet this remained a measure of power best suited to pumping work: if a mine needed to raise 20,000 pounds of water per hour from a 200-foot-deep shaft, one could readily calculate the engine horsepower required. Cotton spinning machinery—which varied in size, function, and design—did not lend itself to such simple arithmetic. In order to properly size engines to mills, Boulton & Watt needed some way measure the horsepower produced by an engine while driving various combinations of machinery. From the beginning, Watt had attached gauges to his engines to measure the pressure inside the engine, by connecting a small indicator cylinder to the main engine cylinder so that steam could flow between them. The level of pressure in the indicator could serve as a proxy for power output. But to actually capture the data was a maddening exercise, because the pressure varied constantly as the piston worked up and down. A means of capturing this continuous data came from a long-time Watt employee, John Southern. He had joined the company as a draftsman in 1782, and despite a predilection for music that the strait-laced Watt found suspicious, quickly became indispensable.[11] Southern’s indicator, as envisioned by Terrell Croft, Steam-Engine Principles and Practice, p. 40. In 1796, Southern devised a simple device to solve the power measurement problem. He attached a piece of paper above the indicator, rigged so that it would move back and forth as the main piston operated. Then he attached a pencil to the tip of the pressure gauge. As the pressure went up and down, so would the pencil, while the paper moved left and right beneath it with the cycle of the engine. The result, when running smoothly, would be a closed shape, which Southern called an indicator diagram, and the averagepressure during the operation of the engine could be computed from the average distance between the top and bottom lines of that shape, which would in turn be proportional to the power. By calibrating the diagramwhile an engine was pumping water, where the power output was well-defined, Boulton & Watt could then determine the power produced by the same engine while operating a given set of mill machinery.[12] An ideal indicator diagram from Terrell Croft, Steam-Engine Principles and Practice, p.60. Thermodynamics Engineers now had a tool at hand for diagnosing the internals of a running engine. That tool, in turn, provided the seed for the birth of the science of thermodynamics, which began as the science of the steam engine. The first great leap in that direction was made by Sadi Carnot. Carnot’s story carries more than a whiff of the tragic. Though later honored as a founding father of thermodynamics, he achieved no recognition in his lifetime, and died of cholera as a still-young man in 1832. His father Lazare was an accomplished engineer and a major political figure in revolutionary France, but what we know of the son comes almost entirely from a fifteen-page biography sketched decades after the fact by his younger brother Hippolyte, which begins, pathetically, with the statement that: “the life of Sadi Carnot was not marked by any notable event…”[13] Carnot as an École student in 1813. In fact, Carnot’s short life was remarkably eventful. He grew up in Napoleon’s court, attended the elite engineering school École polytechnique at age 16, and was at the Chateau Vincennes during the 1814 assault on Paris that ended Napoleon’s first reign. He returned to Paris as a staff lieutenant in 1819, filling his free time with his passions: music, art, and scientific studies. There, in 1824, he produced his seminal work, Réflexions sur la puissance motrice du feu (Reflections on the Motive Power of Fire). In it he endeavored to explain how heat produces motion. I will allow him to elaborate in his own words: Every one knows that heat can produce motion. That it possesses vast motive-power no one can doubt, in these days when the steam-engine is everywhere so well known. To heat also are due the vast movements which take place on the earth. It causes the agitations of the atmosphere, the ascension of clouds, the fall of rain and of meteors, the currents of water which channel the surface of the globe, and of which man has thus far employed but a small portion.[14] As we have seen, the tendency of engineers to conceive of steam hydraulically, as a fluid that generated work through pressure much like water in a water wheel, had engendered some confusion about how to build and operate an engine most efficiently. Ironically, Carnot moved the understanding of the steam engine forward by taking the analogy of a steam engine to a water wheel even more seriously than his contemporaries. However, for him the key power-generating agent was not the pressure of steam, but the fall of heat. Just as a waterwheel required a head from which water descended by gravity to turn the wheel, so the steam engine required a reservoir of high heat, which then flowed down to a cold body and thereby did work. For Carnot this fall of heat in a steam engine was quite literal: it consisted of an imponderable fluid called caloric, that drained out from the hot body to the cool one: The production of motion in steam-engines is always accompanied by a circumstance on which we should fix our attention. This circumstance is the re-establishing of equilibrium in the caloric; that is, its passage from a body in which the temperature is more or less elevated, to another in which it is lower. …The steam is here only a means of transporting the caloric.[15] This caloric theory of heat as a substance still predominated in Carnot’s day, despite subversives like Count Rumford who advocated for a mechanical theory of heat, which understood heat purely as a form of motion. If the flow of heat from the hot to the cold body produced all the work in the steam engine, then making an efficient engine meant minimizing any spillage of heat that did no useful work. It also implied that to maximize the work produced by the engine, one must maximize the difference between the source of high temperature and the sink of low temperature—the height through which the caloric fluid falls. Carnot’s book was largely ignored. But his insights had their first chance to be rescued from obscurity shortly after his death. Émile Clapeyron, just a few years younger than Carnot, was an accomplished engineer who specialized in locomotives, and a fellow-graduate of the École Polytechnique. In 1834, he published a paper in the school’s journal showing that Carnot’s heat engine theory could be expressed in the language of calculus and seen graphically in the indicator diagram: the area inside the diagram (which could be expressed as an integral) corresponded to the work performed by the heat transfer in the engine. Clapeyron’s work revived Carnot’s abstractions, put them on a firmer mathematical basis, and publicized them to the community of engine builders. Yet once again, they reached a dead end. Steeped in the traditions of their craft, neither Clapeyron nor his peers seem not to have understood the heat engine theory as having practical applications to real-life engineering.[16] Vindication for Carnot would have to wait another fifteen years, when a series of exchanges between William Thomson (later Lord Kelvin), Rudolf Clausius, and James Joule shortly before and after 1850 resolved various problems with the Carnot-Clapeyron heat engine, including reconciling it with the mechanical theory of heat: what flowed from the hot to the cold body was not a literal fluid but an abstraction called energy, which could take on many forms, but could only perform useful work over a fall in temperature. Through the medium of energy, a certain quantity of heat was directly equivalent to a certain amount of power.[17] The scientist who best synthesized this new science of heat for a wider engineering audience was Thomson’s colleague at the University of Glasgow, Macquorn Rankine. Perfecting the Marine Engine Rankine’s position was something of a novelty: he was only the second person to hold a chair of Civil Engineering at Glasgow, a position established by Queen Victoria in 1840. From the days of Watt and beyond, the University of Glasgow had been more practical-minded than the great Oxbridge schools of the South. But the establishment of a faculty chair in engineering did not just indicate that the university supported more hardheaded tasks than absorbing classical learning, it also signaled a desire to elevate engineering into a more theoretical, scientific discipline.[18] PGP R 2115.24 " data-medium-file="https://cdn.accountdigital.net/FnlrZNj8fQTsaPvT22_9gd-YHEEq" data-large-file="https://technicshistory.com/wp-content/uploads/2023/11/william_john_macquorn_rankine_by_thomas_annan.jpg?w=739" loading="lazy" width="778" height="1023" src="https://cdn.accountdigital.net/FrEoBHbrvJHyzrEXe93NzuOg6OWg" alt="" class="wp-image-14597" style="width:408px;height:auto" srcset="https://cdn.accountdigital.net/FrEoBHbrvJHyzrEXe93NzuOg6OWg 778w, https://cdn.accountdigital.net/FmzgsPbBW_cLTscowMscuC3n_cwa 1556w, https://cdn.accountdigital.net/Fp_NjcBxPV0wCxM3zCCtq6WnAxpV 114w, https://cdn.accountdigital.net/FnlrZNj8fQTsaPvT22_9gd-YHEEq 228w, https://cdn.accountdigital.net/FqppXmUOcVWA7m11yEWUApiqe2FB 768w" sizes="(max-width: 778px) 100vw, 778px">A leonine Rankine. Rankine, embodying this new spirit, straddling the worlds of theory and practice, preached thermodynamics to the engineering world: his 1859 A Manual of the Steam Engine and Other Prime Movers (1859), a 500-page, densely mathematical treatise, explicated the new theory and its applicability to practical matters in great detail and popularized the term “thermodynamics.” However he also knew how to reach a wider audience: in an 1854 address to the Liverpool meeting of the British Association for the Advancement of Science (BAAS) he concisely expressed the laws of thermodynamics in terms of ordinary English and simple arithmetic: “As the absolute temperature of receiving heat is to the absolute temperature of discharging heat, so is the whole heat received to the necessary loss of heat.” That is, the more precipitous the fall of temperature from the high (receiving) to the low (discharging) point of the engine cycle, the more efficient the engine could be.[19] Among those in Rankine’s circle of influence in the 1850s was an experienced builder of marine steam engines in Glasgow named John Elder, who became the first to incorporate a double-cylinder engine into a successful steamship. Elder had marine engines in his blood: his father David had joined Robert Napier’s engine building firm and began designing steamboat engines in 1821. In addition to family tradition and his natural talents, Elder had two other advantages in this undertaking. First, he had access to Glasgow’s “thermodynamic network” (as the historian Crosbie Smith put it); he had tutors in the new thermodynamic science and probably got specific advice from Rankine to introduce steam jacketing to prevent condensation in the cylinder. Second, he had an eager buyer.[20] An anonymous engraving of John Elder. The Pacific Steam Navigation Company (PSNC) of Liverpool had overextended itself in the South American Pacific-coast trade, where high-quality steam coal could arrive only by a 19,000-mile round-trip supplied by sail. Profit margins were slim to none, and venture stayed in the black only by virtue of a government mail contract. This made the company willing to wait out teething problems in order to get a more efficient engine. From the time Elder and his partner took out their engine patent in January 1853, it took four years before PSNC ratified the superiority of their ship Valparaiso, which consumed 25% less coal than an equivalent single-cylinder model.[21] Elder’s success set the stage for Holt’s further vault forward in the 1860s. Among the latter’s achievements was to convince the Board of Trade that marine engines could operate safely at higher pressures; allowing a greater fall of temperature and thus more efficient use of fuel. This, in turn, set the stage for triple-expansion engines later in the century, to extract still more work from the heat as it falls from boiler to condenser. This polyphonic fugue of machinery heralded the age of steam’s baroque period, which engendered the fantasias of steampunk a century later. By about 1890, a triple-expansion engine, running at 160 pounds-per-square-inch, could consume one-and-a-half pounds of coal per-horsepower per-hour, less than a third of the going rate a few decades before, and about five times less than Watt’s engine.[22] SONY DSC " data-medium-file="https://cdn.accountdigital.net/FtSQ8BekQNbv8kPS9uifApbwjKgt" data-large-file="https://technicshistory.com/wp-content/uploads/2023/11/tmw_677_-_triple_expansion_compound_steam_engine.jpg?w=739" loading="lazy" width="1024" height="975" src="https://cdn.accountdigital.net/FnvB-w_zECM1YvpFkdg-gYKhv1iR" alt="" class="wp-image-14600" srcset="https://cdn.accountdigital.net/FnvB-w_zECM1YvpFkdg-gYKhv1iR 1024w, https://cdn.accountdigital.net/FuWr2VLuwR94tPMUvE7sdYLm4x64 2046w, https://cdn.accountdigital.net/FvPIsIFR9yKXU_LcLXTgOMpJG8pE 150w, https://cdn.accountdigital.net/FtSQ8BekQNbv8kPS9uifApbwjKgt 300w, https://cdn.accountdigital.net/FuYz2_GUHfI2LpjeXYePQ7ky7D4- 768w" sizes="(max-width: 1024px) 100vw, 1024px">Cutaway of an 1888 Austrian triple-expansion engine, in the Vienna Technical Museum [Sandstein / Creative Commons Attribution 3.0 Unported]. Yet even as it thrust the age of steam up towards its apex, thermodynamics pointed out the weak spot that would lead to its downfall. In his 1854 speech to the BAAS, Rankine had touted the advantages of the air engine, a device devised by the Scotsman Robert Stirling that used hot air as its working fluid.  As Rankine pointed out, the laws of thermodynamics have nothing in particular to do with steam, but hold “true for all substances whatsoever in all conditions…” Air had a decided advantage over steam insofar as it could be driven to very high temperatures without creating very dangerous pressures: “For example, at the temperature of 650 ° Fahr. (measured from the ordinary zero,) a temperature up to which air engines have actually been worked with ease and safety, the pressure of steam is 2100 pounds upon the square inch; a pressure which plainly renders it impracticable to work steam engines with safety….”[23] The Stirling air engine did not, in the event, prove to be the slayer of steam. Its use never expanded beyond occasional low-power domestic applications. But it brought the first adumbration of the coming eclipse. Stirling air engine – harbinger of doom? [Paul U. Ehmer / CC-BY-SA-4.0]

Read more
Microcomputers – The First Wave: Responding to Altair

[This post is part of “A Bicycle for the Mind.” The complete series can be found here.] Don Tarbell: A Life in Personal Computing In August 1968, Stephen Gray, sole proprietor of the Amateur Computer Society (ACS), published a letter in the society newsletter from an enthusiast in Huntsville, Alabama named Don Tarbell. To help other would-be owners of home-built computers, Tarbell offered a mounting board for integrated circuits for sale for $8 from his own hobby-entrepreneur company, Advanced Digital Design. Tarbell worked for Sperry Rand on projects for NASA’s Marshall Space Flight Center, but had gotten hooked on computers through coursework at the University of Alabama at Huntsville, and found the ACS through a contact at IBM.[1] Over the ensuing years, integrated circuits became far cheaper and easier to come by, and building a real home computer on one’s own thus far more feasible (though still a daunting challenge, demanding a wide range of hardware and software skills). In June 1972, Tarbell had mastered enough of those skills to report to the ACS Newsletter that he (at last) had a working computer system, with an 8-bit processor built from integrated circuits, four-thousand bytes of memory, a text editor and a calculator program, a Teletype for input and output, and an eight-track-tape interface for long-term storage. Not long after this report to ACS, Tarbell decamped from Alabama and moved to the Los Angeles area to work for Hughes Aircraft.[2] Don Tarbell with his home-built computer system [Kilobaud: The Small Computer Magazine (May 1977), 132]. Three years after that, in 1975, the arrival of the Altair 8800 kit announced that anyone with the skills to assemble electronics could have the power of a minicomputer in their own home, and thousands heeded the call. A group of 150 of these personal computer hobbyists met in the commons of the apartment complex where Tarbell lived. They had come on Father’s Day for the inaugural meeting of the Southern California Computer Society (SCCS). Half of the participants already owned Altairs. Tarbell took on the position of secretary for the new society, and served on the board of directors. Within a few months, SCCS began producing its own magazine with a full editorial staff, a far more sophisticated operation than the old hand-typed ACS Newsletter; Tarbell eventually became one of its associate editors.[3] But an Altair kit by itself was far from a complete computer system like the one Tarbell had back in 1975. It had a piddling 256 bytes of memory, and no devices for reading or writing data other than lights and switches. Dozens of hobbyists founded their own companies to sell other computer buffs the additional equipment that would answer the deficiencies of their newly-purchased Altairs. Don Tarbell was one of them. Among the major problems was the inability to permanently store or load programs and data. Once you shut off the computer, everything you had entered into it was lost. A standard Teletype terminal came equipped with a paper tape punch and reader, but even a heavily used Teletype could cost $1000. In February 1976, Tarbell offered a much simpler and cheaper solution, the Tarbell cassette interface, a board that would slot into the Altair case and connect the computer to an ordinary cassette recorder, writing or reading data to or from the magnetic tape. Not only was a cassette machine much cheaper than a teletype, cassettes were more durable than paper, could store more data (up to 2200 bits per inch with Tarbell’s controller), and could be rewritten many times. Tarbell’s board sold for $150 assembled, $100 for a kit. He later branched out into floppy disk controllers and an interpreter for the BASIC computer language, and became a minor celebrity of the growing microcomputer scene.[4] Tarbell’s story offers a microcosm of the transition of personal computers, over the course of the 1970s, from an obscure niche hobby to a national industry. Like Hugo Gernsback in radio half a century before, home-computer tinkerers found themselves new roles in a growing hobby business as community-builders, publishers, and small-scale manufacturers. Like Tarbell, the first wave of these entrepreneurs responded directly to the Altair, offering supplemental hardware to offset its weaknesses or offering a more reliable or more capable hobby computer. The First Wave: Responding to Altair The Micro Instrumentation and Telemetry Systems (MITS) Altair came with a lot of potential, but it lay mostly unrealized in the basic kit MITS shipped out. This was partly intentional: the Altair sold on the basis of its exceptionally low price (less than $500), and it simply couldn’t remain so cheap if it had all the features of a full-fledged minicomputer system. Other deficiencies arose by accident, out of the amateurish nature of MITS. The good timing and negotiating skills of Ed Roberts, the company’s owner, had put him at the spearhead of the hobby computer revolution, but no one at his company had exceptional talent in electronics or product design. The Altair took hours to assemble, and the assembled machines often didn’t work. Follow-up accessories came out slowly as MITS technicians struggled to get them working. Tarbell’s cassette interface succeeded because it performed faster and more reliably than MITS’ equivalent. The most urgent need of the hobbyist other than easier input and output was additional memory beyond the scanty 256 bytes included with the base kit: far from enough to run a meaningful program, like a BASIC interpreter. In the spring of 1975, MITS started shipping a 4096-byte (4K) board designed by Roberts, but these boards simply didn’t work.[5] Unsurprisingly, other hobby-entrepreneurs began to step up quickly to fill the gaps. Several of them came from the most famous of the Altair-inspired hobby communities, the Homebrew Computer Club, which met in Silicon Valley and attracted attendees from around the Bay Area. Processor Technology was founded in Berkeley by Homebrew regular and electronics enthusiast Bob Marsh and his reclusive partner, Gary Ingram. In the spring of 1975, they began offering a 4K memory board for the Altair that actually worked. Later, the company came out with its own tape controller and a display board that would make Altair into a TV Typewriter, which they called VDM-1.[6] MITS’ 4K memory board compared to Processor Technology’s. Even without knowing anything about hardware design, it’s easy to see how sloppy the former is compared to the latter. [s100computers.com] Only one “authorized” Altair board maker existed, Cromemco, also located in the Bay Area. Cromemco founders Harry Garland and Roger Melen met as Ph.D. students in electrical engineering at Stanford (and named their company after their dormitory: Crothers Memorial). They contributed articles to Popular Electronics regularly, and found out about Altair while visiting the magazine’s offices in New York. They originally intended to build an interface board for the Altair that could read data from their “Cyclops” digital camera design. Despite the early partnership, no Cromemco board saw the light of day until 1976. Their slow start notwithstanding, Garland and Melen created two products of significance to MITS’ business and to the future of personal computing: the “Dazzler” graphics board and the “Bytesaver” read-only-memory (ROM). Unlike the TV Typewriter or the VDM-1, which could display only text, the Dazzler could paint arbitrary pixels onto the screen from an eight color palette (though only at a resolution of 64 x 64, or up to 128 x 128 in monochrome mode). Less sexy but equally significant, the Bytesaver board stored a program that would be immediately loaded into the Altair memory on power up; prior to that an Altair could do nothing until basic control instructions were keyed in manually to bootstrap it (instructing it, for example, to load another program from paper tape).[7] A 1976 ad for the Cromemco Dazzler [Byte (April 1976), 7] Roberts bristled at the competition from rival card makers. But more aggravating still were the rival computer makers cranking out Altair knock-offs. In 1974, Robert Suding and Deck Bemis had launched Digital Group out of Denver to support the Micro-8. After Altair came out, they decided to make their own, superior computer; Suding happily quit his steady but dull job at IBM to serve as the Woz to Bemis’ Jobs, avant la lettre. Digital Group computers came complete with an eight-kilobyte memory board, a cassette tape controller, and a ROM chip that could boot a program directly from tape. They also had a processor board independent of the backplane into which expansion cards slotted, which meant you could upgrade your processor without replacing any of your other boards. In short, they offered a computer hobbyist’s dream. The catch came in the form of poor quality control and very long waits for delivery, after paying cash up front.[8] Other would-be Altair-killers entered the market from around the country in 1975. Mike Wise, of Bountiful, Utah, created the Sphere, the first hobby computer with an integrated keyboard and display—although production was so limited that, decades later, vintage computer collectors would doubt whether any were actually built. The SWTPC 6800 came out of San Antonio, built by the same Southwest Technical Products Corporation that had sold parts for Don Lancaster’s TV Typewriter. A pair of Purdue graduate students in West Lafayette, Indiana wrote software for the SWTPC under the moniker of Technical Systems Consultants. A few hundred miles to the east, Ohio Scientific of Hudson, Ohio released a Microcomputer Trainer Board that put it, too, on the hobbyist map.[9] The SWTPC 6800. The bluntly rectangular cabinet design with the computer’s name prominent on the faceplate is typical of this era of microcomputers.[Michael Holley] But the real onslaught came in 1976. By that time hobbyists with entrepreneurial ambition had had time to fully absorb the lessons of the Altair, to hone their own skills at computer building, and to adopt new chips like the MOS Technology 6502 or Zilog Z80. The most significant releases of the year were the Apple Computer, MOS Technology KIM-1, IMSAI 8080, Processor Technology Sol-20, and, in the unkindest cut for Roberts, the Z-1 from former ally Cromemco. Most of these computer makers solved the upgrade problem in a more blunt fashion than the Digital Group’s sophisticated swappable boards: they simply copied the card interface protocol (known as the “bus”) of the Altair. Already own an Altair? Buy a Z-1 or Sol-20 and you could put all of the expansion cards for your old computer into the new. Cromemco founder Roger Melen encouraged the community to disassociate this interface from MITS by calling it the S100 bus, not the Altair bus—another twist of the knife.[10] Almost all of these businesses (excepting IMSAI, of whom more shortly) continued to exclusively target electronic hobbyists as their customers. The Z-1 looked just like an upmarket Altair, with a front panel now adorned with slightly nicer switches and lights. The Apple Computer and KIM-1 offered no frills at all, just a bare green printed circuit board festooned with chips and other components. Processor Technology’s Sol-20, inflected with Lee Felsenstein’s vision of a “Tom Swift” terminal for the masses, sported a handsome blue case with integrated keyboard and walnut side panels. This represented substantial progress in usability compared to the company’s first memory boards (which came only as a kit the buyer had to assemble), but the Sol-20 was still marketed via Popular Electronics as a piece of hobby equipment.[11] Software Entrepreneurs In early 1975, a computer hobbyist who wanted a minicomputer-like system of their own had only one low-price option: buy an Altair; then build, or wait for, or scrounge, the additional components that would make it into a functional system. Eighteen months later, abundance had replaced scarcity in the computer hobby hardware market, with many makes, models, and accessories to choose from. But what about software? A working computer consisted of metal, semi-conductor, and plastic, but also a certain quantity of “thought-stuff,” program text that would tell the computer what, exactly, to compute. A large proportion of the hobby community had a minicomputer background. They were accustomed to writing some software themselves and getting the rest (compilers, debuggers, math libraries, games, and more) from fellow users, often through organized community exchanges like the DEC user group program library. So, they expected to get microcomputer programs in the same way, through free exchange with fellow hobbyists. Even in the mainframe world, software was rarely sold independently of a hardware system prior to the 1970s.[12] It came as a shock, then, when, immediately on the heels of Altair, the first software entrepreneurs appeared. Paul Allen and Bill Gates—especially Gates—were roughly a decade younger than most of the early hardware entrepreneurs, at just 22 and 19, respectively. Compare to Ed Roberts of MITS at 33; Lee Felsenstein of Processor Technology, 29; Harry Garland of Cromemco, 28; Chuck Peddle of MOS Technology and Robert Suding of the Digital Group, both 37. These two young men from Seattle had caught the computer bug at the keyboard of their private school’s time-sharing terminal; they had finagled some computer time at a Seattle time-sharing company in exchange for finding bugs, but had no serious work experience that would have immersed them in the practices of the minicomputer world. For all their youth, though, Gates and Allen brimmed with ambition, and when they saw the Altair on the cover of Popular Electronics, they saw a business opportunity. Of course, everyone knew that a computer would need software to be useful, but it was not obvious that anyone would pay for that software. Gates and Allen, having not yet grown accustomed to getting software for free, had an easier time imagining that they would. They also knew that the first program any self-respecting hobbyist would want to get their hands on was a BASIC interpreter, so that they could run the huge existing library of BASIC software (especially games) and begin writing programs of their own. Gates and Allen in 1981. [MOHAI, King County News Photograph Collection, 2007.45.001.30.02, photo by Chuck Hallas] Like Cromemco, Gates and Allen started out as partners with MITS—within days of seeing they Altair cover, they contacted Ed Roberts promising a BASIC interpreter. They delivered in March, despite having no Altair, nor even an 8080 processor—they developed the program on a simulator written by Allen for the DEC PDP-10 at Harvard, where Gates was enrolled as a sophomore. In another debt to DEC, Gates based the syntax on Digital’s popular BASIC-PLUS. Allen moved to Albuquerque soon after, to head a new software division at MITS. Gates eventually followed to nurture their independent software venture, Micro-Soft, though he did not completely abandon Harvard until 1977.[13] Many hobbyists balked at the culture shock of paying for software, and freely exchanged paper tapes of Altair BASIC in defiance of Micro-Soft and MITS, prompting Gates’ famous “Open Letter to Hobbyists,” in February 1976. There he made the case that software writers deserved compensation for their work just as much as hardware builders did, prompting a flurry of amici curiae from various corners of the hobby (with far more weighing in for the defendants than the plaintiff). But, though this controversy is famous for its retrospective echoes of later debates over free software, Gates and Allen rendered the issue irrelevant almost immediately, by switching to a different business model. They began licensing BASIC to computer manufacturers at a flat fee, instead of a royalty on each copy sold. MITS paid $31,200, for example, for the BASIC for a new Altair model using the Motorola 6800 processor. The licensor could choose to charge for the software or not, Micro-Soft didn’t care, but they typically didn’t. This approach bypassed the cultural conflict altogether; BASIC interpreters and other systems software became a bullet point in a list of advertised features for a given piece of hardware rather than a separate item in the catalog.[14] Having a BASIC would let you run programs on your computer; but the other crucial linchpin for an easy-to-use microcomputer system was a program to manage your other programs and data. As faster and denser magnetic storage supplanted paper tape, computer users needed a way to quickly and easily move files between memory and their cassettes or floppy disks. By far the most popular tool for this purpose was CP/M, for Control Program for Microcomputers. CP/M was the creation of Gary Kildall, who got his hands on his first microcomputer directly from the source: Intel. Kildall grew up in Seattle and studied computer science at the University of Washington, where he had a brief run in with Gates and Allen, who at the time were teenagers who worked at a company part-owned by one of his professors, the Computer Center Corporation, in exchange for free computer time. Drafted into the army, Kildall used his connections at the University and his father’s position as a merchant marine instructor to get posted instead to naval officer training, and then a position as a math and computer science teacher at the Naval Postgraduate School in Monterey. After completing his obligations to the Navy in 1972, he stayed on as a civilian instructor.[15] Gary Kildall with his wife Dorothy, in 1978. [Computer History Museum] That same year, Kildall learned about the Intel 4004, and, like so many other computer enthusiasts, became enchanted with the idea of a computer of his own. The most obvious route was to get his hands on Intel’s development kit for the 4004, the SIM4-01, intended to be used by customers to write software for the new chip. So Kildall began talking to people at Intel, and then consulting at Intel, and in exchange for software written for Intel, managed to acquire microprocessor development kits for the 4004, and then later the 8008 and 8080 processors.[16] The most significant piece of software Kildall provided to Intel was PL/M, Programming Language for Microprocessors, which allowed developers to express code in a higher-level syntax that would then be compiled down to the 4004 (or 8008, or 8080) machine language. But you could not write PL/M on a microcomputer, it didn’t have the necessary mass storage interface or software tools; clients were expected to write programs on a minicomputer and then flash the final result onto a ROM chip that would power whatever microprocessor application they had in mind (a traffic light controller, for example, or a cash register.) What Kildall dreamed of was to “self-host” PL/M: that is, to author PL/M programs on the same computer on which they would run. By 1974 he had assembled everything he needed—a Intellec 8/80 development kit (for the 8080), a used hard drive and teletype, a disk controller board built by a friend—except for a program that could load and store the PL/M compiler, the code to be compiled, and the output of the compilation. It was for this reason, to complete his own personal quest, that he wrote CP/M.[17] Only after the fact did he think about selling it, just in time to catch the rising wave of hobby computers. Though Kildall later offered direct sales to users, he began with the same flat-fee license model that Micro-Soft had adopted: Kildall sold the software to Omron, a smart terminal maker, and then to IMSAI for their 8080 computer, each at a fee of $25,000. He incorporated his software business as Intergalactic Digital Research (later just Digital Research) in Pacific Grove, just west of Monterey. Gates visited in 1977 to float the idea of a California merger of the two (relative) giants of microcomputer software, but he and Allen decided to relocate to Seattle instead, leaving behind an intriguing what-if.[18] A CP/M command line interaction via a Tarbell disk controller, showing all the files on disk “A”. [Computer History Museum]      CP/M soon became the de-facto standard operating system for personal computers. Having an operating system made writing application software far easier, because basic routines like reading data from disk could be delegated to system calls instead of being re-written from scratch every time. CP/M in particular stood out for its quality in an often-slapdash hobby industry, and could easily be adapted to new platforms because of Kildall’s innovation of a Basic Input Output System (BIOS), which acted as a translation layer between the operating system and hardware. But what bootstrapped its initial popularity was the IMSAI deal, which attached Digital Research to the rising star in what up to that point had been Altair’s market to lose.[19] Getting Serious? There was one company thinking different about the microcomputer market in 1975: IMSAI, headquartered in San Leandro, California, intended to sell business machines. It had the right name for it, an acronym stuffed wall-to-wall with managerial blather: Information Management Sciences Associates, Inc. William (Bill) Millard was an IBM sales rep, then worked for San Francisco setting up computer systems, and founded IMS Associates to sell his services to companies who needed similar IT help. Bill Millard circa 1983. Provenance unknown. Despite the anodyne name he gave to his company, Millard, too, felt the influence of the ideologies of personal liberation that seemed to rise from San Francisco Bay like a fog. But unlike a Lee Felsenstein or a Bob Albrecht, he though mainly of liberating himself, not others: he was a devotee of Erhard Seminars Training, or est, a self-help seminar which promised paying customers access to an understanding of the world-changing power of their will in just two weekends; according to Erhard, “If you keep saying it \ the way it really is \ eventually your word \ is law in the universe.”[20] Neither Millard nor either of his technical employees (part-time programmer Bruce Van Natta and physicist-cum-electrical engineer Joseph Killian), had any prior interest or experience in home computers; they stumbled into the business almost by accident. Their primary contract, to build a computer networking hub for car dealerships based on a DEC computer, had begun spiraling towards failure. Casting about for some solution, they latched onto the news of Altair’s success: here was an inexpensive alternative to the DEC. When Altair refused to deliver on their timetable, they decided, in late summer of 1975, to clone it instead. And, to get cash flow going to pay their expenses and loans, they would sell their clone direct to consumers as well, while working to complete the big contract. When orders from hobbyists began to pour in, they abandoned the automotive scheme altogether to go all-in on their Altair clone.[21] The IMSAI 8080. It closely resembles the Altair, but with cleaner design and higher quality front-panel components. [Morn] The IMSAI 8080 began shipping in December 1975, at a kit price of $439. Millard cultivated an est culture at the company; employees with the “training” were favored, and total commitment to the work was expected. Some employees considered Millard a “genius or a prophet,” spouses and children of employees showed up after school to help assemble computers. By April, they were doing hundreds of thousands of dollars per month in sales. IMSAI was board-compatible with MITS but made improvements that stood out to the connoisseur: a more efficient internal layout, a cleaner and more professional exterior, and a seriously beefed-up power supply that could support a case fully loaded with expansion boards. These advantages appealed enough to buyers to make it Altair’s top competitor in 1976.[22] But what most set IMSAI apart in 1976 was the fact that it was not led by hobby entrepreneurs, but by a business man who wanted to build business machines. An advertisement in the May 1976 issue of BYTE magazine described the IMSAI as a “rugged, reliable, industrial computer with high commercial-type performance,” as opposed to “Altair’s hobbyist kit” (the IMSAI was of course also sold as a kit), along with obscure allusions to expensive IMSAI business products (Hypercube and Intelligent Disk) that never materialized. This was an odd pretense to put on while advertising in BYTE—a publication featuring articles such as “More to Blinking Lights than Meets the Eye” and “Save Money Using Mini Wire Wrap.”  This is not to say that IMSAI (or its contemporaries) had no commercial customers or applications. Alan Cooper, known later for creating Visual Basic, wrote a basic accounting program for the IMSAI in 1976 called General Ledger. But these applications remained a small minority among the mass of buyers who were computer-curious.[23] In 1977, IMSAI began advertising a “megabyte micro,” another fantasy. Such a powerful and expensive machine could sell in the higher end of the minicomputer market, but not to IMSAI’s actual buyers, hobbyists who were buying kits for less than a thousand dollars out of retail storefronts.IMSAI tried again to attract serious business customers with its second major product, the all-in-one VDP-80, which began shipping in late 1977 with an integrated keyboard, display, and dual disk drives, but it was plagued with quality defects, and lacked any application software for its would-be business customers to use.[24] Those customers did arrive in large numbers in good time, but only after a second wave of all-in-one computers appeared, aimed at the mass-market, and after the emergence of useful application software to run on them.

Read more
Steamships, Part 2: The Further Adventures of Isambard Kingdom Brunel

Iron Empire As far back as 1832, Macgregor Laird had taken the iron ship Alburkah to Africa and up the Niger, making it among the first ship of such construction to take the open sea. But the use of iron hulls in British inland navigation can be traced decades earlier, beginning with river barges in the 1780s. An iron plate had far more tensile strength than even an oaken board of the same thickness. This made an iron-hulled ship stronger, lighter, and more spacious inside than an equivalent wooden vessel: a two-inch thickness of iron might replace two-foot’s thickness of timber.[1]  The downsides included susceptibility to corrosion and barnacles, interference with compasses, and, at least at first, the expense of the material. As we have already seen, the larger the ship, the smaller the proportion of its cargo space that it would need for fuel; but the Great Western and British Queen pushed the limits of the practical size of a wooden ship (in fact, Brunel had bound Great Western’s hull with iron straps to bolster its longitudinal strength and prevent it from breaking in heavy seas).[2] The price of wood in Britain grew ever more dear as her ancient forests disappeared, but to build more massive ships economically also required iron prices to fall: and they did just that, starting in the 1830s, because of a surprisingly simple change in technique. Ironmongers had noticed long ago that their furnaces produce more metal from the same amount of fuel in the winter months. They assumed that the cooler air produced this result, and so by the nineteenth century it had become a basic tenet of the iron-making business that one should blast cool air into the furnace with the bellows to maximize its efficiency.[3] This common wisdom was mistaken; entirely backwards, in fact. In 1825, a Glasgow colliery engineer named James Neilson found that a hotter blast made the furnaces more efficient (it was the dryness, not the coolness, of the winter air that had made the difference). Neilson was asked to consult at an ironworks in the village of Muirkirk which was having difficulty with its furnace. He realized that heating the blast air would expand it, and thus increase the pressure of the air flowing into the furnace, strengthening the blast. In 1828 he patented the method of using a stove to heat the blast air. He convinced the Clyde Ironworks to adopt it, and together they perfected the method over the following few years. The results were astounding. A 600° F blast reduced coal consumption of the furnace by two-thirds and increased output from about five-and-a-half tons of pig iron per day to over eight.[4] On top of all that, this simple innovation allowed the use of plain coal as fuel in lieu of (more expensive) refined coke. Ironmakers had adopted coke in the 1750s because when iron was smelted with raw coal the impurities (especially sulfur) in the fuel made the resulting metal too brittle. But the hot blast sent the temperature inside the furnace so high that it drove the sulfur out in the slag waste rather than baking it into the iron. During the 1830s and 40s, Neilson’s hot blast technique spread from Scotland across all of Great Britain, and drove a rapid increase in iron production, from 0.7 million tons in 1830 to over two million in 1850. This cut the market price per ton of pig iron in half.[5] With its vast reserves of coal and iron, made accessible with the power of steam pumps (themselves made in Britain of British iron and fueled by British coal), Britain was perfectly placed to supply the demand induced by this decline in price. Much of the growth in iron output went to exports, strengthening the commercial sinews of the British empire while providing the raw material of industrialization to the rest of the world. The frenzies of railroad building in the United States and continental Europe in the middle of the nineteenth century relied heavily on British rails made from British iron: in 1849, for example, the Baltimore and Ohio railroad secured 22,000 tons of rails from a Welsh trading concern.[6] The hunger of the rapidly growing United States for iron proved insatiable; circa 1850 the young nation imported about 450,000 tons of British iron per year.[7] Good Engineering Makes Bad Business The virtues of iron were also soon on the brain of Isambard Kingdom Brunel. The Great Western Steam Ship Company’s plan for a successor to Great Western began sensibly enough; they would build a slightly improved sister ship of similar design. But Brunel and his partners were seduced, in the fall of 1838, by the appearance in Bristol harbor of an all-iron channel steamer called Rainbow, the largest such ship yet built. Brunel’s associates Claxton and Patterson took a reconnaissance voyage on her to Antwerp and upon their return all three men became convinced that they should build in iron.[8] As if that were not enough novelty to take on in one design, in May 1840 another innovative ship steamed into Bristol harbor, leaving Brunel and his associates swooning one more. The aptly named Archimedes, designed by Francis Petit Smith, swam through the water with unprecedented smoothness and efficiency, powered by a screw propeller rather than paddle wheels.[9] Any well-educated nineteenth-century engineer knew that paddles wasted a huge amount of energy pushing water down at the front of the wheel and lifting it up at the back. Nor was screw propulsion a surprising new idea in 1840. As we have seen, early steamboat inventors tried out just about every imaginable means of pushing or pulling a ship. In his very thorough Treatise on the Screw Propeller, the engineer John Bourne cites fifty some-odd proposals, patents, or practical attempts at screw propulsion prior toSmith’s.[10] After so many failures, most practical engineers assumed (reasonably enough) that the screw could never replace the proven (albeit wasteful) paddlewheel. The difficulties were numerous, including reducing vibration, transmitting power effectively to the screw, and choosing its shape, size, and angle among many potential alternatives. Most fundamental though, was producing sufficient thrust: early steam engines operated at modest speed, cycling every three seconds or so. At twenty revolutions per minute, a screw would have to be of an impractical diameter to actually push a ship forward rapidly. Smith overcame this last problem with a gearing system to allow the propeller shaft to turn 140 times per minute. His propeller design at first consisted of a true helical screw, of two turns (which created excessive friction), then later a single turn. Then, in 1840 he refitted Archimedes with a more recognizably modern propeller with two blades (each of half a turn).[11] Even with these design improvements, Brunel found that noise and vibration made the Archimedes of 1840 “uninhabitable” for passengers.[12]  But he had unshakeable faith in its potential. No doubt, advocates of the screw could tout many potential advantages over the paddlewheel: a lower center of gravity, a more spacious interior, more maneuverability in narrow channels, and more efficient use of fuel  (especially in headwinds, which caught the paddles full on, and rolling sidelong waves, which would lift one paddlewheel or the other out of the water).[13]  So, the weary investors of the Great Western Steam Ship Company saw the timetable of the  Great Britain’s construction set back once more, in order to incorporate a screw. As steamship historian Stephen Fox put it, “[i]n commercial terms, what the Great Western company needed in that fall of 1840 was a second ship, as soon as possible, to compete with the newly established Cunard line,” but that is not what they would get.[14] The completed ship finally launched in 1843, but did not take to sea for a transatlantic voyage until July 1845, having already cost the company some £200,000 pounds in total. With 322 feet of black iron hull driven by a 1000 horsepower Maudslay engine and a massive 36-ton propeller shaft, she dwarfed Great Western. Her all-iron construction gave an impression of gossamer lightness that fascinated a public used to burly wood.[15] The Launching of the Great Britain. But if her appearance impressed, her performance at sea did not. Her propeller fell apart, her engine failed to achieve the expected speed and she rolled badly in a swell. After major, expensive renovations in the winter of 1845, she ran aground at the end of the 1846 sailing season at Dundrum Bay off Ireland. Her iron hull proved sturdier than the organization that had constructed it: by the time she was at last floated free in August 1847, the Great Western Steam Company had already sunk. Another concern bought Great Britain for £25,000, and she ended up plying the route to Australia, operating mostly by sail.[16] In the long run, Brunel and his partners were right that iron hulls and screw propulsion would surpass wood and paddles, but Great Britain failed to prove it. The upstart Inman steamer line launched the iron-hulled, screw-powered City of Glasgow in 1850, which did prove that the ideas behind Great Britain could be turned to commercial success. But the more conservative Cunard line did not dispatch its first iron-hulled ship on its maiden voyage until 1856. Though even larger than Great Britain, at 376 feet and 3600 tons, the Persia still sported paddlewheels. This did not prevent her from booking more passengers than any other steamship to date, nor from setting a transatlantic speed record.[17] Not until the end of the 1860s did oceanic paddle steamers become obsolete. The Archimedes. Without any visible wheels, she looked deceptively like a typical sailing schooner, but for the telltale smokestack. A Glorious Folly For a time, Brunel walked away from shipbuilding. Then, late in 1851, he began crafting plans for a new liner to far surpass even Great Britain, one large enough to ply the routes to Indian and Australia without coaling stops on the African coast. Stopping to refuel wasted time but also quite a lot of money: coal in Africa cost far more than in Europe, because another ship had to bring it there in the first place.[18]    Because it would sail around Africa, not towards America, the new ship was christened Great Eastern. Monstrous in all its dimensions, the Great Eastern, can only be regarded as a monster in truth, in the archaic sense of “a prodigy birthed outside the natural order of things”; it was without precedent and without issue.[19] Given the total failure of Brunel’s last steam liner company, not to mention other examples of excessive exuberance in his past, such as an atmospheric railway project that shut down within a year, it is hard to conceive of how he was able to convince new backers to finance this wild new idea. He did have the help of one new ally, an ambitious Scottish shipbuilder named John Russell, who was also wracked by career disappointment and eager for a comeback. Together they built an astonishing vessel: at 690 feet long and over 22,000 tons, it exceeded in size every other ship built to its time, and also every other ship built in the balance of the nineteenth century. It would carry (in theory) 4,000 passengers and 18,000 tons of coal or cargo, and mount both paddlewheels and a propeller, the latter powered by the largest steam engine ever built, of 1600 horsepower. Brunel died of a stroke in 1859, and never saw the ship take to sea. That is just as well, for it failed even more brutally than the Great Britain. It was slow, rolled badly, maneuvered poorly, and demanded prodigious quantities of labor and fuel.[20] Like Great Britain, after a brief service its owners auctioned it off to new buyers at a crushing loss. Great Eastern did, however, have still in its future a key role to play in the extension of British imperial and commercial power, as we shall see. The Great Eastern in harbor in Wales in 1860. Note the ‘normal-size’ three-masted ship in the foreground for scale. I have lingered on Brunel’s career for so long not because he was of unparalleled import to the history of the age of steam (he was not), but because his character and his ambition fascinate me. He innovated boldly, but rarely as effectively as his more circumspect peers, such as Samuel Cunard. Much—though certainly not all—of his career consists of glorious failure. Whether you, dear reader, emphasize the glory or the failure, may depend on the width of the romantic streak that runs through your soul.

Read more
Steamships, Part I: Crossing the Atlantic

For much of this story, our attention has focused on events within the isle of Great Britain, and with good reason: primed by the virtuous cycle of coal, iron, and steam, the depth and breadth of Britain’s exploitation of steam power far exceeded that found anywhere else, for roughly 150 years after the groaning, hissing birth cry of steam power with the first Newcomen engine. American riverboat traffic stands out as the isolated exception. But Great Britain, island though it was, did not stand aloof from the world. It engaged in trade and the exchange of ideas, of course, but it also had a large and (despite occasional setbacks) growing empire, including large possessions in Canada, South Africa, Australia, and India. The sinews of that empire necessarily stretched across the oceans of the world, in the form of a dominant navy, a vast merchant fleet, and the ships of the East India Company, which blurred the lines of military and commercial power: half state and half corporation. Having repeatedly bested all its would-be naval rivals—Spain, the Netherlands, and France—Britain had achieved an indisputable dominance of the sea. Testing the Waters The potential advantages of fusing steam power with naval power were clear: sailing ships were slaves to the whims of the atmosphere. A calm left them helpless, a strong storm drove them on helplessly, and adverse winds could trap them in port for days on end. The fickleness of the wind made travel times unpredictable and could steal the opportunity for a victorious battle from even the strongest fleet. In 1814, Sir Walter Scott took a cruise around Scotland, and the vicissitudes of travel by sail are apparent on page after page of his memoirs:  4th September 1814… Very little wind, and that against us; and the navigation both shoally and intricate. Called a council of war; and after considering the difficulty of getting up to Derry, and the chance of being windbound when we do get there, we resolve to renounce our intended visit to that town… 6th September 1814… When we return on board, the wind being unfavourable for the mouth of Clyde, we resolve to weigh anchor and go into Lamlash Bay. 7th September, 1814 – We had amply room to repent last night’s resolution, for the wind, with its usual caprice, changed so soon as we had weighed anchor, blew very hard, and almost directly against us, so that we were beating up against it by short tacks, which made a most disagreeable night…[1] As it had done for power on land, as it had done for river travel, so steam could promise to do for sea travel: bring regularity and predictability, smoothing over the rough chaos of nature. The catch lay in the supply of fuel. A sailing ship, of course, needed only the “fuel” it gathered from the air as it went along. A riverboat could easily resupply its fuel along the banks as it travelled. A steamship crossing the Atlantic would have to bring along its whole supply. Plan of the Savannah. It is evident that she was designed as a sailing ship, with the steam engine and paddles as an afterthought. Early attempts at steam-powered sea vessels bypassed this problem by carrying sails, with the steam engine providing supplementary power. The American merchant ship Savannah crossed the Atlantic to Liverpool in this fashion in 1819. But the advantages of on-demand steam power did not justify the cost of hauling an idle engine and its fuel across the ocean. Its owners quickly converted the Savannah back to a pure sailing ship.[2] MacGregor Laird had a better-thought-out plan in 1832 when he dispatched the two steamships built at his family’s docks, Quorra and Alburkah, along with a sailing ship, for an expedition up the River Niger to bring commerce and Christianity to central Africa. Laird’s ships carried sails for the open ocean and supplied themselves regularly with wooden fuel when coasting near the shore. The steam engines achieved their true purpose once the little task force reached the river, allowing the ships to navigate easily upstream.[3] Brunel Laird’s dream of transforming Africa ended in tatters, and in the death of most of his crew. But Laird himself survived, and he and his homeland would both have a role to play in the development of true ocean-going steamships. Laird, like the great Watt himself, was born in Greenock, on the Firth of Clyde, and Britain’s first working commercial steamboats originated on the Clyde, carrying passengers among Glasgow, Greenock, Helensburgh, and other towns. Scott took passage on such a ferry from Greenock to Glasgow in the midst of his Scottish journey, and the contrast is stark in his memoirs between his passages at sea and the steam transit on the Clyde that proceeded “with a smoothness of motion which probably resembles flying.”[4] The shipbuilders of the Clyde, with iron and coal closet a hand, would make such smooth, predictable steam journeys ever more common in the waters of and around Britain.  By 1822, they had already built forty-eight steam ferries of the sort on which Scott had ridden; in the following decade ship owners extended service out into the Irish Sea and English Channel with larger vessels, like David Napier’s 240-ton, 70-horsepower Superb and 250-ton and 100-horsepower Majestic.[5] Indeed, the most direct path to long-distance steam travel lay in larger hulls. Because of the buoyancy of water, steamships did not suffer rocket-equation-style negative returns on fuel consumption with increasing size. As the hull grew, its capacity to carry coal increased in proportion to its volume, while the drag the engines had to overcome (and thus the size of engine required) increased only in proportion to the surface area. Mark Beaufoy, a scholar of many pursuits but with a deep interest in naval matters, had shown this decisively in a series of experiments with actual hulls in water, published posthumously by his son in 1834.[6] In the late 1830s, two competing teams of British financiers, engineers, and naval architects emerged, racing to be the first to take advantage of this fact by creating a large enough steamship to make transatlantic steam travel technically and commercially viable. In a lucky break for your historian, the more successful team was led by the more vibrant figure, Isambard Kingdom Brunel: even his name oozes character. (His rival’s name, Junius Smith, begins strong but ends pedestrian.) Brunel’s unusual last name came from his French father, Marc Brunel; his even more unusual middle name came from his English mother, Sophia Kingdom; and his most unusual first name descends from some Frankish warrior of old.[7] The elder Brunel came from a prosperous Norman farming family. A second son, he was to be educated for the priesthood, but rebelled against that vocation and instead joined the navy in 1786. Forced to flee France in 1793 due to his activities in support of the royalist cause, he worked for a time as a civil engineer in New York before moving to England in 1799 to develop a mechanized process for churning out pulley blocks for the British navy with one of the great rising engineers of the day, Henry Maudslay.[8] The most famous image of Brunel, in front of the chains of his (and the world’s) largest steamship design in 1857. Young Isambard was born in 1806, began working for his father in 1822, and got the railroad bug after riding the Liverpool and Manchester line in 1831.  The Great Western Railway (GWR) company named Brunel as chief engineer in 1833, when he just twenty-seven years old. The GWR originated with a group of Bristol merchants who saw the growth of Liverpool, and feared that without a railway link to central Britain they would lose their status as the major entrepôt for British trade with the United States. It spanned the longest route of any railway to date, almost 120 miles from London to Bristol, and under Brunel’s guidance the builders of the GWR leveled, bridged, and tunneled that route at unparalleled cost). Brunel insisted on widely spaced rails (seven feet apart) to allow a smooth ride at high speed, and indeed GWR locomotives achieved speeds of sixty miles-per-hour, with average speeds of over forty miles-per-hour over long distances, including stops. Though the broad-gauge rails Brunel stubbornly fought for are long gone, the iron-ribbed vaults of the train sheds he designed for each terminus—Paddington Station in London and Temple Meads in Bristol—still stand and serve railroad traffic today.[9] The Great Western Railway " data-medium-file="https://cdn.accountdigital.net/Fhf3soIAhhg2rN0oqVUZMO0J_BSv" data-large-file="https://cdn.accountdigital.net/Fijn2JZJiY1iiPlxXFJdkKowbSRt?w=739" loading="lazy" width="1024" height="640" src="https://cdn.accountdigital.net/FhOeLf78Au4ONW9H2uRKenokq84m" alt="" class="wp-image-14501" srcset="https://cdn.accountdigital.net/FhOeLf78Au4ONW9H2uRKenokq84m 1024w, https://cdn.accountdigital.net/Fi_GgFaxxSyF_JLeBaV4adatJV4f 150w, https://cdn.accountdigital.net/Fhf3soIAhhg2rN0oqVUZMO0J_BSv 300w, https://cdn.accountdigital.net/Ft7LTlTqReE0HzUJR2_XF8PFniC4 768w, https://cdn.accountdigital.net/Fijn2JZJiY1iiPlxXFJdkKowbSRt 1154w" sizes="(max-width: 1024px) 100vw, 1024px">An engraving of Temple Mead, Bristol terminus of the Great Western Railway. According to legend, Brunel’s quest to build a transatlantic steamer began with an off-hand quip at a meeting of the Great Western directors in October 1835.[10] Someone grumbled over the length of the railway line, Brunel said something to the effect of: “Why not make it longer, and have a steamboat to go from Bristol to New York?” Though perhaps intended as a joke, Brunel’s remark spoke to the innermost dreams of the Bristol merchants, to be the indispensable link between England and America.  One of them, Thomas Guppy, decided to take the idea seriously, and convinced Brunel to do the same. Brunel, never lacking in self-confidence, did not doubt that his heretofore landbound engineering skills would translate to a watery milieu, but just in case he pulled Christopher Claxton (a naval officer) and William Patterson (a shipbuilder) in on the scheme. Together they formed a Great Western Steam Ship Company.[11] The Race to New York Received opinion still held that a direct crossing by steam from England to New York, of over 3,000 miles, would be impossible without refueling. Dionysius Lardner took to the hustings of the scientific world to pronounce that opinion. Dionysius Lardner, Brunel’s nemesis. One of the great enthusiasts and promoters of the railroad, Lardner was nonetheless a long-standing opponent of Brunel’s: in 1834 he had opposed Brunel’s route for the Great Western railway on the grounds that the gradient of Box Hill tunnel would cause trains to reach speeds of 120 miles-per-hour and thus suffocate the passengers.[12] He gave a talk to the British Association for the Advancement of Science in August 1836 deriding the idea of a Great Western Steamship, asserting that “[i]n proportion as the capacity of the vessel is increased, in the same ratio or nearly so must the mechanical power of the engines be enlarged, and the consumption of fuel augmented,” and that therefore a direct trip across the Atlantic would require a far more efficient engine than had ever yet been devised.[13] The Dublin-born Lardner much preferred his own scheme to drive a rail line across Ireland and connect the continents by the shortest possible water route: 2,000 miles from Shannon to Newfoundland. Brunel, however, firmly believed that a large ship would solve the fuel problem. As he wrote in a preliminary report to the company in 1836, certainly drawing on Beaufoy’s work: “…the tonnage increases as the cubes of their dimensions, while the resistance increases about as their squares; so that a vessel of double the tonnage of another, capable of containing an engine of twice the power, does not really meet with double the resistance.”[14] He, Patterson and Claxton agreed to target a 1400 ton, 400 horsepower ship. They would name her, of course, Great Western. In the post-Watt era, Britain boasted two great engine-building firms: Robert Napier’s in Glasgow in the North, and Maudslay’s in London in the south. After the death of Henry Maudslay, Marc Brunel’s former collaborator, in 1831, the business’ ownership passed to his sons. But they lacked their father’s brilliance; the key to  the firm’s future lay with the partner he had also bequeathed  to them, Joshua Field. Brunel and his father both had ties to Maudslay, and so they tapped Field to design the engine for their great ship. Field chose a “side-lever” engine design, so-called because a horizontal beam on the side of the engine rocking on a central pivot delivered power from the piston to the paddle wheels. This was the standard architecture for large marine engines, because it allowed the engine to be mounted deep in the hull, avoiding deck obstructions and keeping the ship’s center of gravity low. Field, however, added several novel features of his own devising. The most important of them was the spray condenser, which recycled some of the engine’s steam for re-use as fresh water for the boiler. This ameliorated the second-most pressing problem for long-distance steamships: the build-up of scale in the engine from saltwater.[15] The 236-foot-long, 35-foot-wide hull sported iron bracings to increase its strength (a contribution of Brunel), and cabins for 128 passengers. The extravagant, high-ceiling grand saloon provided a last, luxurious Brunel touch. By far the largest steamship yet built, Great Western would have towered over most other ships in the London docks where she was built.[16] The competing group around Junius Smith had not been idle. Smith, an American-born merchant who ran his business out of London had dreamed of a steam-powered Atlantic crossing ever since 1832, when while idling on a fifty-four day sail from England to New York; almost twice the usual duration. He formed the British and American Steam Navigation Company, and counted among his backers Macgregor Laird, the Scottish shipbuilder of the Niger River expedition. Their 1800-ton British Queen would boast a 500-horsepower engine, built by the Maudslay company’s Scottish rival, Robert Napier.[17] But Smith’s group fell behind the Brunel consortium (this despite the fact that Brunel still led the engineering on the not-yet-completed Great Western Railway); the Great Western would launch first. In a desperate stunt to be able to boast of making the first Atlantic crossing, British and American launched the channel steamer Sirius on April 4, 1838 from Cork on the west coast of Ireland, laden with fuel and bound for New York. Great Western left Bristol just four days later, with fifty-seven crew (fifteen of them just for stoking coal) to serve a mere seven passengers, each paying the princely sum of 35 guineas for passage.[18] The Steamer Great Western. H.R. Robinson. PAH8859 " data-medium-file="https://cdn.accountdigital.net/FjhWpIE1aFlqt2GYL0Hc-SWJMgY9" data-large-file="https://cdn.accountdigital.net/Flj-dfOyg0Ro7Cz2Hb7HjGMwK6WT?w=739" loading="lazy" width="1024" height="730" src="https://cdn.accountdigital.net/Fu9OpVwe0NXae4jdZHJyPyuWk0m9" alt="" class="wp-image-14505" srcset="https://cdn.accountdigital.net/Fu9OpVwe0NXae4jdZHJyPyuWk0m9 1024w, https://cdn.accountdigital.net/FuVJjI8esdiqejo2CGzqD47Y3gkI 150w, https://cdn.accountdigital.net/FjhWpIE1aFlqt2GYL0Hc-SWJMgY9 300w, https://cdn.accountdigital.net/FnNNJhcavKPniiW0ouC1ntqj7v0o 768w, https://cdn.accountdigital.net/Flj-dfOyg0Ro7Cz2Hb7HjGMwK6WT 1280w" sizes="(max-width: 1024px) 100vw, 1024px">A Lithograph of the Great Western. Despite three short stops to deal with engine problems and a near-mutiny by disgruntled coal stokers working in miserable conditions, Great Western nearly overtook Sirius, arriving in New York just twelve hours behind her. In total the crossing took less than sixteen days—about half the travel time of a fast sailing packet—with coal to spare in the bunkers. The ledger was not all positive: the clank of the engine, the pall of smoke and the ever-present coating of soot and coal dust drained the ocean of some of its romance; as historian Stephen Fox put it, “[t]he sea atmosphere, usually clean and bracing, felt cooked and greasy.” But sixty-six passengers ponied up for the return trip: “Already… ocean travelers had begun to accept the modernist bargain of steam dangers and discomforts in exchange for consistent, unprecedented speed.”[19] In that first year, Great Western puffed alone through Atlantic waters. Itmade four more round trips In 1838, eking out a small profit. The British Queen launched at last in July 1839, and British and American launched an even larger ship, SS President, the following year. Among the British Queen’s first passengers on its maiden voyage to New York was Samuel Cunard, a name that would resonate in ocean travel for a century to come, and an object lesson in the difference between technical and business success. In 1840 his Cunard Line began providing transatlantic service in four Britannia-class paddleships. Imitation Great Westerns (on a slightly smaller scale), they stood out not for their size or technical novelty but for their regularity and uniformity of service. But the most important factor in Cunard’s success was outmaneuvering the Great Western Steam Company in securing a contract with the Admiralty for mail service to Halifax. This provided a steady and reliable revenue stream—starting at 60,000 pounds a year—regardless of economic downturns. Moreover, once the Navy had come to depend on Cunard for speedy mail service it had little choice but to keep upping the payments to keep his finances afloat.[20] Thanks to the savvy of Cunard, steam travel from Britain to America, a fantasy in 1836 (at least according to the likes of Dionysius Lardner), had become steady business four years later. Brunel, however, had no patience for the mere making of money. He wanted to build monuments; creations to stand the test of time, things never seen or done before. So, when, soon after the launching of the Great Western, he began to design his next great steam ship, he decided he would build it with a hull of solid iron.

Read more
Internet Ascendant, Part 2: Going Private and Going Public

In the summer of 1986, Senator Al Gore, Jr., of Tennessee introduced an amendment to the Congressional Act that authorized the  budget of the National Science Foundation (NSF). He called for the federal government to study the possibilities for “communications networks for supercomputers at universities and Federal research facilities.” To explain the purpose of this legislation, Gore called on a striking analogy: One promising technology is the development of fiber optic systems for voice and data transmission. Eventually we will see a system of fiber optic systems being installed nationwide. America’s highways transport people and materials across the country. Federal freeways connect with state highways which connect in turn with county roads and city streets. To transport data and ideas, we will need a telecommunications highway connecting users coast to coast, state to state, city to city. The study required in this amendment will identify the problems and opportunities the nation will face in establishing that highway.1In the following years, Gore and his allies would call for the creation of an “information superhighway”, or, more formally, a national information infrastructure (NII). As he intended, Gore’s analogy to the federal highway system summons to mind a central exchange that would bind together various local and regional networks, letting all American citizens communicate with one another. However, the analogy also misleads – Gore did not propose the creation of a federally-funded and maintained data network. He envisioned that the information superhighway, unlike its concrete and asphalt namesake, would come into being through the action of market forces, within a regulatory framework that would ensure competition, guarantee open, equal access to any service provider (what would later be known as “net neutrality”), and provide subsidies or other mechanisms to ensure universal service to the least fortunate members of society, preventing the emergence of a gap between the information rich and information poor.2Over the following decade, Congress slowly developed a policy response to the growing importance of computer networks to the American research community, to education, and eventually to society as a whole. Congress’ slow march towards an NII policy, however, could not keep up with the rapidly growing NSFNET, overseen by the neighboring bureaucracy of the executive branch. Despite its reputation for sclerosis, bureaucracy was created exactly because of its capacity, unlike a legislature, to respond to events immediately, without deliberation. And so it happened that, between 1988 and 1993, the NSF crafted the policies that would determine how the Internet became private, and thus went public. It had to deal every year with novel demands and expectations from NSFNET’s users and peer networks. In response, it made decisions on the fly, decisions which rapidly outpaced Congressional plans for guiding the development of an information superhighway. These decisions rested largely in the hands of a single man – Stephen Wolff.Acceptable UseWolff earned a Ph.D. in electrical engineering at Princeton in 1961 (where he would have been a rough contemporary of Bob Kahn), and began what might have been a comfortable academic career, with a post-doctoral stint at Imperial College, followed by several years teaching at Johns Hopkins. But then he shifted gears, and took a position  at the Ballistics Research lab in Aberdeen, Maryland. He stayed there for most of the 1970s and early 1980s, researching communications and computing systems for the U.S. Army. He introduced Unix into the lab’s offices, and managed Aberdeen’s connection to the ARPANET.3In 1986, the NSF recruited him to manage the NSF’s supercomputing backbone – he was a natural fit, given his experience connecting Army supercomputers to ARPANET. He became the principal architect of NSFNET’s evolution from that point until his departure in 1994, when he entered the private sector as a manager for Cisco Systems. The original intended function of the net that Wolff was hired to manage had been to connect researchers across the U.S. to NSF-funded supercomputing centers. As we saw last time, however, once Wolff and the other network managers saw how much demand the initial backbone had engendered, they quickly developed a new vision of NSFNET, as a communications grid for the entire American research and post-secondary education community.However, Wolff did not want the government to be in the business of supplying network services on a permanent basis. In his view, the NSF’s role was to prime the pump, creating the initial demand needed to get a commercial networking services sector off the ground. Once that happened, Wolff felt it would be improper for a government entity to be in competition with viable for-profit businesses. So he intended to get NSF out of the way by privatizing the network, handing over control of the backbone to unsubsidized private entities and letting the market take over.This was very much in the spirit of the times. Across the Western world, and across most of the political spectrum, government leaders of the 1980s touted privatization and deregulation as the best means to unleash economic growth and innovation after the relative stagnation of the 1970s. As one example among many, around the same time that NSFNET was getting off the ground, the FCC knocked down several decades-old constraints on corporations involved in broadcasting. In 1985, it removed the restriction on owning print and broadcast media in the same locality, and two year later it nullified the fairness doctrine, which had required broadcasters to present multiple views on public-policy debates. From his post at NSF, Wolff had several levers at hand for accomplishing his goals. The first lay in the interpretation and enforcement of the network’s acceptable use policy (AUP). In accordance with NSF’s mission, the initial policy for the NSFNET backbone, in effect until June 1990, required all uses of the network to be in support of “scientific research and other scholarly activities.” This is quite restrictive indeed, and would seem to eliminate any possibility of commercial use of the network. But Wolff chose to interpret the policy liberally. Regularly mailing list postings about new product releases from a corporation that sold data processing software – was that not in support of scientific research? What about the decision to allow MCI’s email system to connect to the backbone, at the urging of Vint Cerf, who had left government employ to oversee the development of MCI Mail. Wolff rationalized this – and other later interconnections to commercial email systems such as CompuServe’s – as in support of research by making it possible for researchers to communicate digitally with a wider range of people that they might need to contact in the pursuit of their work. A stretch, perhaps. But Wolff saw that allowing some commercial traffic on the same infrastructure that was used for public NSF traffic would encourage the private investment needed to support academic and educational use on a permanent basis. Wolff’s strategy of opening the door of NSFNET as far as possible to commercial entities got an assist from Congress in 1992, when Congressman Rick Boucher, who helped oversee NSF as chair of the Science Subcommittee, sponsored an amendment to the NSF charter which authorized any additional uses of NSFNET that would “tend to increase the overall capabilities of the networks to support such research and education activities.” This was an ex post facto validation of Wolff’s approach to commercial traffic, allowing virtually any activity as long as it produced profits that encouraged more private investment into NSFNET and its peer networks.  Dual-Use NetworksWolff also fostered the commercial development of networking by supporting the regional networks’ reuse of their networking hardware for commercial traffic. As you may recall, the NSF backbone linked together a variety of not-for-profit regional nets, from NYSERNet in New York to Sesquinet in Texas to BARRNet in northern California. NSF did not directly fund the regional networks, but it did subsidize them indirectly, via the money it provided to labs and universities to offset the costs of their connection to their neighborhood regional net. Several of the regional nets then used this same subsidized infrastructure to spin off a for-profit commercial enterprise, selling network access to the public over the very same wires used for the research and education purposes sponsored by NSF. Wolff encouraged them to do so, seeing this as yet another way to accelerate the transition of the nation’s research and education infrastructure to private control. This, too, accorded neatly with the political spirit of the 1980s, which encouraged private enterprise to profit from public largesse, in the expectation that the public would benefit indirectly through economic growth. One can see parallels with the dual-use regional networks in the 1980 Bayh-Dole Act, which defaulted ownership of patents derived from government-funded research to the organization performing the work, not to the government that paid for it. The most prominent example of dual-use in action was PSINet, a for-profit company initially founded as Performance Systems International in 1988. William Schrader and Martin Schoffstall, the co-founder of NYSERNet and one of vice presidents’, respectively, created the company. Schofstall, a former BBN engineer and co-author of the Simple Network Management Protocol (SNMP) for managing the devices on an IP network, was the key technical leader. Schrader, an ambitious Cornell biology major and MBA who had helped his alma mater set up its supercomputing center and get it connected to NSFNET, provided the business drive. He firmly believed that NYSERNet should be selling service to businesses, not just educational institutions. When the rest of the board disagreed, he quit to found his own company, first contracting with NYSERNet for service, and later raising enough money to acquire its assets. PSINet thus became one of the earliest commercial internet service providers, while continuing to provide non-profit service to colleges and universities seeking access to the NSFNET backbone.4Wolff’s final source of leverage for encouraging a commercial Internet lay in his role as manager of the contracts with the Merit-IBM-MCI consortium that operated the backbone. The initial impetus for change in this dimension came not from Wolff, however, but from the backbone operators themselves.  A For-Profit BackboneMCI and its peers in the telecommunications industry had a strong incentive to find or create more demand for computer data communications. They had spent the 1980s upgrading their long-line networks from coaxial cable and microwave – already much higher capacity than the old copper lines – to fiber optic cables. These cables, which transmitted laser light through glass, had tremendous capacity, limited mainly by the technology in the transmitters and receivers on either end, rather than the cable itself. And that capacity was far from saturated. By the early 1990s, many companies had deployed OC-48 transmission equipment with 2.5 Gbps of capacity, an almost unimaginable figure a decade earlier. An explosion in data traffic would therefore bring in new revenue at very little marginal cost – almost pure profit.5The desire to gain expertise in the coming market in data communications helps explains why MCI was willing to sign on to the NSFNET bid proposed by Merit, which massively undercut the competing bids (at $14 million for five years, versus the $40 and $25 millions proposed by their competitors6), and surely implied a short-term financial loss for MCI and IBM. But by 1989, they hoped to start turning a profit from their investment. The existing backbone was approaching the saturation point, with 500 million packets a month, a 500% year-over-year increase.7 So, when NSF asked Merit to upgrade the backbone from 1.5 Mbps T1 lines to 45Mbps T3, they took the opportunity to propose to Wolff a new contractual arrangement.T3 was a new frontier in networking – no prior experience or equipment existed for digital networks of this bandwidth, and so the companies argued that more private investment would be needed, requiring a restructuring that would allow IBM and Merit to share the new infrastructure with for-profit commercial traffic – a dual-use backbone. To achieve this, the consortium would from a new non-profit corporation, Advanced Network & Services, Inc. (ANS), which would supply T3 networking services to NSF. A subsidiary called ANS CO+RE systems would sell the same services at a profit to any clients willing to pay. Wolff agreed to this, seeing it as just another step in the transition of the network towards commercial control. Moreover, he feared that continuing to block commercial exploitation of the backbone would lead to a bifurcation of the network, with suppliers like ANS doing an end-run around NSFNET to create their own, separate, commercial Internet. Up to that point, Wolff’s plan for gradually getting NSF out of the way had no specific target date or planned milestones. A workshop on the topic held at Harvard in March 1990, in which Wolff and many other early Internet leaders participated, considered a variety of options without laying out any concrete plans.8 It was ANS’ stratagem that triggered the cascade of events that led directly to the full privatization and commercialization of NSFNET.It began with a backlash. Despite Wolff’s good intentions, IBM and MCI’s ANS maneuver created a great deal of disgruntlement in the networking community. It became a problem exactly because of the for-profit networks attached to the backbone that Wolff had promoted. So far they had gotten along reasonably with one another, because they all operated as peers on the same terms. But with ANS, a for-profit company held a de-facto monopoly on the backbone at the center of the Internet.9 Moreover, despite Wolff’s efforts to interpret the AUP loosely, ANS chose to interpret it strictly, and refused to interconnect the non-profit portion of the backbone (for NSF traffic) with any of their for-profit networks like PSI, since that would require a direct mixing of commercial and non-commercial traffic. When this created an uproar, they backpedaled, and came up with a new policy, allowing interconnection for a fee based on traffic volume.PSINet would have none of this. In the summer of 1991, they banded together with two other for-profit Internet service providers – UUNET, which had begun by selling commercial access to Usenet before adding Internet service; and the California Education and Research Federation Network, or CERFNet, operated by General Atomics – to form their own exchange, bypassing the ANS backbone. The Commercial Internet Exchange (CIX) consisted at first of just a single routing center in Washington D.C. which could transfer traffic among the three networks. They agreed to peer at no charge, regardless of the relative traffic volume, with each network paying the same fee to CIX to operate the router. New routers in Chicago and Silicon Valley soon followed, and other networks looking to avoid ANS’ fees also joined on.DivestitureRick Boucher, the Congressman whom we met above as a supporter of NSF commercialization, nonetheless requested an investigation of the propriety of Wolff’s actions in the ANS affair by the Office of the Inspector General. It found NSF’s actions precipitous, but not malicious or corrupt. Nevertheless, Wolff saw that the time had come to divest control of the backbone. With ANS + CORE and CIX privatization and commercialization had begun in earnest, but in a way that risked splitting the unitary Internet into multiple disconnected fragments, as CIX and ANS refused to connect with one another. NSF therefore drafted a plan for a new, privatized network architecture in the summer of 1992, released it for public comment, and finalized it in May of 1993. NSFNET would shut down in the spring of 1995, and its assets would revert to IBM and MCI. The regional networks could continue to operate, with financial support from the NSF gradually phasing out over a four year period, but would have to contract with a private ISP for internet access.But in a world of many competitive internet access providers, what would replace the backbone? What mechanism would link these opposed private interests into a cohesive whole? Wolff’s answer was inspired by the exchanges already built by cooperatives like CIX – NSF would contract out the creation of four Network Access Points (NAPs), routing sites where various vendors could exchange traffic. Having four separate contracts would avoid repeating the ANS controversy, by preventing a monopoly on the points of exchange. One NAP would reside at the pre-existing, and cheekily named, Metropolitan Area Ethernet East (MAE-East) in Vienna, Virginia, operated by Metropolitan Fiber Systems (MFS). MAE-West, operated by Pacific Bell, was established in San Jose, California; Sprint operated another NAP in Pennsauken, New Jersey, and Ameritech one in Chicago. The transition went smoothly10, and NSF decommissioned the backbone right on schedule, on April 30, 1995.11The Break-upThough Gore and others often invoked the “information superhighway” as a metaphor for digital networks, there was never serious consideration in Congress of using the federal highway system as a direct policy model. The federal government paid for the building and maintenance of interstate highways in order to provide a robust transportation network for the entire country. But in an era when both major parties took deregulation and privatization for granted as good policy, a state-backed system of networks and information services on the French model of Transpac and Minitel was not up for consideration.12Instead, the most attractive policy model for Congress as it planned for the future of telecommunication was the long-distance market created by the break-up of the Bell System between 1982 and 1984. In 1974, the Justice Department filed suit against AT&T, its first major suit against the organization since the 1950s, alleging that it had engaged in anti-competitive behavior in violation of the Sherman Antitrust Act. Specifically, they accused the company of using its market power to exclude various innovative new businesses from the market – mobile radio operators, data networks, satellite carriers, makers of specialized terminal equipment, and more. The suit thus clearly drew much of its impetus from the ongoing disputes since the early 1960s (described in an earlier installment), between AT&T and the likes of MCI and Carterfone.When it became clear that the Justice Department meant business, and intended to break the power of AT&T, the company at first sought redress from Congress. John de Butts, chairman and CEO since 1972, attempted to push a “Bell bill” – formally the Consumer Communications Reform Act – through Congress. It would have enshrined into law AT&T’s argument that the benefits of a single, universal telephone network far outweighed any risk of abusive monopoly, risks which in any case the FCC could already effectively check. But the proposal received stiff opposition in the House Subcommittee on Communications, and never reached a vote on the floor of either Congressional chamber. In a change of tactics, in 1979 the board replaced the combative de Butts – who had once declared openly to an audience of state telecommunications regulators the heresy that he opposed competition and espoused monopoly – with the more conciliatory Charles Brown. But it was too late by then to stop the momentum of the antitrust case, and it became increasingly clear to the company’s leadership that they would not prevail. In January 1982, therefore, Brown agreed to a consent decree that would have the presiding judge in the case, Harold Greene, oversee the break-up of the Bell System into its constituent parts.The various Bell companies that brought copper to the customer’s premise, which generally operated by state (New Jersey Bell, Indiana Bell, and so forth) were carved up into seven blocks called Regional Bell Operating Companies (RBOCs). Working clockwise around the country, they were NYNEX in the northeast, Bell Atlantic, Bell South, Southwestern Bell, Pacific Telesis, US West, and Ameritech. All of them remained regulated entities with an effective monopoly over local traffic in their region, but were forbidden from entering other telecom markets. AT&T itself retained the “long lines” division for long-distance traffic. Unlike local phone service, however, the settlement opened this market to free competition from any entrant willing and able to pay the interconnection fees to transfer calls in and out of the RBOCs. A residential customer in Indiana would always have Ameritech as their local telephone company, but could sign up for long-distance service with anyone.However, splitting apart the local and long-distance markets meant forgoing the subsidies that AT&T had long routed to rural telephone subscribers, under-charging them by over-charging wealthy long-distance users. A sudden spike in rural telephone prices across the nation was not politically tenable, so the deal preserved these transfers via a new organization, the non-profit National Exchange Carrier Association, which collected fees from the long-distance companies and distributed them to the RBOCS.   The new structure worked. Two major competitors entered the market in the 1980s, MCI and Sprint, and cut deeply into AT&T’s market share. Long-distance prices fell rapidly. Though it is arguable how much of this was due to competition per se, as opposed to the advent of ultra-high-bandwidth fiber optic networks, the arrangement was generally seen as a great success for de-regulation and a clear argument for the power of market forces to modernize formerly hidebound industries. This market structure, created ad hoc by court fiat but evidently highly successful, provided the template from which Congress drew in the mid-1990s to finally resolve the question of what telecom policy for the Internet era would look like. Second Time Isn’t The CharmPrior to the main event, there was one brief preliminary. The High Performance Computing Act of 1991 was important tactically, but not strategically. It advanced no new major policy initiatives. Its primary significance lay in providing additional funding and Congressional backing for what Wolff and the NSF already were doing and intended to keep doing – providing networking services for the research community, subsidizing academic institutions’ connections to NSFNET, and continuing to upgrade the backbone infrastructure.  Then came the accession of the 104th Congress in January 1995. Republicans took control of both the Senate and the House for the first time in forty years, and they came with an agenda to fight crime, cut taxes, shrink and reform government, and uphold moral righteousness. Gore and his allies had long touted universal access as a key component of the National Information Infrastructure, but with this shift in power the prospects for a strong universal service component to telecommunications reform diminished from minimal to none. Instead, the main legislative course would consist of regulatory changes to foster competition in telecommunications and Internet access, with a serving of bowdlerization on the side. The market conditions looked promising. Circa 1992, the major players in the telecommunications industry were numerous. In the traditional telephone industry there were the seven RBOCs, GTE, and three large long distance companies – AT&T, MCI, and Sprint – along with many smaller ones. The new up-and-comers included Internet service providers, such as UUNET, and PSINET as well as the IBM/MCI backbone spin-off, ANS; and other companies trying to build out their local fiber networks, such as Metropolitan Fiber Systems (MFS). BBN, the contractor behind ARPANET, had begun to build its own small Internet empire, snapping up some of the regional networks that orbited around NSFNET – Nearnet in New England, BARRNet in the Bay area, and SURANet in the southeast of the U.S. To preserve and expand this competitive landscape would be the primary goal of the 1996 Telecommunications Act, the only major rewrite of communications policy since the Communications Act of 1934. It intended to reshape telecommunications law for the digital age. The regulatory regime established by the original act siloed industries by their physical transmission medium – telephony, broadcast radio and television, cable TV; in each in its own box, with its own rules, and generally forbidden to meddle in each other’s business. As we have seen, sometimes regulators even created silos within silos, segregating the long-distance and local telephone markets. This made less and less sense as media of all types were reduced to fungible digital bits, which could be commingled on the same optical fiber, satellite transmission, or ethernet cable. The intent of the 1996 Act, shared by Democrats and Republicans alike, was to tear down these barriers, these “Berlin Walls of regulation”, as Gore’s own summary of the act put it.13 A complete itemization of the regulatory changes in this doorstopper of a bill is not possible here, but a few examples provide a taste of its character. Among other things it:allowed the RBOCs to compete in long-distance telephone markets,lifted restrictions forbidding the same entity from owning both broadcasting and cable services,axed the rules that prevented concentration of radio station ownership.The risk, though, of simply removing all regulation, opening the floodgates and letting any entity participate in any market, was to recreate AT&T on an even larger scale, a monopolistic megacorp that would dominate all forms of communication and stifle all competitors. Most worrisome of all was control over the so-called last mile – from the local switching office to the customer’s home or office. Building an inter-urban network connecting the major cities of the U.S. was expensive but not prohibitive, several companies had done so in recent decades, from Sprint to UUNET. To replicate all the copper or cable to every home in even one urban area, was another matter. Local competition in landline communications had scarcely existed since the early wildcat days of the telephone, when tangled skeins of iron wire criss-crossed urban streets. In the case of the Internet, the concern centered especially on high-speed, direct-to-the-premises data services, later known as broadband. For years, competition had flourished among dial-up Internet access providers, because all the end user required to reach the provider’s computer was access to a dial tone. But this would not be the case by default for newer services that did not use the dial telephone network. The legislative solution to this conundrum was to create the concept of the “CLEC” – competitive local exchange carrier. The RBOCs, now referred to as “ILECs” (incumbent local exchange carriers), would be allowed full, unrestricted access to the long-distance market only once the had unbundled their networks by allowing the CLECs, which would provide their own telecommunications services to homes and businesses, to interconnect with and lease the incumbents’ infrastructure. This would enable competitive ISPs and other new  service providers to continue to get access to the local loop even when dial-up service became obsolete – creating, in effect, a dial tone for broadband. The CLECs, in this model, filled the same role as the long-distance providers in the post-break-up telephone market. Able to freely interconnect at reasonable fees to the existing local phone networks, they would inject competition into a market previously dominated by the problem of natural monopoly. Besides the creation of the CLECS, the other major part of the bill that affected the Internet addressed the Republicans’ moral agenda rather than their economic one. Title V, known as the Communications Decency Act, forbade the transmission of indecent or offensive material – depicting or describing “sexual or excretory activities or organs”, on any part of the Internet accessible to minors. This, in effect, was an extension of the obscenity and indecent rules that governed broadcasting into the world of interactive computing services. How, then, did this sweeping act fare in achieving its goals? In most dimensions it proved a failure. Easiest to dispose with is the Communications Decency Act, which the Supreme Court struck down quickly (in 1997) as a violation of the First Amendment. Several parts of Title V did survive review however, including Section 230, the most important piece of the entire bill for the Internet’s future. It allows websites that host user-created content to exist without the fear of constant lawsuits, and protects the continued existence of everything from giants like Facebook and Twitter to tiny hobby bulletin boards. The fate of the efforts to promote competition within the local loop took longer to play out, but proved no more successful than the controls on obscenity. What about the CLECs, given access to the incumbent cable and telephone infrastructure so that they could compete on price and service offerings? The law required FCC rulemaking to hash out the details of exactly what kind of unbundling had to be offered. The incumbents pressed the courts hard to dispute any such ruling that would open up their lines to competition, repeatedly winning injunctions on the FCC, while threatening that introducing competitors would halt their imminent plans for bringing fiber to the home. Then, with the arrival of the Bush Administration and new chairman Michael Powell in 2001, the FCC became actively hostile to the original goals of the Telecommunications Act. Powell believed that the need for alternative broadband access would be satisfied by intermodal competition among cable, telephone, power communications networks, cellular and wireless networks. No more FCC rules in favor of CLECs would be forthcoming. For a brief time around the year 2000, it was possible to subscribe to third-party high-speed internet access using the infrastructure of your local telephone or cable provider. After that, the most central of the Telecom Act’s  pro-competitive measures became, in effect, a dead letter. The much ballyhooed fiber-to-the home only began to actually reach a significant number of homes after 2010, and the only with reluctance on the part of the incumbents.14 As author Fred Goldstein put it, the incumbents had “gained a fig leaf of competition without accepting serious market share losses.”15During most of the twentieth century, networked industries in the U.S. had sprouted in a burst of entrepreneurial energy and then been fitted into the matrix of a regulatory framework as they grew large and important enough to affect the public interest. Broadcasting and cable television had followed this pattern. So had trucking and the airlines. But with the CLECs all but dead by the early 2000s, the Communications Decency Act revoked, and other attempts to control the Internet such as the Clipper chip16 stymied, the Internet would follow an opposite course. Having come to life under the guiding hand of the state, it would now be allowed to develop in an almost entirely laissez-faire fashion. The NAP framework established by the NSF at the hand-off of the backbone would be the last major government intervention in the structure of the Internet. This was true at both the transport layer – the networks such as Verizon and AT&T that transported raw data, and the applications layer – software services from portals like Yahoo! to search engines like Google to online stores like Amazon.  In our last chapter, we will look at the consequences of this fact, briefly sketching the evolution of the Internet in the U.S. from the mid-1990s onward. [Previous] [Next]Quoted in Richard Wiggins, “Al Gore and the Creation of the Internet” 2000.“Remarks by Vice President Al Gore at National Press Club“, December 21, 1993.Biographical details on Wolff’s life prior to NSF are scarce – I have recorded all of them that I could find here. Notably I have not been able to find even his date and place of birth.Schrader and PSINet rode high on the Internet bubble in the late 1990s, acquiring other businesses aggressively, and, most extravagantly, purchasing the naming rights to the football stadium of the NFL’s newest expansion team, the Baltimore Ravens. Schrader tempted fate with a 1997 article entitled “Why the Internet Crash Will Never Happen.” Unfortunately for him, it did happen, bringing about his ouster from the company in 2001 and PSINet’s bankruptcy the following year.To get a sense of how fast the cost of bandwidth was declining – in the mid-1980s, leasing a T1 line from New York to L.A. would cost $60,000 per month. Twenty years later, a OC-3 circuit with 100 times the capacity cost only $5,000, more than a thousand-fold reduction in price per capacity. See Fred R. Goldstein, The Great Telecom Meltdown, 95-96. Goldstein states that the 1.55 mpbs T1/DS1 line has 1/84th the capacity of OC-3, rather than 1/100th, a discrepancy I can’t account for. But this has little effect on the overall math.Office of Inspector General, “Review of NSFNET,” March 23, 1993.Fraser, “NSFNET: A Partnership for High-Speed Networking, Final Report”, 27.Brian Kahin, “RFC 1192: Commercialization of the Internet Summary Report,” November 1990.John Markoff, “Data Network Raises Monopoly Fear,” New York Times, December 19, 1991.Though many other technical details had to be sorted out, see  Susan R. Harris and Elise Gerich, “Retiring the NSFNET Backbone Service: Chronicling the End of an Era,” ConneXions, April 1996.The most problematic part of privatization proved to have nothing to do with the hardware infrastructure of the network, but instead with handing over control over the domain name system (DNS). For most of its history, its management had depended on the judgment of a single man – Jon Postel. But businesses investing millions in a commercial internet would not stand for such an ad hoc system. So the government handed control of the domain name system to a contractor, Network Solutions. The NSF had no real mechanism for regulatory oversight of DNS (though they might have done better by splitting the control of different top-level domains (TLDs) among different contractors), and Congress failed to step in to create any kind of regulatory regime. Control changed once again in 1998 to the non-profit ICANN (Internet Corporation for Assigned Names and Numbers), but the management of DNS still remains a thorny problem.The only quasi-exception to this focus on fostering competition was a proposal by Senator Daniel Inouye to reserve 20% of Internet traffic for public use: Steve Behrens, “Inouye Bill Would Reserve Capacity on Infohighway,” Current, June 20, 1994. Unsurprisingly, it went nowhere. Al Gore, “A Short Summary of the Telecommunications Reform Act of 1996”.Jon Brodkin, “AT&T kills DSL, leaves tens of millions of homes without fiber Internet,” Ars Technica, October 5, 2020.Goldstein, The Great Telecom Meltdown, 145.The Clipper chip was a proposed hardware backdoor that would give the government the ability to bypass any U.S.-created encryption software.Further ReadingJanet Abatte, Inventing the Internet (1999)Karen D. Fraser “NSFNET: A Partnership for High-Speed Networking, Final Report” (1996)Shane Greenstein, How the Internet Became Commercial (2015)Yasha Levine, Surveillance Valley: The Secret Military History of the Internet (2018)Rajiv Shah and Jay P. Kesan, “The Privatization of the Internet’s Backbone Network,” Journal of Broadcasting & Electronic Media (2007)Share this: Click to share on X (Opens in new window) X Click to share on Facebook (Opens in new window) Facebook Like Loading...

Read more
Inter-Networking

In their 1968 paper, “The Computer as a Communications Device,” written while the ARPANET was still in development, J.C.R. Licklider and Robert Taylor claimed that the linking of computers would not stop with individual networks. Such networks, they predicted, would merge into a “labile network of networks” that would bind a variety of “information processing and storage facilities” into an interconnected whole. Within less than a decade, such formerly theoretical speculations had already acquired an immediate practical interest. Because by the mid-1970s, computer networks were proliferating. Networks Proliferate They were proliferating across a variety of new media, institutions, and places. ALOHAnet was one of several new academic networks funded by ARPA in the early 1970s – the others being the PRNET, which connected mobile trucks with packet radio, and the satellite-based SATNET. Along similar lines, other countries, especially the U.K. and France, were developing their own research networks. Local networks, because of their smaller scale and lower cost, were multiplying even more quickly. Other than Xerox PARC’s Ethernet,  one could also find the Octopus at Lawrence Radiation Laboratory in Berkeley, California; the Ring at the University of Cambridge; and the Mark II network at the British National Physical Laboratory. Around the same time, businesses also began to offer fee-based access to privately-funded packet networks. This enabled a new, national marketplace for on-line computer services. In the 1960s, various companies had launched businesses offering access to specialized databases (for legal or financial data) or to time-shared computers, to anyone with a terminal. But these were prohibitively expensive to access cross-country via the regular telephone network, which made it hard for such services to expand beyond local markets. A few larger services firms (Tymshare, for example) built their own internal networks, but commercial packet networks brought the costs down to a reasonable level for users of smaller services. The first such network came about via a defection of ARPANET experts. In 1972, several employees left Bolt, Beranek, and Newman (BBN), the company in charge of ARPANET’s construction and operation, to form Packet Communications, Inc. Though that company ultimately failed, the sudden shock catalyzed BBN to form its own private network, called Telenet. With Larry Roberts, the architect of ARPANET, at its helm, Telenet operated successfully for five years before being acquired by GTE. Given this explosion of network diversity, how could Licklider and Taylor’s vision of single unified system ever come about? Even were it organizationally feasible to simply merge all of these systems into ARPANET – which of course it was not – the incompatibilities among their protocols would have made it a technical impossibility. Yet ultimately these many heterogeneous networks (and their descendants) did interlink, into a confederated communication system that we know as the Internet. It began not with any grand, global plan, but with an obscure research project run by a middle-ranking ARPA manager named Robert Kahn. Bob Kahn’s Problem Kahn completed a Ph.D. thesis on electronic signal processing at Princeton in 1964, in between rounds of golf on the links adjacent to the Graduate College. After a brief stint as a professor at MIT, he took a position nearby at BBN, initially intending a short leave of absence to immerse himself in industry and learn how practical men decided which research problems were worthy of investigation. His pursuits at BBN, fortuitously, included research into the possible behavior of computer networks, for it was just a short time later that BBN received the bid request for ARPANET. Kahn became absorbed in the project, providing the bulk of the design for the system’s network architecture. Kahn’s profile photo from a 1974 paper His short leave of absence became a six-year stint, with Kahn serving as the networking expert at BBN for the duration of the ramp up of ARPANET into its fully operational state. By 1972, however, he was tired of the topic, and, more importantly, tired of being buffeted by the constant politicking and jostling for advantage among the BBN division heads. So he accepted an offer from Larry Roberts (before Roberts himself had left for Telenet) to become a program manager at ARPA, heading a research program to develop automated manufacturing technology, with potentially hundreds of millions in funding at his command. He washed his hands of ARPANET and set off south for a clean start in a green field. Then, within months of his arrival in Washington D.C., Congress quashed the automated manufacturing project. Kahn wanted to pack up and return to Cambridge immediately, but Roberts convinced him to stay on to help develop new networking projects for ARPA. And so Kahn, unable to escape the bonds of his own expertise, found himself managing PRNET, a packet radio network intended to bring the benefits of packet-switched networks to the operational military in the field. The PRNET project, launched under the auspices of Stanford Research Institute (SRI), was intended to extend the basic technical kernel of packet broadcasting from ALOHANET to support repeaters and multiple stations, including mobile vans. However, it was obvious to Kahn early on that the network by itself would be sorely lacking in utility, for it was a computer network with scarcely any computers. When it became operational in 1975, it consisted of one computer at SRI and four repeater stations positioned around the San Francisco Bay. Mobile field stations could not economically support the size and power requirements of a 1970s mainframe. All of the significant computing resources available resided in the ARPANET, which used a totally different set of protocols and had no way of interpreting a message broadcast on PRNET. How, he began to wonder, could his infant network be interlinked with its far more mature cousin? Kahn turned to an old acquaintance from the early ARPANET days for help in crafting the answer. VintonCerf had gotten interested in computers as a math undergraduate at Stanford, and decided to go back to grad school in computer science at UCLA after a couple years at IBM’s Los Angeles office. He arrived in 1967, and, with his old high school friend Steve Crocker, joined Len Kleinrock’s Network Measurement Center, the UCLA branch of ARPANET. There he and Crocker became experts in protocol design, as leading voices in the Network Working Group, which developed both the base Network Control Program (NCP) for sending messages on ARPANET and the higher level file transfer and remote login protocols. Cerf’s profile photo as a Stanford professor from a 1974 paper Cerf met Kahn in early 1970, when the latter flew out the UCLA from BBN to put the network through its paces with some load testing. He generated congestion in the network with the help of software built by Cerf for generating artificial traffic. As Kahn had expected, the network collapsed under the stress, and he recommended changes to improve congestion control. In the ensuing years, Cerf continued on with what looked like a promising academic career. Around the same time that Kahn decamped from BBN for Washington D.C., Cerf traveled up the opposite coast, to take up an assistant professorship at Stanford. Kahn knew a lot about computer networks, but had no experience with the details of protocol design – he was a signals processing guy, not a computer scientist. He knew Cerf would be perfect to supply those skills, which would be crucial to any attempt to link ARPANET and PRNET. Kahn reached out to him about inter-networking, and they met several times throughout 1973 before holing up at the Cabana Hyatt in Palo Alto to produce their seminal paper, “A Protocol for Packet Network Intercommunication,” published in the May 1974 issue of IEEE Transactions on Communications. It presented the design for a Transmission Control Program (TCP) – the P later became protocol – the cornerstone for the software of the modern Internet. Outside Influences Not two people or one moment are more closely identified with the invention of the Internet than Cerf and Kahn and this 1974 paper. Yet, the creation of the Internet was not truly an event that happened at a point in time, but a process that unfolded over years of development. The initial protocol described in Cerf and Kahn’s 1974 paper was tweaked and revised numerous times over the ensuing years. Not until 1977 was the first cross-network link tested; the protocol was not split into two layers – the now-ubiquitous TCP and IP – until 1978; and ARPANET did not adopt it for its own use until 1982.1 The participants in that process of invention extended well beyond the two most well-known principals. In the early years, an organization called the International Packet Network Working Group (INWG) served as the main venue for their collaboration. ARPANET debuted to the wider technical world in October 1972, at the first International Conference on Computer Communications, amid the swooping curves of the modernist Washington Hilton. In addition to Americans like Cerf and Kahn, several prominent European network experts attended, among them Louis Pouzin of France and Donald Davies from the U.K. At the instigation of Larry Roberts, they decided to form an international working group to discuss packet-switching systems and protocols, modeled on the Network Working Group that established the protocols for ARPANET. Cerf, a newly minted Stanford professor, agreed to serve as chair.  One of the first topics that this new International NWG took up was the problem of inter-networking. Among the important early contributors to this discussion was Robert Metcalfe, whom we previously met as the architect of Xerox PARC’s Ethernet. Though Metcalfe could not say so to any of his colleagues, by the time of the publication of Cerf and Kahn’s paper,  he and his colleagues were already well underway with the design of their own internet protocol, the PARC Universal Packet, or PUP. The need for an internet at Xerox became pressing as soon as the Alto/Ethernet network became a success. PARC had another other local network, of Data General Nova minicomputers, and there was ARPANET, of course. Looking further in the future, the PARC leadership foresaw that every Xerox site would need its own Ethernet, and these would need to be connected in some fashion (probably via Xerox’s own internal ARPANET equivalent). To enable it to masquerade as an ordinary message, the PUP packet nestled within the outer packet of whatever host network it was travelling across – the PARC Ethernet, say. When the packet reached the gateway computer between Ethernet and another net (e.g., ARPANET), that computer would unwrap the PUP packet, read its address, and re-wrap it in an ARPANET packet with the appropriate headers to send it onward to its destination. Though Metcalfe could not directly disclose what Xerox was up to, the practical experience he had acquired there inevitably trickled back into INWG discussions, in filtered form. Evidence of his influence survives in the fact that Cerf and Kahn’s 1974 paper recognizes his contribution, and Metcalfe would later show a glimmer of resentment that he did not rate the recognition of co-authorship2. PUP likely affected the design of the modern Internet again later in the 1970s, when Jon Postel instigated the decision to split TCP and IP in order to avoid having to run the intricate TCP protocol on the gateways between networks. IP (Internet Protocol) was a simplified addressing protocol with none of TCP’s complex logic for ensuring the delivery of every bit. The Xerox networking protocol, – by then publicly known and rechristened as Xerox Network Systems (XNS), had already made the same division. Another source of influence on the early internet protocols came from Europe, especially from a network developed in the early 1970s, as an offshoot of Plan Calcul, a program set in motion by Charles de Gaulle to nurture a native French computing industry. De Gualle had long been concerned about America’s growing political, commercial, financial and cultural dominance of Western Europe. He aimed to re-establish France as an independent world power, rather than a pawn in the great Cold War game between the U.S. and the Soviet Union. Two events in the 1960s particularly threatened that independence with respect to the computer industry. First, the United States refused export licenses on its most powerful computers, which France intended to use to aid in the design of its own hydrogen bomb. Second, an American company, General Electric, became the majority owner of France’s only major manufacturer of computing machinery – Compagnie des Machines Bull3 – and then shortly thereafter discontinued several major Bull product lines. Hence the Plan Calcul, to ensure that France could provide for its own computing needs. To oversee Plan Calcul, De Gaulle created the délégation à l’informatique (roughly translated, the “delegation on computing”), reporting directly to his Prime Minister. In early 1971, that delegation selected an engineer by the name of Louis Pouzin to oversee the creation of a french ARPANET. The delegation believed that packet networks would play a crucial role in computing in the coming years, and so native technical expertise in that field would be essential to Plan Calcul’s success. Pouzin at a conference in 1976. Pouzin, a graduate of the École Polytechnique, the premier engineering school for all of France, had worked as a young engineer for France’s national telephone equipment manufacturer, and then moved to Bull. There he convinced his employers that they needed to know more about the cutting edge work happening in the United States. So he spent two-and-a-half years while a Bull employee, from 1963 to 1965, helping to build the Compatible Time-Sharing System (CTSS) at MIT. This experience made him the foremost expert on time-shared, interactive computing in all of France – likely on the entire European continent. Architecture of the Cyclades network Pouzin called the network he was tasked to build Cyclades, after a constellation of Greek islands in the Aegean Sea. Like its namesake, each computer on the network was, to a large extent, an island entire of itself. For Cyclades’ primary contribution to networking technology was the concept of a datagram, the simplest possible variety of packet communication. The idea consisted of two complementary parts: Datagrams are independent: Unlike the data in a telephone call or an ARPANET message, each datagram can be processed independently. There is no reliance on any prior messages, whether based on ordering or some protocol for establishing a connection (e.g. dialing a phone number). Datagrams are host-to-host: All responsibility for ensuring a message is sent reliably to a destination rests with the sender and receiver, not with the network, which is merely a “dumb” pipe. The datagram concept was anathema to Pouzin’s peers at the French post, telegraph and telephone authority (PTT), which was building its own network in the 1970s based on telephone-like circuit connections and terminal-to-computer  (rather than computer-to-computer) communication, under the supervision of another Polytechnique grad, Rémi Després. Culturally, the idea of giving up on reliability within the network was repellent to the PTT mindset, molded by decades of experience in trying to make the telephone and telegraph systems as robust as possible. While economically and politically, the idea of surrendering control of all applications and services to host computers at the periphery of the network threatened to make the PTT into nothing but a fungible commodity. Nothing works better to deeply entrench one’s opinions than firm resistance to them, however, and so the needling presence of the PTT’s virtual circuits only helped to confirm Pouzin in the correctness of his datagram, host-to-host approach to protocols. Pouzin and his fellow Cyclades engineers participated actively in INWG and the various conferences where the ideas behind TCP were hashed out, and they were not shy about putting forth their opinions on how a network of networks should function. Like Metcalfe, both Pouzin and his colleague Hubert Zimmerman earned mentions in the 1974 TCP paper, and at least one other coleague, an engineer by the name of Gerard Le Lann also helped Cerf with hashing out the protocols. Cerf later recalled that “the sliding window flow control for TCP came straight out of discussions with Louis Pouzin and his people… I remember Bob Metcalfe and Le Lann and I sort of lying down of the living room in my house in Palo Alto on this giant piece of paper, trying to sketch what the state diagrams were for these protocols.”4 The datagram concept mapped neatly onto the behavior of broadcast networks like Ethernet and ALOHANET, which sent their messages willy-nilly into a noisy, uncaring ether (in contrast to the more telephonic ARPANET, which required in-order delivery between IMPs across a reliable AT&T line to function). It made sense to align the protocols for inter-networking with the lowest-common-denominator datagram-like networks rather than their more elaborate cousins, and indeed that is just what Kahn and Cerf’s TCP did. I could continue still further in this vein, by describing the British role in the early inter-networking conversations, but I don’t wish to belabor the point – that the two names most closely tied to the invention of the Internet are not the only ones that mattered. TCP Conquers All What happened, then, to this early promise of inter-continental collaboration? How is it that Cerf and Kahn are hailed everywhere as the fathers of the Internet, yet we hear very little about Pouzin and Zimmerman? To understand this requires, for starters, getting down into the procedural weeds of the INWG’s early years. In keeping with the spirit established by the ARPA network working group and its Requests for Comment (RFCs), the INWG created its own system of “General Notes.” In keeping with this practice, after about a year of collaborative work, Kahn and Cerf presented the preliminary version of TCP to the IWNG as note 39 in September 1973. This was effectively the same document that they published in IEEE Transactions the following spring. In April 1974 the Cyclades team, under the authorship of  Hubert Zimmerman and Michel Elie, published a counterproposal, designated INWG 61. The differences consisted in different views on certain engineering trade-offs, mainly around how packets are subdivided and re-assembled when crossing networks with small maximum packet sizes. This rift was minor, but the need to settle on a consensus had acquired a sudden urgency due to the plans announced by the Comité Consultatif International Téléphonique et Télégraphique (CCITT) to consider packet networking standards. CCITT, the standardization body of the International Telecommunications Union, operated on a four year cycle of Plenary Assemblies. Proposals for consideration in the 1976 assembly were due in the fall of 1975, and no further changes would be possible between then and the next assembly in 1980. A scramble of meetings within INWG led up to a final vote in favor of a new protocol drafted by the representatives of the most important institutions in the world of computer networking – Cerf from ARPANET, Zimmerman from Cyclades, Roger Scantlebury from the British National Physical Laboratory, and Alex McKenzie of BBN. The new proposal, INWG 96, split the difference between 39 and 61, and seemed likely to establish the direction for network interconnection for the foreseeable future. But in truth, the compromise proved the last gasp of international collaboration in inter-networking, a fact foreshadowed by the ominous abstention of Bob Kahn from the INWG vote on whether to accept it. As it happened, the vote came too late to make the CCITT deadline, and Cerf further undermined its standing at CCITT with a cover letter indicating that it lacked the full consensus support of the INWG. Any proposal from INWG was likely dead-on-arrival anyway, because the telecom authorities that dominated CCITT had no interest in the datagram networks being cooked up by computer researchers. They wanted to control the flow of traffic within the network, not delegate that power to host computers that they didn’t control. Instead they ignored inter-networking altogether, and agreed on a single-network virtual circuit protocol designated X.255 The Europeans, led especially by Zimmerman, made another try via a different standards body, one less dominated by the power of the telecom authorities, the International Organization for Standardization (ISO). The Open Systems Interconnection (OSI) standard that resulted had some technical advantages over TCP/IP. Notably, it lacked IP’s limited and hierarchical addressing system, whose limitations required several cheap hacks to allow for the explosive growth of the Internet in the 1990s6. But for a number of reasons, the process dragged out interminably without producing working software. For one thing, ISO’s processes, well-suited to blessing already established technical practices, were not appropriate for still-nascent technology. Once the TCP/IP Internet took off in the early 1990s, OSI became irrelevant. So much for the arena of standards setting, but what about the on-the-ground practicality of network-building? The Europeans began earnestly working on an implementation of INWG 96 to link Cyclades and the National Physical Laboratory, as part of the the European Informatics Network. But Kahn and the other leaders of the ARPA Internet project did not really care to derail the TCP train for the sake of international collaboration. Kahn had already disbursed funds for TCP implementations on ARPANET and PRNET, and he didn’t want to start over. Cerf made an attempt to rally support in the U.S. for the compromise he had forged at the INWG, but finally gave up on it. He also gave up on the stresses of life as an assistant professor, following Kahn’s footsteps to become a program manager at ARPA and withdrawing from active participation in the INWG. Why was the desire of the Europeans to establish a unified front and an official, global standard so weakly requited? The primary reason lay in the relative position of the American and European telecom authorities. The Europeans had to face constant pressure against the datagram model from the post and telecom authorities (the PTTs), which operated as administrative departments within their national governments. Because of these pressures, they had a much stronger incentive to care about building a consensus within the official standards-making processes. The rapid demise of Cyclades, which fell out of political favor in 1975 and lost all funding in 1978, provides a case study in the power of the PTTs. Pouzin blamed Cyclades’ death on the administration of Valéry Giscard d’Estaing. d’Estaing came to power in 1974, and set up a government peopled with École nationale d’administration (ENA) types, whom Pouzin disdained – if Polytechnique was something like the MIT of France, ENA was its Harvard Business School. d’Estaing’s administration focused French information technology policy around the idea of “national champions,” and a national champion computer network required the backing of the PTT. Cyclades could never acquire that support; instead Pouzin’s rival Després led the construction of a virtual-circuit X.25 network called Transpac. The situation in the United States was quite different. A&T did not have the political leverage of its international peers, not being part of the American administrative state,  On the contrary, it was in fact in the process of being heavily constrained and weakened by that state, barred from interference in computer networking and computer services, and soon to be be dismantled entirely. ARPA could proceed with its Internet program under the umbrella of protection from the powerful Department of Defense, without any adverse political pressure. It funded TCP implementations on a variety of computers, and used its leverage to force all of the hosts on ARPANET itself to convert to the new protocol in 1983. The most influential computing network in the world, many of whose nodes happened to be the most influential academic computing institutions in the world, thus became a TCP/IP shop. TCP/IP thus became the foundation stone of the Internet, and not just an internet, because of the relative political and financial freedom of ARPA compared to any other computer networking organization. OSI notwithstanding, ARPA became the dog, and the rest of the network research community the indignant tail. From the perspective of 1974, one can clearly see the many lines of influence that led into Cerf and Kahn’s TCP paper, and the many potential avenues of international development that might have followed from it. But from the perspective of 1995, all roads led backward to one seminal moment, one American organization, and two revered names. [Previous] [Next] Further Reading Janet Abbate, Inventing the Internet (1999) John Day, “The Clamor Outside as INWG Debated,” IEEE Annals of the History of Computing  (2016) Andrew L. Russell, Open Standards and the Digital Age (2014) Andrew L. Russell and Valérie Schafer, “In the Shadow of ARPANET and Internet: Louis Pouzin and the Cyclades Network in the 1970s,” Technology and Culture (2014)        

Read more
ARPANET, Part 1: The Inception

By the mid-1960s, the first time-sharing systems had already recapitulated the early history of the first telephone exchanges. Entrepreneurs built those exchanges as a means to allow subscribers to summon services such as a taxi, a doctor, or the fire brigade. But those subscribers soon found their local exchange just as useful for communicating and socializing with each other1. Likewise time-sharing systems, initially created to allow their users to “summon” computer power, had become communal switchboards with built-in messaging services2. In the decade to follow, computers would follow the next stage in the history of the telephone – the interconnection of exchanges to form regional and long-distance networks. The Ur-Network The first attempt to actually connect multiple computers into a larger whole was the ur-project of interactive computing itself, the SAGE air defense system. Because each of the twenty-three SAGE direction centers covered a particular geographical area, some mechanism was needed for handing off radar tracks from one center to another when incoming aircraft crossed a boundary between those areas. The SAGE designers dubbed this problem “cross-telling,” and they solved it by building data links on dedicated AT&T phone lines among all the neighboring direction centers. Ronald Enticknap, part of a small Royal Air Force delegation to SAGE, oversaw the design and implementation of this subsystem. Unfortunately, I have found no detailed description of the cross-telling function, but evidently each direction center computer determined when a track was crossing into another sector and sent its record over the phone line to that sector’s computer, where it could be picked up by an operator monitoring a terminal there3. The SAGE system’s need to translate digital data into an analog signal over the phone line (and then back again at the receiving station) occasioned AT&T to develop the Bell 101 “dataset”, which could deliver a modest 110 bits per second. This kind of device was later called a “modem”, for its ability to modulate the analog telephone signal using an outgoing series of digital data, and demodulate the bits from the incoming wave form. SAGE  thus laid some important technical groundwork for later computer networks. The first computer network of lasting significance, however, is one whose name is well known even today: ARPANET. Unlike SAGE, it connected a diverse set of time-shared and batch-processing hardware each with its own custom software, and was intended to be open-ended in scope and function, fulfilling whatever purposes users might desire of it. ARPA’s section for computer research – the Information Processing Techniques Office (IPTO) –  funded the project under the direction of Robert Taylor, but the idea for such a network sprang from the imagination of that office’s first director, J.C.R. Licklider. The Vision As we learned earlier, Licklider, known to his colleagues as ‘Lick,’ was a psychologist by training. But he became entranced with interactive computing while working on radar systems at Lincoln Laboratory in the late 1950s. This passion led him to fund some of the first experiments in time-shared computing when he became the director of the newly-formed IPTO, a position he took in 1962. By that time, he was already looking ahead to the possibility of linking isolated interactive computers together into a larger superstructure. In his 1960 paper on “man-computer symbiosis”, he wrote that [i]t seems reasonable to envision …a ‘thinking center’ that will incorporate the functions of present-day libraries together with anticipated advances in information storage and retrieval and the symbiotic functions suggested earlier in this paper. The picture readily enlarges itself into a network of such centers, connected to one another by wide-band communication lines and to individual users by leased-wire services. Just as the TX-2 had kindled Licklider’s excitement over interactive computing, it may have been the SAGE computer network that prompted Licklider to imagine that a variety of interactive computing centers could be connected together to provide a kind of telephone network for intellectual services. Whatever its exact origin, Licklider began disseminating this vision among the community of researchers that he had created at IPTO, most famously in his memo of April 23, 1963, directed to the “Members and Affiliates of the Intergalactic Computer Network,” that is to say the various researchers receiving IPTO funding for time-sharing and other computing projects. The memo is rambling and shambolic, evidently dictated on the fly with little to no editorial revision. Determining exactly what Licklider intended it to say about computer networks therefore requires some speculative inference. But several significant clues stand out. First, Licklider revealed he sees the “various activities” funded by IPTO as in fact belonging to a single “overall enterprise.”  He follows this pronouncement by discussing the need to allocate money and projects to maximize the advantage accruing to that enterprise, as network of researchers as a whole, given that, “to make progress, each of the active researchers needs a software base and a hardware facility more complex and more extensive than he, himself, can create in reasonable time.” To achieve this global efficiency might, Licklider conceded, requires some individual concessions and sacrifices by certain parties. Then Licklider began to explicitly discuss computer (rather than social) networks. He wrote of the need for some sort of network control language (what would later be called a protocol) and his desire to eventually see an IPTO computer network consisting of “..at least four large computers, perhaps six or eight small computers, and a great assortment of disc files and magnetic tape units–not to mention the remote consoles and teletype stations…” Finally, he spent several pages laying out a concrete example of how a future interaction with such a computer network might play out. Licklider imagines a situation where he is running an analysis on some experimental data. “The trouble is,” he writes, “I do not have a good grid-plotting program. …Is there a suitable grid-plotting program anywhere in the system? Using prevailing network doctrine, I interrogate first the local facility, and then other centers. Let us suppose that I am working at SDC, and that I find a program that looks suitable on a disc file in Berkeley.” He asks the network to execute this program for him, assuming that, “[w]ith a sophisticated network-control system, I would not decide whether to send the data and have them worked on by programs somewhere else, or bring in programs and have them work on my data.” Taken together, these fragments of thought appear to reveal a larger scheme in Licklider’s mind: first, to parcel out particular specialties and areas of expertise among IPTO-funded researchers, and then to build beneath that social community a physical network of IPTO computers. This physical instantiation of IPTO’s “overall enterprise” would allow researchers to share in and benefit from the specialized hardware and software resources at each site. Thus IPTO would avoid wasteful duplication while amplifying the power of each funding dollar by allowing every researcher to access the full spectrum of computing capabilities across all of IPTO’s projects. This idea, of resource-sharing among the research community via a communications network, sowed the seeds within IPTO that led, several years later, to the creation of ARPANET. Despite its military provenance, originating as it did in the halls of the Pentagon, ARPANET thus had no real military justification. It is sometimes said that the network was designed as a war-hardened communications network, capable of surviving a first-strike nuclear attack. There is a loose connection, as we’ll see later, between ARPANET and an earlier project with that aim, and ARPA’s leaders occasionally trotted out the “hardened systems” idea to justify their network’s existence before Congress or the Secretary of Defense. But in truth, IPTO built ARPANET purely for its own internal purposes, to support its community of researchers – most of whom themselves lacked any direct defense justification for their activities. Meanwhile, by the time of his famous memo Licklider had already begun planning the germ of his intergalactic network, to be led by Len Kleinrock at UCLA. The Precursors Kleinrock, the son of working class immigrants from Eastern Europe, grew up in Manhattan in the shadow of the George Washington Bridge. He worked his way through school, taking evening sessions at City College to study electrical engineering. When he heard about a fellowship opportunity for graduate study at MIT, capped by a semester of full time work at Lincoln Lab, he jumped at the opportunity. Though built to serve the needs of SAGE, Lincoln had since diversified into many other research projects, often tangentially related to air defense, at best. Among them was the Barnstable Study, a concept floated by the Air Force to create an orbital belt of metallic strips (similar to chaff) to use as reflectors for a global communication system4. Kleinrock had fallen under the spell of Claude Shannon at MIT, and so decided to focus his graduate work on the theory of communication networks. The Barnstable Study provided Kleinrock with his first opportunity to apply the tools of information and queuing theory to a data network, and he extended that analysis into a full dissertation on “communications nets,” combining his mathematical analysis with empirical data gathered by running simulations on Lincoln’s TX-2 computers. Among Kleinrock’s close colleagues at Lincoln, sharing time with him in front of the TX-2, were Larry Roberts and Ivan Sutherland, whom we will meet again shortly. By 1963, Kleinrock had accepted a position at UCLA, and Licklider saw an opportunity – here he had an expert in data networking at a site with three local computer centers: the main computation center, the health sciences computer center, and the Western Data Processing Center (a cooperative of thirty institutions with shared access to an IBM computer). Moreover, six of the Western Data Processing Center institutions had remote connections to the computer by modem, and the IPTO-sponsored System Development Corporation (SDC) computer resided just a few miles away in Santa Monica. IPTO issued a contract to UCLA to interconnect these four centers, as a first experiment in computer networking. Later, according to the plan, a connection with Berkeley would tackle the problems inherent in a longer-range data connection. Despite the promising situation, the project foundered and the network was never built. The directors of the different UCLA centers didn’t trust one other, nor fully believe in the project, and they refused to cede control over their computing resources to one another’s users. IPTO had little leverage to influence the situation, since none of the UCLA computing centers were funded directly by ARPA5. IPTO’s second try at networking proved more successful, perhaps because it was significantly more limited in scope – a mere experimental trial rather than a pilot plant. In 1965, a psychologist and disciple of Licklider’s named Tom Marill left Lincoln Lab to try to profit from the excitement around interactive computing by starting his own time-sharing business. Lacking much in the way of actual paying customers, however, he began casting about for other sources of income, and thus proposed that IPTO fund him to carry out a study of computer networking. IPTO’s new director, Ivan Sutherland, decided to bring a larger and more reputable partner on board  as ballast, and so sub-contracted the work to Marill’s company via Lincoln Lab. Heading things from the Lincoln side would be another of Kleinrock’s old office-mates, Lawrence (Larry) Roberts. Roberts had cut his teeth on the Lincoln-built TX-0 as an undergrad at MIT. He spent hours each day entranced before the glowing console screen, eventually constructing a program to (badly) recognize written characters using neural nets. Like Kleinrock he ended up working at Lincoln for his graduate studies, solving computer graphics and computer vision problems, such as edge-detection and three-dimensional rendering, on the larger and more powerful TX-2. Up until late 1964, Roberts had remained entirely focused on his imaging research. Then he came across Lick. In November of that year, he attended an Air Force-sponsored conference on the future of computing at the Homestead hot springs resort in western Virginia. There he talked late into the night with his fellow conference participants, and for the first time heard Lick expound on his idea for an Intergalactic Network. Roberts began to feel a tickle at the back of his brain – he had done great work on computer graphics, but it was in effect trapped on the one-of-a-kind TX-2. No one else could use his software, even if he had way to provide it to them, because no one else had equivalent hardware to run it on. The only way to extend the influence of his work was to report on it in academic papers in the hopes that others would and could replicate it elsewhere. Licklider was right, he decided, a network was exactly the next step needed to accelerate computing research. And so Roberts found himself working with Marill, trying to connect the Lincoln TX-2 with a cross-country link to the SDC computer in Santa Monica, California. In an experimental design that could have been ripped straight from Licklider’s “Intergalactic Network” memo, they planned to have the TX-2 pause in the middle of a computation, use an automatic dialer to remotely call the SDC Q-32, invoke a matrix multiply program on that computer, and then continue the original computation with the answer. Setting aside the basic sensibility of using dearly-bought cutting-edge technology to span a continent in order to use a basic math routine, the whole process was painfully slow due to the use of the dial telephone network. To make a telephone call required setting up a dedicated circuit between the caller and recipient, usually routed through several different switching centers. As of 1965, virtually all of these were electro-mechanical6. Magnets shifted metal bars from one place to another in order to complete each step of the circuit. This whole process took several seconds, during which time the TX-2 could only sit idle and wait. Moreover the lines, though perfectly suited for voice conversation, were noisy with respect to individual bits and supported very low bandwidth (a couple hundred bits per second). A truly effective intergalactic, interactive, network, would require a different approach.[^others] The Marill-Roberts experiment had not shown long-distance networking to be practical or useful, merely theoretically possible. But that was enough. The Decision In the middle of 1966, Robert Taylor took over the directorship of IPTO, succeeding Ivan Sutherland as the third to hold that title. A disciple of Licklider and a fellow-psychologist, he came to IPTO by way of a position administering computer research for NASA. Nearly as soon as he arrived, Taylor seems to have decided that the time had come to make the intergalactic network a reality, and it was Taylor who launched the project that produced ARPANET. ARPA money was still flowing freely, so Taylor had no trouble securing the extra funding from his boss, Charles Herzfeld. Nonetheless, the decision carried significant risk of failure. Other than the very limited 1965 cross-country connection, no one had ever attempted anything like ARPANET. One could point to other early experiments in computer networking. For example, Princeton and Carnegie-Mellon set up a network of time-shared computers in the late 1960s in conjunction with IBM.7 The main distinction between these and the ARPA efforts was their uniformity – they used exactly the same computer system hardware and software at each site. ARPANET, on the other hand, would be bound to deal with diversity. By the mid-1960s, IPTO was funding well over a dozen sites, each with its own computer, and each of those computers had a different hardware design and operating software. The ability to share software was rare even among different models from a single manufacturer – only the brand-new IBM System/360 product line had attempted this feat. This diversity of systems was a risk that added a great deal of technical complexity to the network design, but also an opportunity for Licklider-style resource sharing. The University of Illinois, for example, was in the midst of construction on the massive, ARPA-funded ILLIAC IV supercomputer. It seemed improbable to Taylor that the local users at Urbana-Champaign could fully utilize this huge machine. Even sites with systems of more modest scale – the TX-2 at Lincoln and the Sigma-7 at UCLA, for example, could not normally share software due to their basic incompatibilities. The ability to overcome this limitation by directly accessing the software at one site from another was attractive. In the paper describing their networking experiment, Marill and Roberts had suggested that this kind of resource sharing would produce something akin to Ricardian comparative advantage among computing sites: The establishment of a network may lead to a certain amount of specialization among the cooperating installations. If a given installation, X, by reason of special software or hardware, is particularly adept at matrix inversion, for example, one may expect that users at other installations in the network will exploit this capability by inverting their matrices at X in preference to doing so on their home computers.[^ricardo] Taylor had one further motivation for proceeding with a resource-sharing network. Purchasing a new computer for each new IPTO site, with all the capabilities that might be required by the researchers at that site, had proven expensive, and as one site after another was added to IPTO’s portfolio, the budget for each was becoming thinly stretched. By putting all the IPTO-funded systems onto a single network, it might be possible to supply new grantees with more limited computers, or perhaps even none at all. They could draw whatever computer power they needed from a remote site with excess capacity, the network as whole acting as a communal reservoir of hardware and software. Having launched the project and secured its funding, Taylor’s last notable contribution to ARPANET was to select someone to actually design the system and see it through to completion. Roberts was the obvious choice. His engineering bona fides were impeccable, he was already a respected member of the IPTO research community, and he was one of of a handful of people with hands-on experience designing and building a long-distance computer network. So in the fall of 1966, Taylor called Roberts to ask him to come down from Massachusetts to work for ARPA in Washington. But Roberts proved difficult to entice. Many of the IPTO principal investigators cast a skeptical eye on the reign of Robert Taylor, whom they viewed as something of a lightweight. Yes, Licklider had been a psychologist too, with no real engineering chops, but at least he had a doctorate, and a certain credibility earned as one of the founding fathers of interactive computing. Taylor was an unknown with a mere master’s degree. How could he oversee the complex technical work going on within the IPTO community? Roberts counted himself among these skeptics. But a combination of stick and carrot did their work. On the one hand Taylor exerted a certain pressure on Roberts’ boss at Lincoln, reminding him that a substantial portion of his lab’s funding now came from ARPA, and that it would behoove him to encourage Roberts to see the value in the opportunity on offer. On the other hand, Taylor offered Roberts the newly-minted title of “Chief Scientist”, a position that would report over Taylor’s head directly to a Deputy Director of ARPA, and mark Roberts as Taylor’s successor to the directorship. On these terms Roberts agreed to take on the ARPANET project.8 The time had come to turn the vision of resource-sharing into reality. [previous] [next] Further Reading Janet Abbate, Inventing the Internet (1999) Katie Hafner and Matthew Lyon, Where Wizards Stay Up Late (1996) Arthur Norberg and Julie O’Neill, Transforming Computer Technology: Information Processing for the Pentagon, 1962-1986 (1996) M. Mitchell Waldrop, The Dream Machine: J.C.R. Licklider and the Revolution That Made Computing Personal (2001)  

Read more