Condemned to repeat it?

Apparently, 15 years is just long enough to prove the worth of Santayana's famous saying ("Those who cannot remember the past are condemned to repeat it").

An interesting story in this weekend's San Francisco Chronicle: How tech became the enemy - then and now.

The flyer tucked on the windshield of a tech worker's car on South Van Ness didn't mince words: "The Mission has been colonized by pigs with money. ... They help landlords drive up rents, pushing working and poor people out of their homes."

The leaflet urged people to key the cars of wealthy new transplants: "Take action now!"

The year was 1999.

San Francisco, of course, is one of the few places I know of, outside Manhattan, that have some sort of rent control, and a lot of this current struggle turns out to be about money, behind the scenes:

Meanwhile, 31-year-old housing activist Erin McElroy was struggling to get the media to link housing and tech. Evictions performed using the Ellis Act peaked in 2000, and though they've risen sharply in the recent years - surging 81 percent last year alone - they haven't returned to the levels of the dot-com boom. But McElroy said more landlords were turning to buyouts and tenant harassment to get units back on the market. And she blamed it on tech money.

There are lots of things you can criticize the new tech giants for: kow-towing to the NSA, selling our personal information to marketers and advertisers, building corporate fortunes on the backs of deeply poor Asian factory workers, etc.

But it's hard to see them as the devil for providing high-paying, interesting, safe, productive jobs for young people.

I guess that's why I have trouble feeling much outrage for companies who provide safe transit for their employees.

Over here in the East Bay, I'm kind of out of the argument (though we have plenty of Google Buses here), so maybe I'm missing the whole point.

Am I? Drop me a line and let me know.

Stuff I'm reading, March Madness edition

My bracket is a shambles ... Mercer?

But here's some madness of a different sort:

• Brief History of Latency: Electric Telegraph

  Brief look at the history of the electric telegraph - how it came to be, how it was used, and the early problems it encountered. Namely, networking congestion, which was caused by routing and queuing delays!

• Denial of Service Attacks

  Over the last year, we have seen a large number and variety of denial of service attacks against various parts of the GitHub infrastructure. There are two broad types of attack that we think about when we're building our mitigation strategy: volumetric and complex.

  We have designed our DDoS mitigation capabilities to allow us to respond to both volumetric and complex attacks.

• Go Concurrency Patterns: Pipelines and cancellation

  Go's concurrency primitives make it easy to construct streaming data pipelines that make efficient use of I/O and multiple CPUs. This article presents examples of such pipelines, highlights subtleties that arise when operations fail, and introduces techniques for dealing with failures cleanly.

• Marginally Useful

  But while it may be wishful thinking to imagine Bitcoin as a true currency, it’s a highly functional and effective technology. Bitcoin’s “block chain protocol” is built atop well-understood, established cryptographic standards and allows perfect certainty about which transactions occurred when.

• Hack

  Hack is a programming language for HHVM that interoperates seamlessly with PHP. Hack reconciles the fast development cycle of PHP with the discipline provided by static typing, while adding many features commonly found in other modern programming languages.

  Hack provides instantaneous type checking via a local server that watches the filesystem. It typically runs in less than 200 milliseconds, making it easy to integrate into your development workflow without introducing a noticeable delay.

• Facebook Introduces ‘Hack,’ the Programming Language of the Future

  Facebook engineers Bryan O’Sullivan, Julien Verlaguet, and Alok Menghrajani spent the last few years building a programming language unlike any other.

  Working alongside a handful of others inside the social networking giant, they fashioned a language that lets programmers build complex websites and other software at great speed while still ensuring that their software code is precisely organized and relatively free of flaws — a combination that few of today’s languages even approach. In typical Facebook fashion, the new language is called Hack, and it already drives almost all of the company’s website — a site that serves more than 1.2 billion people across the globe.

• Facebook VP of Engineering on Solving Hard Things Early

  Building great products is hard enough without allowing the ease of early management to fool founders into thinking they invented something new. Build great management, train new managers, and introduce sustainable, scalable structure now. Do not wait until world-class managers and radical re-orgs are needed to fix poor information flow or productivity problems.

Skyrim snort for a Friday afternoon

It's not just a game, it's an obsession: The Cheesing of Lydia.

Stuff I'm reading, midweek edition

The weather's great; the snowpack isn't. Meanwhile, I read.

• Leslie Lamport Receives Turing Award

  “Leslie’s schemes for dealing with faults was a major area of investigation in distributed computing,” Levin says. “His work was fundamental there. Then it led to work on agreement protocols, a key part of the notion of getting processes to converge on a common answer. This is what has come to be known as Paxos.”

  Incidently, that work was independently invented at about the same time by Barbara Liskov, Turing Award winner in 2008, and her student Brian Oki.

  “Lamport’s paper [The Part-Time Parliament],” Levin adds, “explained things through the use of a mythical Greek island and its legislative body. Partly because he chose this metaphor, it was not appreciated for quite some time what was really going on there.”

  Lamport has a less diplomatic assessment.

  “With the success of Byzantine Generals, I thought, ‘We need a story.’ I created a story, and that was an utter disaster.

• Surprise! Science!

  Chao-Lin Kuo surprises Andrei Linde and his wife with the news that gravitational waves were detected, proving Linde's theory of an inflationary universe.

• Ernest Cline is the luckiest geek alive

  Cline spent eight years writing Ready Player One before it hit the presses in August 2011. Set in 2044, Cline’s book prophesied a future where everybody’s always plugged in to The Oasis, a virtual world hosting the Earth’s jobs, education, and secrets. Each Oasis user hooks in using a variety of haptic and visual inputs to simulate and stimulate the senses in a virtual world. Ready Player One is indebted to hundreds of other books, games, and films like The Matrix, and it wears them on its shirt-sleeve. Cline’s most original creation yet moved away from Star Wars into a world of his own, a world made out of his favorite things.

• Why Dorian Nakamoto Probably Isn’t Satoshi

  To me, one of the weakest points in Newsweek’s argument is their assertion that Dorian had the skills and background to create Bitcoin. All they really have as evidence is that Dorian trained as a physicist, worked as an engineer, and is reputed to be very intelligent. But none of that indicates that Dorian understood cryptography or distributed algorithms well enough to devise Bitcoin and write the original Bitcoin paper.

• Missed Alarms and 40 Million Stolen Credit Card Numbers: How Target Blew It

  On Saturday, Nov. 30, the hackers had set their traps and had just one thing to do before starting the attack: plan the data’s escape route. As they uploaded exfiltration malware to move stolen credit card numbers—first to staging points spread around the U.S. to cover their tracks, then into their computers in Russia—FireEye spotted them. Bangalore got an alert and flagged the security team in Minneapolis. And then …

  Nothing happened.

  For some reason, Minneapolis didn’t react to the sirens.

• Worse

  This isn’t just an Amazon problem. In the last few years, Google, Apple, Amazon, Facebook, and Twitter have all made huge attempts to move into major parts of each others’ businesses, usually at the detriment of their customers or users.

• managers are awesome / managers are cool when they’re part of your team

  This bothered me a bit when I heard it last summer, and it’s gotten increasingly more uncomfortable since. I’ve been paraphrasing this part of the talk as “management is a form of workplace violence,” and the still-evolving story of Julie Ann Horvath suggests that the removal of one form of workplace violence has resulted in the reintroduction of another, much worse form.

• What Your Culture Really Says

  Culture is not about the furniture in your office. It is not about how much time you have to spend on feel-good projects. It is not about catered food, expensive social outings, internal chat tools, your ability to travel all over the world, or your never-ending self-congratulation.

  Culture is about power dynamics, unspoken priorities and beliefs, mythologies, conflicts, enforcement of social norms, creation of in/out groups and distribution of wealth and control inside companies. Culture is usually ugly. It is as much about the inevitable brokenness and dysfunction of teams as it is about their accomplishments. Culture is exceedingly difficult to talk about honestly. The critique of startup culture that came in large part from the agile movement has been replaced by sanitized, pompous, dishonest slogans.

• Welcome to the Thirsty West

  Don’t get me wrong: This has always been an extreme environment. But over the thousands of years of human civilization in this corner of the world, people have adapted to little water. Problem is: The water supply/demand calculus has never changed this quickly before. About 100 years ago, the balance started to tip. Groundwater was invested for agricultural purposes. Massive civil engineering projects pulled more water from rivers. The human presence in the desert blossomed.

Stuff I'm reading, St Patrick's Day edition

While the corned beef is boiling, take a break, pour yourself a cold green-colored beverage and read.

• Agile Is Dead (Long Live Agility)

  Those four lines and one practice encompass everything there is to know about effective software development. Of course, this involves a fair amount of thinking, and the basic loop is nested fractally inside itself many times as you focus on everything from variable naming to long-term delivery, but anyone who comes up with something bigger or more complex is just trying to sell you something.

• Smart Guy Productivity Pitfalls

  If my pithy advice were little more than "Be more like John Carmack" then I can imagine a lot of readers throwing up their hands and saying "Well, fuck it, I'm a lost cause, because that's not going to happen." But what I can do is relate some of the things that helped me kill off some of my underachieving habits. The point isn't to become a superstar, it's to become better, since that's always the first step.

• The One Problem

  if you speak more than 30% in a conversation, you are boring the other person. If you forget everything I said and just remember to STFU and listen, you have a fair shot at building a product that market wants.

• Good Riddance to Hampton, Florida?

  The town's three staff members resigned in February, and so has the police chief, who at one point was employing 17 officers ("a word loosely applied here," said the Times) for a town of 477 people. The county sheriff said he did not know how many of the 17 were actually police officers or whether any of them were actually trained in radar detection.

• How Sony Makes Music For Your Favorite Games

  Yesterday, I was able to take a tour of Sony's state-of-the-art PlayStation Music Studio at the company's headquarters in San Mateo, Calif., where I met the guys responsible for the music in some of the best games released in the last few years.

• NTP and the Winter of 2013 Network DRDoS Attacks

  The only information that should come in to your network from the outside should be from messages that never have your address as the “sender” — the only place such messages should come from are from within your network. An “ingress” filter at your border would block these forgeries.

• A Plea for Architectural & Specification Stability with IPv6

  excuses for not deploying IPv6 are, to a great extent, just that: excuses. They have no relationship to the actual reason for not deploying it, which is, and has always been, "we see no benefit" (or, to a lesser extent, "our code doesn't support it", and "our code has bugs" -- both of which are temporary). These excuses mislead the IETF into thinking that the lack of IPv6 deployment means that there is somehow something wrong with the protocol. This in turn causes hand-wringing and standards-writing, but in my experience, that doesn't help: when we remove an excuse, people move on to another excuse -- because the excuse wasn't the real reason anyway.

• Using OpenSSH Certificate Authentication

  In 2014 ssh certificates are still a fairly obscure subject, neither widely understood or used. With such an obscure subject, one could almost expect it to be either hard or complex to implement – it is neither hard nor complex, just not well documented.

  The goal of this guide is to show how easy it is to use and manage ssh certificate authentication from small to very large environments in a practical way.

• The Infinite Lives of BitTorrent

  That’s why, among its many definitions and identities, BitTorrent is ultimately a very curious thing: a gigantic question about what startup success should look like. Most startups don’t achieve their world-changing ambitions, but the lucky ones happily settle for being acquired. BitTorrent seems to be stuck in the middle of all this--profitable, but unable to truly ever capitalize on the revolution it unleashed.

Silicon Valley Generation Gap

If you can tear yourself away from obsessing over Malaysia Air Flight 370, there's a fairly well-written article in this weekend's New York Times Magazine by Yiren Lu: Silicon Valley’s Youth Problem (In the printed copy of the magazine, the article is titled: A Tale of Two Valleys).

The article looks at the various ways you can classify the high-tech industry along different axes:

The rapid consumer-ification of tech, led by Facebook and Google, has created a deep rift between old and new, hardware and software, enterprise companies that sell to other businesses and consumer companies that sell directly to the masses.

Although these are all valid ways to discriminate and compare and contrast, the article focuses on a different breakdown, perhaps hinted at slightly by "old and new": young vs old.

This is something I've definitely noticed myself over the last 5 years or so: the times are definitely changing; the people who are building the next products and companies and organizations are a new generation, who literally grew up on the web.

My earliest memories of using a web browser on the Internet are from the summer of 1993 (it was Lynx, a completely text-mode browser, at the time), so we're roughly at the 20th anniversary of the Web, and that means that this year's college graduates probably had graphical web browsers in their homes by the time they were in kindergarden.

Lu's article poses a pretty blunt question to this fresh new generation:

This summer in San Francisco, I’m living with three roommates, also students doing tech internships in the valley, two at Google and one at the news aggregator Flipboard. For better or worse, these are the kinds of companies that seem to be winning the recruiting race, and if the traditional lament at Ivy League schools has been that the best talent goes to Wall Street, a newer one is taking shape: Why do these smart, quantitatively trained engineers, who could help cure cancer or fix healthcare.gov, want to work for a sexting app?

It's a great question, and it makes me think of Steve Yegge's equally blunt keynote at the 2011 OSCON, in which Yegge challenges his audience to stop making "cat-picture webapps," and consider doing work that matters.

But back to Lu's article, which goes on to wonder whether we're getting what we reward:

as a group, my peers feel more restless, more constantly in search of the next big thing — in part because start-ups select for and reward these impulses, which also spur the successive exoduses from Yahoo to Google, from Google to Facebook, from Facebook to younger, hipper companies.

It does seem like it's more than just "the bubble is back." Lu, who did her undergraduate work at Harvard, has been watching the recent explosion in interest first-hand:

Tech hasn’t been pedestrianized — it’s been democratized. The doors to start-up-dom have been thrown wide open. At Harvard, enrollment in the introductory computer-science course, CS50, has soared. Last semester, 39 percent of the students in the class were women, and 73 percent had never coded before.

(I'm not sure if that's 73 percent of the women, or 73 percent of the students in the class, but either way it's a bit surprising that it's still the case that so many people are just getting into programming when they arrive at college.)

One of the watershed changes that Lu highlights is clearly a recent development: computer technology has become so advanced and powerful and inexpensive and straightforward to deploy that it's no longer necessary that a technology company be all about technology. In fact, modern "technology" companies are increasingly not about technology at all. Lu notes:

Recently, an engineer at a funded-to-the-gills start-up in San Francisco texted me to grumble about his company’s software architecture. Its code base was bug-ridden and disorganized — yet the business was enjoying tremendous revenue and momentum. “Never before has the idea itself been powerful enough that one can get away with a lacking implementation,” he wrote. His remark underscores a change wrought by the new guard that the old guard will have to adapt to. Tech is no longer primarily technology driven; it is idea driven.

But of course, much of it is not even idea-driven, it is driven by an older story, one that is all too familiar, one that could have been written by Fitzgerald or Salinger 75 years ago, or even by Dickens or Bronte 75 years before that:

One of Stripe’s founders rowed five seat in the boat I coxed freshman year in college; the other is his older brother. Among the employee profiles posted on its website, I count three of my former teaching fellows, a hiking leader, two crushes. Silicon Valley is an order of magnitude bigger than it was 30 years ago, but still, the start-up world is intimate and clubby, with top talent marshaled at elite universities and behemoths like Facebook and Google. These days, a new college graduate arriving in the valley is merely stepping into his existing network. He will have friends from summer internships, friends from school, friends from the ever-increasing collection of incubators and fellowships. His transition will be smoothed by a hefty relocation package and cheerful emails from the young female H.R. staff at his hot web-consumer start-up.

Worse than the clubbiness, it's the incessant need to be trendy and hip that seems oh so incredibly depressing and shallow:

Young people like to be among young people; they like to work on products (consumer brands) that their friends use and in environments where they feel acutely the side effects of growth.

...

to a software engineer in his 20s, with endless opportunities, what matters most is not salary, or stability, or job security, but cool.

Perhaps the saddest part of it all is that, in those few examples that Lu is able to find where people tried to break out of this trendy mosh-pit of social app-making startups, they chose ... Wall Street?

Andrew, was a sophomore at the University of Chicago and trying to decide on a major. He was interested in computer science, having taken the online version of CS50, Harvard’s introductory computer-science course, in his spare time. But his parents, both software engineers, wanted him to choose finance. They thought that being a software engineer meant drowning in a technical quagmire, being someone else’s code monkey. Their view of tech was shaped by their years of experience at old-guard companies, where a few cynosures (Bill Gates, Steve Jobs, Larry Ellison, etc.) got most of the money and the glory.

I'm not that old, but I know I'm part of another generation now. I was around when computers were still new, when people were just starting to wonder what changes they might bring, and how the world might change.

And, in so many ways, the world did change.

It's just too bad that the more things change, the more they stay the same.

Lu recalls her days at Harvard:

In 2010, the year I took the CS50, the hottest final project was a dating app called CrimsonSpark. By entering an email address, you could “spark” classmates you were interested in, and if they sparked you back, both of you would be notified.

and notes that

The central concept, though, was alluring: It connected people who wanted to sleep together.

Will I be around to see a time when Harvard undergraduates taking Computer Science classes won't choose, as their homework assignment, a hookup app?

Dunno. This is college, after all, and that behavior is surely nothing new.

So I take heart in reading (will this shock you?) this year's annual letter from none other than Bill Gates, who calls for new investment, not in a better app for getting a taxi ride home from the bar, but in things that really do matter:

It is very hard to know exactly which investments will spark economic growth, especially in the near term. However, we do know that aid drives improvements in health, agriculture, and infrastructure that correlate strongly with growth in the long run. Health aid saves lives and allows children to develop mentally and physically, which will pay off within a generation. Studies show that these children become healthier adults who work more productively.

Improvements in health care, agriculture, and education: what a concept!

It's all food for thought, and I know in some ways I'm picking on Lu's article unfairly, but the problem is real, and deserves attention, and her article inspired me to write about it.

For whatever that's worth.

Reading my way to Ireland, Part 2: travelogues

I've always been an easy mark for the travelogue.

Travel guides are fine, but they are very dry. Travelogues make no bones about it: they are personal, and opinionated, and eccentric, and everything that's wonderful about traveling.

I've been lucky to stumble across some nice travelogues about traveling in Ireland:

• McCarthy's Bar: A Journey of Discovery In Ireland

  This book will be no surprise to anyone who's ever read anything about Ireland. Pete McCarthy was a prolific writer and a prolific traveler and rather a funny man as well. Sadly, he died only a few years after writing this book, but what a good book it is!

  Rather than take the easy way around Ireland, McCarthy goes out of his way to have a real experience. He deliberately gets lost. He sets out in the morning without knowing where he will stay that evening. He takes every opportunity to put himself in situations where he can't just be a spectator. He lives, breathes, sweats, and cries Ireland. And, all the time, you find yourself laughing and crying with him:

  I drove on, stopping a couple of times to go ferreting up mountainsides looking for mass rocks and standing stones. I know this passion for old stones is beginning to seem like an obsession, but when there are no sushi restaurants or art-house cinemas to hang out in, you have to make your own fun. At one point I followed a waterfall up the hillside through ferns and thick woods. At the top, I stopped to gaze out over the mountains, lakes and islands of Kerry, but found myself instead gazing in wonder at the beautiful emerald moss that covered the rocks at my feet. Wow, I thought. At home I go mental trying to get rid of the moss in the garden, but here I realise how beautiful it is. It was a moment of great realisation. I realised the solitude and the natural beauty were turning me soft in the head. It was time to go somewhere with lots of people and buildings, so I could get back in touch with my uncaring, cynical side. I needed quality time in a major tourist trap. I went back to the Tank and hit the road for Killarney.

  It was gorgeous moss though.

  I wish McCarthy had lived longer, to write more, but I'm pleased to have found him nonetheless.

• Round Ireland in Low Gear

  Eric Newby is rather a well-known travel writer, though this was the first book of his I've read.

  When I read the blurb before buying the book ("Touring Ireland by bicycle in the winter is a daunting prospect even for the most seasoned backpackers, but Newby and his wife Wanda weathered it with good humor and resilience."), I anticipated that I was going to be reading some sort of adventure travel book, about a pair of 20-somethings who sleep in the fields and scale the cliffs in between epic bicycle sprints from one place to the next.

  Oh, how wrong I was!

  It turns out, at the time of this trip, Newby and his wife were in their late 60's, and were only occasional cyclers.

  Moreover, they chose the dead of winter for their trip.

  So large parts of this book involve passages like this:

  In the morning we rode out to a huge white sugar-loaf beacon known as Lot's Wife which looks across a narrow sound to Sherkin Island. The rain had stopped and the sun was shining but the wind was blowing so strongly that we could lean out on it without falling over, which meant it was Force 9. Gouts of froth streamed up the face of a precipice on the extreme edge of which a herd of cattle stood grazing, accompanied by an enormous, wily-looking goat; apparently the cattle often fall over, having neither apprehension nor fear of heights, but never the goat. Having done this there was not much else to do, the mail boat not being due to sail for Clear Island until half past two in the afternoon.

  "I'm afraid I can't go on with much more of this," said Wanda, as we sat in a deep valley leading down to the sea next door to an abandoned Morris done out in jungle camouflage with nothing inside except seatbelts. "The winds and the rains are simply killing me." And she shed a tear or two. Nevertheless she promosed to delay her decision about abandoning both me and Ireland until our return from Clear Island.

  I'm not giving much away to admit that, somehow, they persevere.

  Newby's book is delightful. He's interested in everything: history, culture, scenery, religion, art. In between the two-wheeled stretches, he discusses all sorts of topics, and his writing is fluid and natural.

  If it weren't for McCarthy's Bar, I'd be raving about Round Ireland in Low Gear.

• Keep to the Left!: Freewheeling through Ireland

  It is, perhaps, easier for Europeans to appreciate Ireland, as they have some idea of what it is that they are seeing, and why it is there.

  We Yanks have it harder. To us, a historical building was built around 1905 or so, and clans and kings and queens are things we only learn about on TV.

  So off go Jesse and Micki Lovelace, two middle-aged Midwesterners, to Ireland, doing their best to approach things with an open mind and let Ireland show itself to them.

  Jesse takes copious notes, and is very good at re-telling what he had for breakfast, and who had the better meal at the pub. At at times it seems like all he manages to do is to make it from one door to the next.

  Our evening was another memorable pub-crawl. There were several pubs we had missed the night before, so we had to take up the slack before we left County Mayo. Our first stop was the Parting Glass.

  But when he's not simply regurgitating the facts of the matter, he has a lively appreciation for Ireland that makes his book a genuine kick to read:

  With that reassurance, we returned to Abbeyfeale for dinner. Kathleen had recommended a place called O'Riordan's and had said the food was good and reasonable. We found it, since we had noted it as a landmark a few hours earlier, and went in to have one at the bar. As we were sitting there, a big fellow sat down at the bar next to us. He bore a striking resemblance to Ronan Tynan, the Irish tenor: thin hair, round face, prominent ears (like mine) and an infectious grin.

  Since pub manners prevail, we weren't surprised (or offended) when he struck up a conversation. After the usual "How are you enjoying your holiday?," we got to chatting about things in general. He was (and I hope still is) a police officer (Garda) and had just gotten off duty and dropped into O'Riordan's to unwind. When Micki told him that she was a nurse in a small town hospital, the two of them had a grand old time comparing hairy emergency room stories. People who deal with the wreckage of humanity and the disasters that befall people have a sort of bond that defies all boundaries; they know and understand things that the rest of us are completely clueless about. It was an amazing and inspiring experience to listen to an American nurse and an Iris cop discuss the things they had in common.

  Lovelace's book isn't nearly at the level of the other two, but it's enjoyable and entertaining, and most of all it's heart-felt: Lovelace deeply treasured his trip to Ireland, and his enthusiasm is infectious and pleasing, and I can't say I regret the time I spent reading his stories of his adventures.