Stuff I'm reading, Pluto fly-by edition

The world keeps spinning, I keep reading...

• On the various ways of creating large files in NTFS

  Another option is to make the file sparse. I refer you to the remarks I made some time ago on the pros and cons of this technique. One thing to note is that when a file is sparse, the virtual-zero parts do not have physical disk space assigned to them. Consequently, it's possible for a Write­File into a previously virtual-zero section of the file may fail with an ERROR_DISK_QUOTA_EXCEEDED error.

• Trash Day: Coordinating Garbage Collection in Distributed Systems

  In this paper, we show that distributed applications suffer from each node’s language runtime system making GC-related decisions independently. We first demonstrate this problem on two widely-used systems (Apache Spark and Apache Cassandra). We then propose solving this problem using a Holistic Runtime System, a distributed language runtime that collectively manages runtime services across multiple nodes.

• Inside NGINX: How We Designed for Performance & Scale

  NGINX scales very well to support hundreds of thousands of connections per worker process. Each new connection creates another file descriptor and consumes a small amount of additional memory in the worker process. There is very little additional overhead per connection. NGINX processes can remain pinned to CPUs. Context switches are relatively infrequent and occur when there is no work to be done.

  In the blocking, connection-per-process approach, each connection requires a large amount of additional resources and overhead, and context switches (swapping from one process to another) are very frequent.

• The WTF economy is transforming how we do business

  What is the future when more and more work can be done by intelligent machines instead of people, or only done by people in partnership with those machines? What happens to workers, and what happens to the companies that depend on their purchasing power? What’s the future of business when technology-enabled networks and marketplaces are better at deploying talent than traditional companies? What’s the future of education when on-demand learning outperforms traditional universities in keeping skills up to date?

• Monitoring 101: Collecting the right data

  For each resource in your system, try to collect metrics that cover four key areas:

  • utilization is the percentage of time that the resource is busy, or the percentage of the resource’s capacity that is in use.
  • saturation is a measure of the amount of requested work that the resource cannot yet service, often queued.
  • errors represent internal errors that may not be observable in the work the resource produces.
  • availability represents the percentage of time that the resource responded to requests. This metric is only well-defined for resources that can be actively and regularly checked for availability.

• Defining a High Performance Team: It’s not just about Structure

  Flattened structure doesn’t mean no managers, or no hierarchy of responsibility. It more means that the leaders with more responsibility share openly and include people. This is what flattens the structure.

Oh Boy! Oh Boy! Oh Boy!

It's almost here!

Patch 1.07 - Changelog

The Witcher Wild Hunt 3: Patch 1.07 coming soon to all platforms!

In additional to several dozen bug fixes, we get:

• Introduces an alternative movement style for Geralt. To enable, go to the Gameplay\Movement Response submenu.
• Introduces a number of changes in selected game-world areas to prevent players from unexpectedly progressing quests or leaving the playable area by climbing certain elements of the landscape.
• Introduces a number of fixes, improvements and clarifications in the map-pins and objectives for multiple quests.
• Adds a stash for player convenience. Players can now store loot in their stash, access to which is available in different parts of the world. Stash locations are marked on the map.
• All crafting components and alchemy ingredients now weigh nothing.
• Introduces a number of improvements in the game streaming system. Players should experience fewer blurred textures, NPC spawn times should be markedly reduced, and there should be an overall improvement in the speed with which game assets are loaded. Streaming system improvements should be most noticeable on consoles and systems with non-SSD drives.
• Adds a Books tab to the Inventory panel.
• Introduces a number of additional loading screen hints.
• Introduces a pinning feature for formulae and diagrams. Ingredients and components for pinned formulae/diagrams are highlighted in the shop view. This should greatly facilitate the purchase of currently needed elements.
• Introduces a feature whereby currently equipped items are highlighted in the Repair panel, facilitating prioritization of items needing repair.
• Adds a feature whereby read and unread books are marked differently in the Inventory panel.

All that and horse armor, too!

Is it just me, or does that full Skellige heavy armor kit make Geralt look obese?

For now, I'm sticking to my gorgeous light armor set.

Oh boy oh boy oh boy.

Stuff I'm reading

I've been busy at work recently.

Good busy, but busy.

But maybe I'll find some time to read...

• Keys Under Doormats: Mandating insecurity by requiring government access to all data and communications

  In this report, a group of computer scientists and security experts, many of whom participated in a 1997 study of these same topics, has convened to explore the likely effects of imposing extraordinary access mandates.

• More about the NSA's XKEYSCORE

  E-mails, chats, web-browsing traffic, pictures, documents, voice calls, webcam photos, web searches, advertising analytics traffic, social media traffic, botnet traffic, logged keystrokes, file uploads to online services, Skype sessions and more: if you can figure out how to form the query, you can ask XKEYSCORE for it.

• The CAP theorem series

  Let me introduce a new series of posts on the CAP theorem. CAP is a well known theorem conjectured and proven by recognized researchers in distributed systems, namely Eric Brewer, Seth Gilbert and Nancy Lynch. It is also widely used to categorize distributed applications.

• You Do It Too: Forfeiting Partition Tolerance in Distributed Systems

  The CA--consistent, available, but not partition tolerant--category in CAP has a very specific history. Not only forfeiting “partition tolerance” can be understood as impossible in theory and crazy in practice (P--partition tolerance--as an illusion of a choice), but there is also an overlap between the CA and CP categories. As a result, many consider that it’s impossible to build a production CA system. This is wrong, both in theory--the CAP theorem does not say that--and in practice--you can build a system without partition tolerance, and sometimes you should.

• Comments on "You Do it Too"

  The entire point of the CAP theorem is that such systems cannot exist. The existence of such a system, even theoretically, would disprove the theorem. You’ve got a paper to publish.

• Is Linux TCP/IP Stack Really That Slow?

  In most cases, the answer is surprisingly simple: because the vendors ported their existing code to VM format, and replaced direct access to dedicated hardware with calls to Linux kernel (thus making every possible mistake they could). Vendors that spent time optimizing the code (Vyatta, Juniper) got the performance you’d expect (Juniper managed to push 160 Gbps through their vMX).

• Routing Protocols and SD-WAN: Apples and Furbies

  You see, shifting traffic across alternate paths works very well in SD-WAN world, because the amount of shifted traffic represents a minuscule part of the overall traffic in the ISP network, whereas shifting traffic based on routing protocol decisions results in significant traffic shifts, which can result in interesting feedback loops in oscillations.

• Don’t Be Fooled By Phony Online Reviews

  The Internet is a fantastic resource for researching the reputation of companies with which you may wish to do business. Unfortunately, this same ease-of-use can lull the unwary into falling for marketing scams originally perfected by spammers: Namely, fake reviews and dodgy search engine manipulation techniques that seek to drown out legitimate, negative reviews in a sea of glowing but fake endorsements.

• Updating Probability of Damage Rolls

  One of my goals was to structure all of my pages so that I'd first give you the solution you were looking for, and then give you an idea that would change the way you thought about the problem. For the damage rolls page, the problem you're trying to solve is how to set up the rules for the dice so that you get a distribution of values that you like. You fiddle with the rules, look at the distribution, fiddle with the rules again, look at the distribution, and keep fiddling until you get the distribution you want. The big idea was that you should start with a distribution, and then work backwards towards the code. That way you don't have to keep fiddling with parameters.

• Games vs Sports

  From a game design "formalist" point of view, they are not different. A rules-centric view of games doesn’t care whether the interface is computerized, mediated via apparatus, or physical, so it makes no distinction between computer chess and physical chess; similarly, it makes no distinction between the rules of, say, baseball, implemented within a computer or by players on a field. They’re both still recognizably baseball.

• Episode 163: The Gruen Effect

  Retail spaces are designed for impulse shopping. When you go to a store looking for socks and come out with a new shirt, it’s only partly your fault. Shops are trying to look so beautiful, so welcoming, the items so enticingly displayed and in such vast quantity, that the consumer will start buying compulsively.

  This is the Gruen Effect.

• Gruen Day 2015

  On July 18, the Bay Area Infrastructure Observatory (BAIO) invites you to celebrate the lofty aspirations and historical legacy of the suburban shopping center at Gruen Day 2015.

  Festivities will include an afternoon of talks, tours, and hanging out in the food court at Bay Fair Center, which opened in 1957 as one of the first Gruen designed shopping centers in the country.

Fare Thee Well finale show

It sounds like the final night was quite the show, even if there was a bit of audience drama, and it apparently was the best-attended of the Chicago shows.

(I guess Levi's Stadium is substantially bigger than Soldier Field nowadays; the last time I was in Soldier Field was in 1984, before the renovation, and I understand the updated stadium is nicer, but smaller.)

Everybody seemed to agree that it was a delightful finale. Billboard reports that they handled my wife's personal favorite (Terrapin Station) well: Grateful Dead, Trey Anastasio Bid Final Fare Thee Well at Third Chicago Show: Concert Review

Anastasio seemed to be channeling Bob Dylan with his vocal lead, and launching into the three-act "Terrapin Station," a Dead anthem if ever there was one, brought the vibe right back to 1977 with the unmistakable intro that is "Lady With a Fan."

"Terrapin," of course, is treacherous territory, not only because of its complex key changes and tricky time signatures, but it’s the sort of psychedlia that could easily veer into Spinal Tap "Stonehenge" territory if not handled the right way -- which is to say, delicately.

To that end, the band did pull it off

Over at Ultimate Classic Rock, Ben Djarum even finds nice things to say about late-era songs: Grateful Dead Hit Emotional Peak for Final ‘Fare Thee Well’ Concert: Set List and Photos

The first real surprise of the night came in the form of pianist Bruce Hornsby’s delightful take on the song “Built to Last,” the title cut of the Grateful Dead’s final studio album. Up to this point, the song has had a relatively brief track record, played only in 1989 and 1990, but its inclusion last night was a revelation.

Although I'm surprised they didn't play Brokedown Palace at all, over all five nights, there's no way to complain with last night's setlist: Althea, Truckin', Not Fade Away, Terrapin Station, I Know You Rider, Throwing Stones, and Touch of Grey.

And, something I surely wish I had seen, China Cat Sunflower, perhaps even more of a "Jerry" song than Saturday night's Friend of the Devil. I guess that modern technology has helped a bit:

Anastasio utilized a Mu-Tron envelope filter to nail the tone Garcia favored during the composed sections of the song

And a full fireworks show during the intermission!

It was fun going to the show, it was fun following the shows from afar, and it certainly gave me the excuse to drag some of my old albums out from underneath the pile of books on the shelf and re-spin them (yes, they're CDs now, but ...).

But it's Monday morning, and I've got plenty to do, so off we go...

Fare Thee Well, Chicago Day 2: Wave that flag!

Well, the reviews are in for Saturday's 4th-of-July Grateful Dead show at Soldier Field in Chicago.

Surely this must have been the show with the highest pressure and the highest expectations, due to the symbolic nature of the date, and the fact that it was the next-to-last of the shows.

And perhaps the pressure got to everybody.

Review: Grateful Dead pay slack tribute to legacy, writes Chicago Tribune entertainment critic Greg Kot, clearly disappointed.

For this weekend’s shows, which the band has said will be its last, the core four brought in Phish guitarist Trey Anastasio and keyboardists Bruce Hornsby and Jeff Chimenti to fill out the lineup. But despite the formidable chops of the newcomers, the show developed little pace, with slack arrangements and some deep cuts that felt indulgent rather than revelatory.

In Rolling Stone, Will Hermes chimes in: Grateful Dead's Goodbye, Night Two: Chemistry Lost, Cash-Grabs Abound

And the chemistry wasn't there like it was for Night One, or the best parts of the two warm-up shows in Santa Clara last week. Tempos were sluggish or weirdly accelerated; there was little overarching sense of flow. The ringers — Anastasio, keyboardist Jeff Chimenti, pianist Bruce Hornsby — played well, but didn't always sync with the original band members, and rarely tapped into the musical mind-meld characteristic of the best Dead shows.

As happens during dull stretches, attention wandered. One might have thought about shows past. About what a shame it is to have to sit through songs as boring as "Liberty" "Lost Sailor" and "Saint of Circumstance" — even when lit up with nice spots of improvisation — during such a special night, or another pro-forma bar-band run-thru of Willie Dixon's "Little Red Rooster." Looking up to the sky above Soldier Field, one might have pondered the Direct TV blimp with the flashing side panel, which alternated quotes from Grateful Dead songs and animated dancing bears with ad pitches ("HIGHER SATISFACTION THAN CABLE" "THE MOST PGA COVERAGE" "STREAM ON ANY DEVICE"). And it might have driven one back to the concession stands for another $11.75 beer.

But who knows? As the gang at JamBase point out, a large part of this event was about the event itself, rather than the details of the shows.

Deadheads from around the U.S.A. and well beyond have descended upon Chicago for the run making for an International crowd heavy on those from out of town. Attendees have been swapping stories, making new friends and meeting up with old friends all weekend long in The Windy City.

Just as with on Friday, the energy in Soldier Field was far beyond any typical concert as many of those in attendance spent an ungodly amount of time and money making their Chicago trip a reality.

I certainly had that experience last weekend in Santa Clara. Hanging out in a line for something-or-other, I started chatting with the fellow in front of me, who had driven all the way from Colorado with his family, making a summer-vacation-in-California out of the experience, taking his kids to the beach, and using the show as an experience to make it all happen.

And even though I could take a pass on Standing On The Moon and Saint of Circumstance and West L.A. Fadeaway, this show still had Me and My Uncle, Deal, Bird Song, and (but of course, it was the 4th of July) U.S. Blues.

And of course it had to close with One More Saturday Night since it was, after all, Saturday night.

And what about this neat trick for the encore: Grateful Dead Celebrate July 4th With Empire State Building Light Show

The Grateful Dead celebrated Independence Day Saturday night with a synchronized light show atop the Empire State Building in New York City that was broadcast live to the sold-out crowd at Chicago's Soldier Field during the band's encore performance of "U.S. Blues."

The LED tower lights glowed red, white and blue — colors fit for both the Stars and Stripes and the famous Steal Your Face skull — while an assortment of Grateful Dead imagery appeared on the mast of the Empire State Building. The display was coordinated and created by the band and Empire State Building lighting designer, Marc Brickman.

There's a nice copy of the video on YouTube, synchronized to the original studio version of the song.

Wave that flag!

Stuff I'm reading, nation's birthday edition

Happy 4th, if that's your thing wherever you are...

• What Turing Himself Said About the Imitation Game

  Turing’s fundamental message about thinking in his 1952 radio broadcast was that we shouldn’t set the bar any higher, or any differently, for computers than we do for people. We don’t decide that our fellow human beings think by putting their brains under a microscope—ordinary everyday interaction is enough. That was Turing’s astute observation. If you want to tell whether a machine thinks, try communicating with it.

• Preview the new JDBC 4.2 for SQL Server Driver

  The JDBC Driver for SQL Server is a Java Database Connectivity (JDBC) type 4 driver that implements full compliance with the JDBC specifications 4.1 and 4.2 and supports Java Development Kit (JDK) version 1.8. There are several additional enhancements available with the driver. The updated XA Transaction feature includes new timeout options for automatic rollback of unprepared transactions. And, the new SQLServerBulkCopy class enables developers to quickly copy large amounts of data into tables or views in SQL Server and Azure SQL Database databases from other databases.

• s2n : an implementation of the TLS/SSL protocols

  Ignoring tests, blank lines and comments, s2n is about 6,000 lines of code. s2n's code is also structured and written with a focus on reviewability. All s2n code is subject to code review, and we plan to complete security evaluations of s2n on an annual basis.

  To date there have been two external code-level reviews of s2n, including one by a commercial security vendor. s2n has also been shared with some trusted members of the broader cryptography, security, and Open Source communities. Any issues discovered are always recorded in the s2n issue tracker.

• Let's Encrypt Releases Transparency Report -- All Zeroes Across The Board

  This is actually pretty important for a variety of reasons. First, it clearly acts as something of a warrant canary. And by posting this now, before launch and before there's even been a chance for the government to request information, Let's Encrypt is actually able to say "0." That may seem like a strange thing to say but, with other companies, the government has told them that they're not allowed to claim "0," but can only give ranges -- such as 0 to 999 if they separate out the specific government requests, or 0 to 249 if they lump together different kinds of government orders. Twitter has been fighting back against these kinds of rules, and others have argued that revealing an accurate number should be protected speech under the First Amendment.

• Blaming the Victim

  The compromises at OPM and at Sony Pictures have revealed some truly pathetic security practices at both organizations, which certainly made the bad guy's job very easy. Better security practices would undoubtedly have made their job harder. But it is important to understand that in a world where Kaspersky and Cisco cannot keep their systems secure, better security practices would not have made the bad guy's job impossible.

• The Harmful Consequences of Postel's Maxim

  Jon Postel's famous statement in RFC 1122 of "Be liberal in what you accept, and conservative in what you send" - is a principle that has long guided the design of Internet protocols and implementations of those protocols. The posture this statement advocates might promote interoperability in the short term, but that short term advantage is outweighed by negative consequences that affect the long term maintenance of a protocol and its ecosystem.

• ISDN: The Untravelled Path of Mobile Computing

  The reason for this is that Japan's national phone carrier, NTT, had a vision for the future in which people who were out on the road with their mobile computing devices would stop off at a payphone and plug in to make "data" calls. ISDN was an international standard for a natively digital phone system, which offered 64 kbps line speeds.

• Running Effective Retrospectives

  let’s take a look at how an average team can apply scientific retrospectives to the process of team improvement, by sitting down with Scrum Mistress Alice and her team of Rockstar Ninja Samurai Cowboy developers at Poogle (a search service that helps desperate travelers locate the nearest lavatory).

• Lost Highways

  Vermont is unusual in that, if a road has been officially surveyed and, thus, added to town record books—even if that road was never physically constructed—it will remain legally recognized unless it has been explicitly discontinued.

  This means that roads surveyed as far back as the 1790s remain present in the landscape as legal rights of way—with the effect that, even if you cannot see this ancient road cutting across your property, it nonetheless persists

• Google Street View - Allure of the Seas | Royal Caribbean

  At Royal Caribbean we like to push the boundaries of technology & innovation, so we are excited to reveal the world's first, exclusive "access all areas" tour onboard Allure of the Seas, using Google Street View technology.

Fare Thee Well, Chicago day one

Reports are in from the first night in Chicago, and it sounds like it was a wonderful show

The setlist hits some big highlights for me: Scarlet Begonias, Jack Straw, Box of Rain, Bertha are all personal favorites, and the long jazzy selection from Blues for Allah must have been just marvelous.

Meanwhile, I bet it was an experience just to watch the pilgrimage: I’m spending $4,768 dollars to see the Grateful Dead this weekend

Beyond the shows themselves is a full calendar of ancillary events and expenses, a schedule to rival SXSW. Every jam band west of the Mississippi is coming into town to play… pre-parties, after-parties, and all the live-streaming parties to boot. And named for the 1978 Grateful Dead album and eponymous song, “Shakedown Street” will be the crowded, bacchanalian bazaar that inevitably pops up in the parking lots, where you can buy or trade anything

Beyond just free trade, as Wired observes, the Grateful Dead "community" can claim credit for a number of inventions: Call Them Hippies, But the Grateful Dead Were Tech Pioneers

Long before it became necessary (or cool) to do so, the band embraced a DIY ethos in everything from manufacturing its own gear to publishing its own music to fostering a decentralized music distribution system. The Dead’s obsession with technology was almost inseparable from the band’s psychedelic ambition and artistic independence.

Lastly, while I've got your attention, even though it has nothing to do with the Grateful Dead except for the title, I enjoyed this article quite a bit: A Long, Strange Trip Downwind Faster Than the Wind

When we had only equations to present, we were nearly universally ridiculed. When we built and demonstrated a manned cart beating the wind, people complained we had no theory to back it up. To this end another friend offered, “Sure it works in practice – but can you prove it works in theory?”

Hey, it's a beautiful day (Happy 4th of July!); now go find a copy of American Beauty and put it on, and sing along with a friend.