this is a long post for someone with nothing to talk about
You've been warned.
Believe it or not, my little BitTorrent dissertation was actually meant to be the beginning of an even longer entry. What can I say? I'm not so good at self-editing. Anyway, there was a logical end point to the last one -- namely, the realm of fact. From here on out it's just a high-concept misapplication of scientific principles.
During my, er, research for this post I discovered that suprnova.org (sic) wasn't the cutting-edge BitTorrent clearinghouse I thought. In fact, it kind of sucks.
You might recall me rambling about .torrent files and trackers in my last post. Well, those files need to be hosted somewhere. Suprnova is one of those places. But there are others -- including many that, unlike Suprnova, require a user account.
The specific one I ended up using is called EliteTorrents. The gimmick there is that your upload/download ratio is recorded on the server. When you download a torrent it's custom-tailored to your account, allowing your individual activity to be tracked. Download more than you upload and you'll start having to wait to join the torrent; keep doing it and you might get banned. It's an extra layer of quality-of-service assurance on top of the QoS stuff already built into BitTorrent. There are a lot of other sites with similar schemes.
This is nothing new. Some of this blog's readers might remember logging into the dialup BBS I ran in middle and high school. The file section there had an enforced upload/download ratio too, to ensure that you contributed roughly as many badly faked EGA pictures of topless celebrities as your friends did.
This all got me thinking about the appropriately derided hacker credo (or motto, or whatever): "information wants to be free". Well of course it doesn't really want anything (barring arguments for panpsychism, which even I know are beyond the scope of this entry). But it does seem to try to get free, in the same way that a drop of dye in a glass of water tries to diffuse until it's uniformly distributed.
The reason for that dye spreading out is the second law of thermodynamics, aka entropy. It's a nerd greatest-hit: "the unusable energy of a closed system will always increase". Put in a somewhat less formal way: things spread out. On ignition, chemical energy in a molecule of propane spreads out into lower-energy bonds in water and CO2, plus surplus heat. Electrical energy spreads out from places of high concentration, through whatever appliances you put in its way, and into the earth where its charge can be most evenly distributed. The mechanical energy of a football flying through the air is transferred to the air and the person catching it; eventually it ends up as friction, diffusing that mechanical energy down to the level of random molecular motion. In fact, theoretical physicists think that as the universe winds down, protons themselves will fall apart. Space will be filled with nothing but a soup of elementary partles and heat -- enough of it, anyway, to keep things a fraction of a degree above absolute zero. Nature seems to want very badly to turn itself into a big, messy, undifferentiated soup.
The practical interpretation of entropy is that systems tend to disorder. Jeff is fond of explaining entropy as the reason Nintendo controller cables get tangled. That isn't entropy, strictly speaking -- the energy of the system is probably actually higher when the cords are twisted. But, like entropy, the tendency to tangle is an artifact of the fact that very few potential outcomes of a probabilistic circumstance correspond with what humans think of as "order". The odds of the controller cords ending up in an untangled configuration are almost as bad as the odds of those dye particles randomly arranging themselves into a drop-sized space inside a larger volume of water.
My point is that there are entropic-looking processes that don't have anything directly to do with entropy, but which echo the principle, and can be thought of in similar terms in an instructive way. We can sometimes employ entropy as useful shorthand even at scales or in situations where it may not be strictly applicable.
Is there an actual correlary for information? Probably not in a scientifically rigorous way. The type of information diffusion I'm talking about involves human actors, which obviously muddies everything up. Constructing parallels between physics and sociology is an undertaking that’s unlikely to produce much testable theory.
But there are some connecting strands here. I’m playing pretty fast and loose with the term “information” here (and entropy, for that matter), but Claude Shannon and his intellectual descendents did a much better job – down to the level of defining just how many bits you can get per photon. (If you’re interested, I highly recommend this book as an accessible introduction to information theory.)
There are other explicit ties between information and the physical world. As processors become more powerful, they’re also getting hotter in terms of watts per square centimeter1. In a couple of years, don’t be surprised to find that your Dell desktop PC comes equipped with a water-based cooling system.
One solution to the problem is something called reversible computing. It turns out that a lot of processor heat comes from the destruction of information. If you do your computing in a way that can be reversed – that is, one can take the result and work backward to the input – you waste much less energy. It’s a hard thing to understand, and an even harder thing to design for; I don’t mean to imply that I can do either. But it’s the weird truth. The intersection between physics and information is real.
So I think that information's tendency to diffuse may be usefully thought of in entropic terms. And from that premise, I think that the following two observations can be made.
First, I find it interesting that when enough order is injected into either type of system -- usable energy, or unique information -- broadly "anti-entropic" mechanisms arise. It would be much simpler for sunlight to diffuse its energy into heat directly, but life arose, keeping the energy ordered for many more phase changes, and slowing the entropic process to a relative trickle. Similarly, it would be a lot simpler for file transfers to be direct, leech-style transactions or simple broadcasts. Instead, distribution mechanisms have arisen, in parallel, that ensure the orderly dispersal of the data. Perhaps both of these are actually disorder-maximizing processes – in the absence of plant life, a lot of sunlight would radiate off into space, still in a usable form. And the point of EliteTorrents and its ilk is to ensure a steady, optimal flow of data, not to keep the data closer to its original, non-distributed state. Still – that’s an awful lot of apparent order that has spontaneously arisen.
Second, when you have a sufficiently large natural imbalance, you can use it to drive an engine. High charge can run a vacuum cleaner as it seeks ground; compressed, energetic gas can push a piston head; even the difference between hot and cold water can be used to do useful things as it seeks to equalize temperature. In the same way, the dispersal of information might be harnessed to power what I’ll reluctantly call a social engine. You could make the argument that publishing houses are such engines; or that EliteTorrents is. But I’m not convinced these efforts rise much above the comparative level of hot air balloons in terms of technological sophistication. It may be that such processes can’t be effectively harnessed. It may be that social engines self-organize into webs of vast complexity, but generate only informational waste heat and no useful work.
Either way, I think it’s at least an interesting paradigm to apply to the internet, piracy, and Shawn Fanning’s various failed business ventures.
1 Yes, Jeff, I know. Don’t look at me; I didn’t choose the units used for this.

Comments
tom, I'm really looking forward to drunkenly arguing with you about this when I come home in a few weeks, but let me just say that there are some problems with this post.
First of all, you say my analogy with the nintendo controllers "isn't entropy, strictly speaking". Strictly speaking, it is. You're putting the cart before the horse in your definition of the second law: stricly speaking, the second law states that with time, systems will tend towards the state with the maximum number of equal-energy conformations. The practical interpreation, to use your words, is that energy "spreads" out to an unusable form, i.e. heat. This is a subtle point, but an important one if you really want to understand the functional consequences of the second law. I'll save my analysis of the energetics of nintendo controller conformations for a later date.
And towards the end you don't have a clear definition of what your closed system is, and I think this leads to some false conclusions. You can't treat file sharing as diffusion in any sense, because making an exact copy of a file (or of anything) is inherently order-creating. The reason the second law isn't violated is that the only reason computers can run these programs is from a constant influx of energy from some other source. The information diffusion you talk about is actually strictly regulated, directed motion, requiring energy from some highly inefficient, entropy-increasing process taking place in the hands and brains of the computer users and in a powerplant somewhere. Your analogies with plant life are correct for up to where you say "that's an aweful lot of apparent order that has spontaneously arisen". It wasn't spontaneous at all... the only reason life is able to exist is because of a constant influx of energetic photons from the sun. The closed system in this case has to incorporate both the plant and solar nuclear chemistry. Life, and information are - as you say - actually disorder maximizing processes, as are all processes, everywhere, all the time. As such, attempting to harness this energy is a waste because extracting "work" from this system would be a horribly inefficient use of coal and powerbars.
Reversible computing, however, sounds pretty cool. And if I understand it correctly, it would be the computer equivalent of a hybrid car... when getting rid of energy (information or velocity), instead of just discarding it as heat, divert some of that energy to some storable medium. It wouldn't be 100% efficient, but anything's better than 100% heat.
Also, I have no gripe with watts per square centimeter. It's all within the same system. I would have a problem with Watts per square inch - which is probably just as dumb as the strictly SI kg/s^3.
In conclusion, i'm right you're wrong.
okay. first, I'm very prepared to be wrong about most of this. some of your objections I anticipated and acknowledge.
I am prepared to argue more about the nintendo controllers. I think it's an instructive example (so do the dorks at wikipedia, fyi), but that the twisting of the cables probably holds some potential energy that could be harnessed. That's why I said it's not entropy. But I could be wrong, and probably am.
Of course you're right that none of my "anti-entropic" processes actually violate the second law. Either the system isn't closed or they're entropy-maximizing. I should have been clearer, though, in what I meant by "anti-entropic": really, I just meant they seem that way. Like a wave curling upstream against a river's current. Or something. Structures arise that conform to what we think of as order. It may not violate the second law's sense of it, but it violates ours. That's the parallel I was trying to make.
You've got a good point about the analogy falling apart given the facts of the matter as they relate to copying information. I think for it to work I'd have to define the state of information that's analogous to an ordered physical system as, say, "desirable, undistributed information". With a definition like that, though, I may be creeping up on writing a tautology.
Maybe I'm reading too much into your position, but I really disagree with you when you say "attempting to harness this energy is a waste". Obviously we can get useful results out of state changes (useful in the practical sense, you cynical scientist). We might be able to get work out of a social machine either because a) it isn't work in the scientific sense, but just a behavioral concept or b) the desirable information's creation was originally powered by the sun's energy anyway (most likely (a)).
As for the watts -- whoops. I'm not good at remembering where SI stops and starts for electrical units of measurement. I'd just kind of assumed America was backward about this unit, too. And, you know -- it reminds me of James Watt. Steam engines n' shit. That's old-timey, right? Right.
I should also note that, while doing background reading on the end of the universe, some serious problems came up with my "spreading out" explanation of entropy. I still think it's a basically useful way for a layman such as myself to understand the way physics works, but I am aware that someone could out-science me pretty badly on this point if they wanted.
Anyway, I, too, am looking forward to arguing about this in progressively louder voices, until we both puke eggnog all over the place. But I'm flattered you took it seriously. I should probably have made the analogy a little looser.
So where does quantum computing fit into all of this? Or is it sufficiently unknown at this point that we can't assess the entropic results of a quantum computer?
AAAAAAAAAAAAAHH THIS IS AWESOME
Justin, I'm not sure what you're getting at. Aside from quantum weirdness being, well, weird, I don't know that there are particular entropic consequences to quantum computers. If a working one ever gets built, you can be sure that (relatively) huge amounts of energy will be spent keeping the qubits in a stable, usable state.
Post A Comment