3.14.2011

Welcome High School for Environmental Studies students!

Greetings and welcome to students from the High School for Environmental Studies!

Sol and I have gotten wind that you're going to be our online guests leading up to our talk on April 5th. We're very happy to have you guys here and hope you're as excited as we are. We've set up this page up so you have an easy and accessible place to find out more about climate change, sustainable development, and our research. In particular you might want to check out any post tagged with the HSES tag, since those are going to be oriented more specifically towards you. Please feel free to check back every now and then for new content and links, and if you have any questions don't hesitate to email either of us (Jesse: jka2110@columbia.edu Sol: smh2137@columbia.edu).

Assorted reference links:
Previous posts on the blog that you might like:
General advice on getting ready for college, research, environmentalism, etc.:

Understanding Nuclear Accidents

As if the direct damages from the Sendai earthquake / tsunami weren't enough, there's now ample concern that one of the nuclear power plants damaged by the quake might melt down. Ed Lyman of the Union of Concerned Scientists' All Things Nuclear blog has an overview of what's going on and how this could make an already horrific disaster worse:
I have done considerable analysis on the safety risks associated with using MOX fuel in light-water reactors. The use of MOX generally increases the consequences of severe accidents in which large amounts of radioactive gas and aerosol are released compared to the same accident in a reactor using non-MOX fuel, because MOX fuel contains greater amounts of plutonium and other actinides, such as americium and curium, which have high radio-toxicities.
Because of this, the number of latent cancer fatalities resulting from an accident could increase by as much as a factor of five for a full core of MOX fuel compared to the same accident with no MOX. Fortunately, as noted above, the fraction of the fuel in this reactor that is MOX is small. Even so, I would estimate this could cause a roughly 10% increase in latent cancer fatalities if there were a severe accident with core melt and containment breach, which has not happened at this point and hopefully will not.
They also have an excellent two page pdf describing how nuclear power plants work and why they can be so unstable.

More broadly, one of our better estimates of the long-term impacts of nuclear fallout was actually done by Doug Almond, one of the SDev Ph.D. program's core faculty. From his 2009 Quarterly Journal of Economics article with Lena Edlund and MÃ¥rten Palme:
We use prenatal exposure to Chernobyl fallout in Sweden as a natural experiment inducing variation in cognitive ability. Students born in regions of Sweden with higher fallout performed worse in secondary school, in mathematics in particular. Damage is accentuated within families (i.e., siblings comparison) and among children born to parents with low education. In contrast, we detect no corresponding damage to health outcomes. To the extent that parents responded to the cognitive endowment, we infer that parental investments reinforced the initial Chernobyl damage. From a public health perspective, our findings suggest that cognitive ability is compromised at radiation doses currently considered harmless.
There's accompanying video of the Chernobyl plume's spread here. And not to be terribly alarmist, but western North America is directly downwind from Japan.

Does Daylight Saving Time Save Energy?

While reflecting on my loss of sleep this past weekend, I found this working paper from a few years ago:

Does Daylight Saving Time Save Energy? Evidence from a Natural Experiment in Indiana

Matthew J. Kotchen, Laura E. Grant
NBER Working Paper No. 14429

Abstract: The history of Daylight Saving Time (DST) has been long and controversial. Throughout its implementation during World Wars I and II, the oil embargo of the 1970s, consistent practice today, and recent extensions, the primary rationale for DST has always been to promote energy conservation. Nevertheless, there is surprisingly little evidence that DST actually saves energy. This paper takes advantage of a natural experiment in the state of Indiana to provide the first empirical estimates of DST effects on electricity consumption in the United States since the mid-1970s. Focusing on residential electricity demand, we conduct the first-ever study that uses micro-data on households to estimate an overall DST effect. The dataset consists of more than 7 million observations on monthly billing data for the vast majority of households in southern Indiana for three years. Our main finding is that -- contrary to the policy's intent -- DST increases residential electricity demand. Estimates of the overall increase are approximately 1 percent, but we find that the effect is not constant throughout the DST period. DST causes the greatest increase in electricity consumption in the fall, when estimates range between 2 and 4 percent. These findings are consistent with simulation results that point to a tradeoff between reducing demand for lighting and increasing demand for heating and cooling. We estimate a cost of increased electricity bills to Indiana households of $9 million per year. We also estimate social costs of increased pollution emissions that range from $1.7 to $5.5 million per year. Finally, we argue that the effect is likely to be even stronger in other regions of the United States.

pooreconomics.com

Abhijit Banerjee and Esther Duflo have put together what promises to be an excellent new book collecting the array of new advances made in development economics: Poor Economics.

The book isn't out yet, but its website sets a new standard for how academics present their work.  It has interactive maps, datasets and a collection of quality studies (each chapter has a long list of relevant reading).

Check it out: pooreconomics.com

3.13.2011

Stata blog post on understanding matrices (with bonus Stata cheat sheet)


William Gould on Stata's blog (previously mentioned here) has two great posts (here and here) on the intuition behind matrices and regression coefficients. The section on near-singular matrices is characteristically nice:
Singular matrices are an extreme case of nearly singular matrices, which are the bane of my existence here at StataCorp. Here is what it means for a matrix to be nearly singular: [see figure]
Nearly singular matrices result in spaces that are heavily but not fully compressed. In nearly singular matrices, the mapping from x to y is still one-to-one, but x‘s that are far away from each other can end up having nearly equal y values. Nearly singular matrices cause finite-precision computers difficulty. Calculating y = Ax is easy enough, but to calculate the reverse transform x = A-1y means taking small differences and blowing them back up, which can be a numeric disaster in the making.
Both posts are great and I recommend them for anyone struggling with the intuition behind what exactly you're doing when you type in reg y x.

As an added bonus, earlier this week I stumbled across Kenneth Simon's excellent pdf cheat sheet of Stata commands for intermediate / advanced econometrics, here. I was trying to figure out a way to do something cute with distributed lag models and post-estimation tests, but the sheet covers everything from the simple but important (e.g., the difference between gen old = age >= 18 and gen old = age >= 18 if age<. ) to the arcane but potentially important (e.g., nonlinear hypothesis testing). If you're in applied work and use Stata I highly recommend flipping through it. I've already found several useful techniques I wasn't even aware existed.

March 11 Pacific Tsunami

NOAA has put together a nice technical site with model output and gauge readings from the tsunami on Friday.  The EVL used the data to make the graphic on the top, the NYT put together the graphic on the bottom:


A team at the NYTimes has also put together a nice interactive explanation about how tsunamis are generated and an interactive map with images of the damage.

3.10.2011

Maps + Data Presentation

Since Sol recently posted on both NOAA's lovely data visualization labs and an assortment of map resources, I figured it might be worth pointing our readers to Cartastrophe. From the site's about page:
There are a lot of bad maps out there. They lurk in brochures, on company websites, and in magazines. They confuse, they miscommunicate, and they make it hard to learn anything about the world. Sometimes they leave off Sicily. They’re made by people who have to rush against tight deadlines, by people who are pressured by their bosses or clients to make bad design choices because it “looks cool,” and by people who were thrust into map-making jobs without any training.
[...]

We learn a lot from seeing what went wrong in someone else’s experience. I hope to amuse, but also to educate — to help people (myself included) understand what the elements of a good map are. And maybe, just maybe, if people are better able to understand what makes up a bad map, they’ll start demanding better ones.

The site is effectively the cartographic counterpart to Andrew Gelman's consistently superb data presentation critiques, and offers a huge amount of useful and thoughtful advice. Highlights:
The last link is particularly nice for its reminder that as much as many of us love Google maps (I have difficulty imagining how I went through life before it...) it can still contain major errors.

3.01.2011

Earth Magazine Article

A recent article of mine came out in Earth Magazine.  Its an abridged description of my PNAS paper, which I described in an earlier post.

The best part is that on their main site

www.earthmagazine.org

they have a voluntary "visitors poll" (I mentioned a different poll in an earlier post) asking visitors if high temperatures affects their productivity. The results at the time of this posting are:


For those interested in the large (but sometimes statistically underpowered) literature on thermal stress and human productivity, here is a review from the Indoor Air Quality Handbook (2001).


2.17.2011

Map resources

I spoke with some librarians today who pointed me to two excellent online resources for historical maps, the University of Texas Map Library and the David Rumsey Map Collection.  There is so much untapped information on these sites its overwhelming.  Below were two favorites that I found on Rumsey's site.

The Distribution of Wealth, 1870

Ranking of States by Income, Debt, Literacy, etc, 1880


2.10.2011

Bibliometrics and book shrink

In the middle of doing a bunch of bibliometrics work I came across a site called BookShrink that parses a text to choose the sentences in it that are most representative of the whole. The alogorithm basically assigns a score to each sentence based on the total frequency count of all words in the book and then normalizes by sentence length. So no, it doesn't look like it has anything positional and no, it doesn't condense the book into Cliff Notes-style summary (and it doesn't read pdf's, so don't think you're getting out of doing your lit review using just some bash scripts) BUT it is pretty cool. Loading in the entirety of The Wealth of Nations yields:
1 (1.000000): The taxes upon expense, therefore, which fall chiefly upon that of the superior ranks of people, upon the smaller portion of the annual produce, are likely to be much less productive than either those which fall indifferently upon the expense of all ranks, or even those which fall chiefly upon that of the inferior ranks, than either those which fall indifferently upon the whole annual produce, or those which fall chiefly upon the larger portion of it.

2 (0.961065): I shall endeavour to give the best account I can, first, of those taxes which, it is intended should fall upon rent; secondly, of those which, it is intended should fall upon profit; thirdly, of those which, it is intended should fall upon wages; and fourthly, of those which, it is intended should fall indifferently upon all those three different sources of private revenue.

3 (0.765899): From the end of the first to the beginning of the second Carthaginian war, the armies of Carthage were continually in the field, and employed under three great generals, who succeeded one another in the command; Amilcar, his son-in-law Asdrubal, and his son Annibal: first in chastising their own rebellious slaves, afterwards in subduing the revolted nations of Africa; and lastly, in conquering the great kingdom of Spain.

4 (0.708201): You must pay, too, for the tax upon the salt, upon the soap, and upon the candles which those workmen consume while employed in your service; and for the tax upon the leather, which the saltmaker, the soap-maker, and the candle-maker consume, while employed in their service.
...
No, nothing about pins, but still pretty interesting.

NOAA Environmental Visualization Laboratory

Just completing my data visualization hat trick for the week.  A colleague of mine, Amir Jina, recently pointed me to what is now one of my favorite websites: NOAA's Environmental Visualization Laboratory.

The group takes huge quantities of real-time data and transforms it into beautiful images designed to teach students and the public about the global environment. Perhaps most impressive is the constant stream of new images.  Some elegant highlights below.

Nitrogen dioxide concentrations showing China's superlative industrial pollution.


The absence of atmospheric water vapor over the equatorial Pacific illustrates the current La Nina.


3D plot of snow-depth in the US following some of the recent storms (related to the La Nina).


Composite image of some 2010 hurricanes.


North Atlantic sea surface temperatures were extraordinarily warm this past October.


2.08.2011

Cropscape Data Visualization

Micahel Roberts recently sent me a link to this relatively new data browser for land-use in the US, produced by the National Agricultural Statistical Service. Its not available for all years, but the resolution is impressive, allowing you to zoom in so you can see the individual fields of farmers.

The announcement of the dataset was here:

CropScape delivers data visualization tools directly into the hands of the agricultural community without the need for specialized expertise, GIS software or high-end computers,” said Mark Harris, NASS Research and Development Division director. “This information can be used for addressing issues related to agricultural sustainability, land cover monitoring, biodiversity and extreme events such as flooding, drought and hail storm assessment.”


NASS produced the 2010 CDL using satellite image observations at 30-meter (0.22 acres per pixel) resolution and collected from the Resourcesat-1 Advanced Wide Field Sensor (AWiFS) and Landsat Thematic Mapper. The collection of images was categorized using on-the-ground farm information including field location, crop type, elevation, tree canopy and urban infrastructure. All prior CDL products dating back to 1997 are also hosted by CropScape.
CropScape was developed in cooperation with the Center for Spatial Information Science and Systems at George Mason University, Fairfax, Va. The research and development ofCropScape and the NASS partnership with George Mason University reflect NASS’s continued commitment to improve U.S. agricultural production, sustainability and food security. 



CropScape is operated by NASS’s Research and Development Division and hosted and maintained by the Center for Spatial Information Science and Systems at George Mason University. For more information about CropScape, and the Cropland Data Layer visit http://nassgeodata.gmu.edu/CropScape.




2.02.2011

Refugee flow visualization

A colleague and I are doing some work on refugees and ran across this excellent vizualization of UNHCR data here. This is how they describe it:
Since 1950, the United Nations High Commissioner for Refugees is mandated with the coordination of aid and assistance for refugees worldwide. According to its self-description, its primary purpose is to safeguard the rights and well-being of refugees. Over 6,000 people in more than 110 countries work for the UNHCR. Founded in 1951 as a means to assist the more than one million people who were still uprooted after World War II, the agency's mandate covered about 10 million refugees in 2009. This visualization attempts to give a comprehensive overview of the phenomenon of flight and expulsion, an ongoing issue of global scale and extreme complexity. 

Based on the annual UNHCR Refugee Report, the application allows views from different perspectives on the extensive dataset, highlighting different aspects. The idea for this visualization originated from a class project on the topic of mapping global tendencies at Potsdam University of Applied Sciences in 2008. The current application's interface was completely rebuilt in late 2009.

2.01.2011

What it means to be in a nondemocratic developing country


Like I assume most of the people who read this blog, I've been watching events unfold in Egypt with a mix of (mostly) hope and (some) worry. Ignoring for the moment possible outcome trajectories, the specifics of what's been going on, the response from other countries, and everything else, I think it's interesting to focus for a second on why and how Egypt got here:
"... a carnival atmosphere descended on the square, where vendors offered food at discount prices and protesters posed for pictures in front of tanks scrawled with slogans like, '30 years of humiliation and poverty.'"
That's from an online NY Times article from yesterday that's been getting continuously updated (and now no longer shows the original quote). The set of events that have to go down to bring about the kind of social unrest we're seeing in Egypt aren't trivial. People routinely toss around the idea of "revolution" when discussing topics like a change in US political party or new regulations (e.g., of gun control, carbon taxation, health care...) but the costs of revolution, in particular in terms of the uncertainty of its outcome, are huge. So I think it bears thinking about for a second:

30 YEARS of humiliation and poverty. Notoriously brutal secret police. Elite capture. Enough frustration to push your way across a bridge guarded by hundreds of cops willing to turn a water cannon on you.

We often talk about development, its constraints, and the various political, economic, and historical forces which result in countries being "developed" or not. Sometimes those conversations can get very abstract. It's worth remembering that being in a typically underdeveloped, undemocratic country means dealing on a day to day basis with issues so debilitating and frustrating that you're motivated to spray paint your grievances on the side of a tank.

*Note: the graffiti on the side of the tank says "Down with Mubarak," and comes from Ramy Raoof's flickr stream, here.

Weather-driven pirate risk maps

A variety of sources point out that Naval Research Labs' James Hansen* has come up with a piracy-risk model that takes as its two major sources of input current and forecasted weather and in-field reports on pirate activity:
"Usually, I'm doing theoretical stuff down in the weeds," said Hansen, a Seattle-area native and applied mathematician at the Naval Research Laboratory in Monterey, Calif. "This is the only project where I can actually show pictures of the impact," he said, projecting images of Somali boatmen armed with missile-launchers and automatic weapons.
The quote is from an article in the Seattle Times about a presentation that Hansen gave at the American Meteorological Society meeting. The model is driven by the fact that most if not all modern piracy depends on small, fast boats that can evade long-distance detection and can outpace larger slower cargo ships. In heavy weather the boats can't operate. Combine weather forecasts with observed pirate activity and voilà.

I can't locate any sort of working paper at present, so if any of y'all locate it please do send it to me. And as I wrote to the sdev-internal email list: someone please please please write a paper using this ASAP. Just be careful of your exclusion restrictions.

* As Sol points out: "How many climate scientists are named James Hansen? I now know of 3."

1.27.2011

Histories of Numerical Climate Models

Meteorology Project, 
Institute for Advanced Study, Princeton, 1952. 
Left to right: Jule Charney, MANIAC I, Norman Phillips, 
Glenn Lewis, N. Gilbarg, George Platzman.
I was recently doing some background reading on the history of general circulation models (GCMS) for a paper and thought I'd share two of the nice histories I found.  The first is one that I've shared with many colleagues, both for information and for inspiration:

General Circulation Models of Climate
ABSTRACT: The climate system is too complex for the human brain to grasp with simple insight. No scientist managed to devise a page of equations that explained the global atmosphere's operations. With the coming of digital computers in the 1950s, a small American team set out to model the atmosphere as an array of thousands of numbers. The work spread during the 1960s as computer modelers began to make decent short-range predictions of regional weather. Modeling long-term climate change for the entire planet, however, was held back by lack of computer power, ignorance of key processes such as cloud formation, inability to calculate the crucial ocean circulation, and insufficient data on the world's actual climate. By the mid 1970s, enough had been done to overcome these deficiencies so that Syukuro Manabe could make a quite convincing calculation. He reported that the Earth's average temperature should rise a few degrees if the level of carbon dioxide gas in the atmosphere doubled. This was confirmed in the following decade by increasingly realistic models. Skeptics dismissed them all, pointing to dubious technical features and the failure of models to match some kinds of data. By the late 1990s these problems were largely resolved, and most experts found the predictions of overall global warming plausible. Yet modelers could not be sure that the real climate, with features their equations still failed to represent, would not produce some big surprise.
And here is one of my favorite passages about the birth of the enterprise:
In 1922, the British mathematician and physicist Lewis Fry Richardson published a more complete numerical system for weather prediction. His idea was to divide up a territory into a grid of cells, each with its own set of numbers describing its air pressure, temperature, and the like, as measured at a given hour. He would then solve the equations that told how air behaved (using a method that mathematicians called finite difference solutions of differential equations). He could calculate wind speed and direction, for example, from the difference in pressure between two adjacent cells. These techniques were basically what computer modelers would eventually employ. Richardson used simplified versions of Bjerknes's "primitive equations," reducing the necessary arithmetic computations to a level where working out solutions by hand seemed feasible. Even so, "the scheme is complicated," he admitted, "because the atmosphere itself is complicated."  
The number of required computations was so great that Richardson scarcely hoped his idea could lead to practical weather forecasting. Even if someone assembled a "forecast-factory" employing tens of thousands of clerks with mechanical calculators, he doubted they would be able to compute weather faster than it actually happens. But if he could make a model of a typical weather pattern, it could show meteorologists how the weather worked. 
So Richardson attempted to compute how the weather over Western Europe had developed during a single eight-hour period, starting with the data for a day when scientists had coordinated balloon-launchings to measure the atmosphere simultaneously at various levels. The effort cost him six weeks of pencil-work Perhaps never has such a large and significant set of calculations been carried out under more arduous conditions: a convinced pacifist, Richardson had volunteered to serve as an ambulance-driver on the Western Front. He did his arithmetic as a relief from the surroundings of battle chaos and dreadful wounds.
The work ended in complete failure. At the center of Richardson's simulacrum of Europe, the computed barometric pressure climbed far above anything ever observed in the real world. "Perhaps some day in the dim future it will be possible to advance the calculations faster than the weather advances," he wrote wistfully. "But that is a dream." Taking the warning to heart, meteorologists gave up any hope of numerical modeling.

I also found this chapter in a Google-book from a decade ago which had a very nice introduction to some of the early experiments and technical innovations.  It's slightly more technical, but extremely succinct. Less history but maybe more science.

1.02.2011

Temperature and aggression

Sometimes we don't take time to think about simple "obvious" things or to seriously consider older bodies of research.  Here's a gem from 1986 that I found recently.

Ambient Temperature and Horn Honking: A Field Study of the Heat/Aggression Relationship
Environment and Behavior, March 1986
Douglas T. Kenrick and Steven W. MacFarlane
Abstract
Using a method developed in previous field studies of aggression, this study examined the influence of ambient temperature on responses to a car stopped at a green light. To investigate alternative models of the effects of high temperature on interpersonal hostility, the study was conducted during the spring and summer in Phoenix, Arizona, and included a range on the temperature humidity discomfort index up to 116 degrees F. Results indicated a direct linear increase in horn honking with increasing temperature. Stronger results were obtained by examining only those subjects who had their windows rolled down (and presumably did not have air conditioners operating).
[As someone who spends the entire day in front of a computer screen, I am jealous of people who do this kind of research:]

[and the results:]

This relatively older literature on temperature and aggression is reviewed here.  It seems to be something that psychologists studied for a while, but hasn't been discussed at all in the highly technical discussions of climate change impacts.  Perhaps it could add something to the recent controversy over the idea that temperature changes can lead to conflict? In my reading of the recent literature, I don't think this mechanism was ever discussed. Somehow we manage to miss simple and "obvious" mechanisms when we think about complex global processes.

(A similar case is the effect of temperature on productivity, which again should be "obvious"...) 

12.23.2010

Strategic dissent in the PRC

Yale's Chris Blattman, whose blog on development and violence is one of the more fun academic blogs out there, points to an excellent interview in the New York Review of Books with Yang Jisheng, the author of recent book called Tombstone about China's Great Famine, a.k.a. the three years of hunger and deprivation caused by the Great Leap Forward. The book is noteworthy for the fact that Yang basically went around gathering a variety of records about how horrific the famine was under the pretense of doing agricultural work. If it strikes you as odd that the notoriously secretive Chinese government kept files on things like cannibalism, well:
Ian Johnson: I wondered when reading Tombstone why officials didn’t destroy the files. Why did they preserve all this evidence?

Yang Jisheng: Destroying files isn’t up to one person. As long as a file or document has made it into the archives you can’t so easily destroy it. Before it is in the archives, it can be destroyed, but afterwards, only a directive from a high-ranking official can cause it to be destroyed. I found that on the Great Famine the documentation is basically is intact—how many people died of hunger, cannibalism, the grain situation; all of this was recorded and still exists.
That potentially very embarrassing records don't generally get destroyed once they're in the system (a) makes one wonder what else is in there and (b) gives hope that at some point (hopefully in the not-too-distant future) some bright young researcher will get a nice fat chunk of data out of those records and be able to write some very cool papers.

That said, what I find even more compelling is this: given the notoriously repressive regime, how does Yang operate? He runs a "reform-oriented" journal Annals of the Yellow Emperor and not only keeps it from getting shut down, but manages to publish a very controversial (enough to be subsequently banned) book. How?
Why do you think your magazine seems to enjoy more leeway than other Chinese publications?

Because we know the boundaries. We don’t touch current leaders. And issues that are extremely sensitive, like 6-4 [the June 4th Tiananmen Square massacre], we don’t talk about. The Tibet issue, Xinjiang, we don’t write about them. Current issues related to Hu Jintao, Jiang Zemin and their family members’ corruption, we don’t talk about. If we talk just about the past, the pressure is smaller.

Now, as a total non-sinologist, and probably falling too much into the classic economic style of reasoning, I read this in two ways:
  • The first is that there's a reputational cost associated with stifling dissent (of course), and it's one that I suspect is increasing in the apparent harmlessness of the dissenter. For all the noise other governments make about human rights, everyone knows that China censors its internal critics and to a certain real-politik extent accepts it. But if China is seen as being unnecessarily repressive ("why are you going after this guy? He's writing about events that happened two generations ago") then it undermines their censoring practices in general, and they don't want that.
  • The second hews more closely to the limited amount of work I've read on how the Chinese elite views change, which is to say that many are in favor of making China less repressive but think it needs to be done piecemeal lest the country fly apart. In this light, and ignoring those in power who are more interested in elite-capture (which may, admittedly, be a dumb thing to do), people like Yang are actually *very* valuable to the ruling class. They allow a slower, more controlled and more co-optable approach towards reform. Looking at how long it takes even democratic governments to admit prior mistakes and wrong doing (Japan and WWII atrocities; the US's treatment of indigenous peoples) this seems to make a lot of sense. For China to up and say "you're right, we shouldn't have cracked down so hard at Tiananmen" would be hugely disruptive and likely terrifying for those in power, but admitting that their forebears made deadly policy mistakes much less so while still moving the country further towards openness and democracy.
In either event, the interaction displays strategic behavior on both sides: Yang recognizes there are certain subjects about which he'd like to write that he ignores because the costs are too great, and the regime recognizes that some types of dissent are either too valuable or too costly to repress. Something to keep in mind when one thinks about authoritarian rule, its limits, and their drivers, especially in places like Russia where allowable dissent seems even more circumscribed than in China.

12.22.2010

Collections of papers on climate change economics

Found these recently:

Distributional Aspects of Energy and Climate Policy
Special Issue of The B.E. Journal of Economic Analysis & Policy

The Economics of Climate Change: Adaptations Past and Present
Gary Libecap and Richard H. Steckel, editors
Forthcoming from University of Chicago Press