6.07.2011

Mountain bike races as commentary on urban infrastructure?

I don't think the organizers of this meant for this to be commentary, but what does it say about the design/organization of your urban infrastructure when professional athletes are using it as a venue for mountain bike racing?  A corollary: if professional athletes find your "walk to school/work" this challenging, what does that mean for normal people who are just trying to get themselves or their goods/services to market?







[I hope my cynicism doesn't ruin these videos for you, since they are amazing athletic/artistic feats.  Thanks to Mina for sending these.]

6.05.2011

Recent advances in Lagrangian atmospheric transport models

I liked this brief review article in Eos of some recent advances in the modeling of chemical transport models. Excerpt below, since the article is behind a pay-wall.

click to enlarge
Lagrangian models (LMs) track the movement of fluid parcels in their moving frame of reference. As such, scientists using LMs are forced, in a way, to imagine themselves moving with the parcel and experiencing the effects of advection, turbulence, and changes in the parcel’s environment.
LMs have advanced in sophistication over recent decades, allowing them to be used increasingly for both scientific and societal purposes. For example, it is common practice now for researchers around the world to apply LMs to examine a wide spectrum of geophysical phenomena. Atmospheric chemists can track intercontinental transport of pollution plumes [Stohl et al., 2002] or airborne radioactivity [Wotawa et al.,2006]. By running LMs backward in time [Flesch et al., 1995; Lin et al., 2003], instrumentalists can establish the source regions of observed atmospheric species with high computational efficiency [Ryall et al., 2001]. Therefore, LMs are being used increasingly to quantify sources and sinks of greenhouse gases by combining simulations with observations in an inverse modeling framework [Trusilova et al., 2010]. Such “top-down”emissions estimation is receiving growing acceptance as an independent tool to test the veracity of emissions inventories and to verify adherence to treaties. 
A recent indication of the tremendous societal importance of LMs was their role in predicting the spread of volcanic ash from the eruption of Eyjafjallajökull volcano inIceland. Figure 1 demonstrates the power ofLMs to accurately track the multiday dispersion of a plume as it eventually transforms into a complicated filamentary structure. The example further demonstrates the great potential of applying LMs in combination with data assimilation and inverse modeling to improve source estimates and the simulation of hazardous plumes.
As Lagrangian modeling increases in complexity and popularity, it is imperative to reexamine the physical foundations and implementation aspects of LMs used today.From this, scientists can build a road map of further steps needed to move Lagrangian modeling forward and to ensure its successful application in the future.
As opposed to Eulerian models (which use grid cells that are fixed in place), LMs are known to create minimal numerical diffusion and thus are capable of preserving gradients in tracer concentration. Additionally,Lagrangian integration is numerically stable, meaning that models can take bigger time steps. Furthermore, the Lagrangian framework is a natural way to model turbulence,as it is a closer physical analog to the pathways traced by eddies.
These advantages served as the inspiration from which Lagrangian particle dispersion models (LPDMs) have evolved, in which air parcels are modeled as infinitesimally small particles that are transported with random velocities representing turbulence. LPDMs often track many thousands to millions of particles in three dimensions and are more sophisticated than simple trajectory or puff models. With the availability of computational resources, full three-dimensional LPDM simulations that were expensive to run just a decade ago are now routinely carried out.

5.31.2011

Incentives work for online labor, too


A nice experimental paper on online labour market incentives just got presented at the ACM Conference on Computer Supported Cooperative Work (CSCW). It's by John Horton, Daniel Chen and Aaron Shaw and covers different incentives' impact on success rates for a set of simple Mechanical Turk questions. Shaw summarizes it nicely at his blog :
The results surprised us. They suggest that workers perform most accurately when the task design credibly links payoffs to a worker’s ability to think about the answers that their peers are likely to provide.
That priming technique is referred to catchily as "Bayesian Truth Serum" and its setup (from the paper online) behooves a little extra attention:
Bayesian Truth Serum or BTS (financial) “For the following five questions, we will also ask you to predict the responses of other workers who complete this task. There is no incentive to misreport what you truly believe to be your answers as well as others’ answers. You will have a higher probability of winning a lottery (bonus payment) if you submit answers that are more surprisingly common than collectively predicted.”
BTS was designed by Drazen Prelec at MIT, and you can get the original paper (I believe) here.

In short, the setup exemplifies what I think is particularly great about data analysis these days: Shaw, Horton, and Chen manage to put together a very tight, deeply informative and even slightly controversial (psych and sociological priming are not so effective) paper that really required nothing more than an internet connection, some computational power for the stats, and a clever eye. Go check it out.


5.26.2011

Google Correlate


Google Correlate goes live at Google Labs today. It provides correlative search by time or US state and returns the top most-correlated search terms and / or data series. For particularly Fight Entropy-ish content, check out terms that correlate with:
Also: their explanatory webcomic manages the rare feat of being simultaneously cute and informative.

5.25.2011

TRMM Satellite picks up Joplin tornado


Our colleague and occasional guest poster Kyle Meng points out that NASA's TRMM satellite (previously here) passed over the supercell that generated this past weekend's megatornado in Joplin, MO, generating a map of the resultant precipitation. You can find out about it here.

5.24.2011

WeatherSpark


WeatherSpark combines two of our favorite topics (data visualization and climate/weather) in one very compelling package. A few quick and interesting things to do with it in under 5 minutes:
  1. Check out predicted cyclicality of temperatures over the 24 hour cycle
  2. Note the difference between observed weather (black line in the past) versus predicted
  3. Check out weather at different physical locations (close to / far from coast; east of / west of mountains; north / south; etc.)
  4. Play around with the other, less intuitive variables (pressure, humidity...)
  5. Do 1. 2. and 3. together to detect rural vs. urban heat island effects (particularly cool)
Enjoy!

5.23.2011

Data-oriented search engine

Jon Goldhill sent me a link to his company's new data-oriented search engine, which I think has interesting potential: zanran.com

According to their website:


What is Zanran?
Zanran helps you to find ‘semi-structured’ data on the web. This is the numerical data that people have presented as graphs and tables and charts. For example, the data could be a graph in a PDF report, or a table in an Excel spreadsheet, or a barchart shown as an image in an HTML page. This huge amount of information can be difficult to find using conventional search engines, which are focused primarily on finding text rather than graphs, tables and bar charts.


Put more simply: Zanran is Google for data.


How it works… technology overview
Zanran doesn't work by spotting wording in the text and looking for images – it's the other way round. The system examines millions of images and decides for each one whether it's a graph, chart or table – whether it has numerical content.
The core technology is patented computer vision algorithms that decide whether an image is numerical – and they're accurate (about 98%). But the huge majority of images on the internet are not graphs etc. So even though the accuracy is high, you will still get some non-numerical images.
In comparison, looking for tables is relatively simple. Once we've found a table we then have to decide whether it's essentially numerical - and we have algorithms for that.
Our programmes then take suitable text near that image and build the search engine around that text. At present, we extract tables and images from HTML, PDF and Excel files and will be processing PowerPoint and Word documents in the near future.



I've added a link on our resources page. Check it out.

5.16.2011

Columbia University's Sustainable Development PhD Graduates of 2011!

On Saturday, six of us from Columbia University's PhD program in Sustainable Development graduated amid great fanfare. In reverse alphabetical order (since Ram got to walk across the stage first):

Marta Vicarelli wrote the dissertation "Essays on Climate Risks and Vulnerability-Reduction Strategies" and will be an Assistant Professor of Economics at University of Massachusetts Amherst following a Postdoc at Yale University.

Anisa Khadem Nwachuku wrote the dissertation "Critiquing Economic Frameworks in Sustainable Development: Health Equity, Resource Management and Materialism" and is working for McKinsey & Company.

Gordon McCord wrote the dissertation "Essays on Malaria, Environment and Society" and will be an Assistant Professor at the School of International Relations & Pacific Studies at University of California San Diego.

Chandra Kiran Krishnamurthy wrote the dissertation "Essays on Climatic Extremes, Agriculture and Natural Resources" and will be a Postdoc at Umeå University of Sweden.

Solomon Hsiang wrote the dissertation "Essays on the Social Impacts of Climate" and will be a Postdoc at Princeton University.

Mukul Ram Fishman wrote the dissertation "Theoretical and Applied Dimensions of Natural Resource Management" and will be a Postdoc at Harvard University.

Jump if you're a doctor!

5.14.2011

Are Temperature and Incentives Compliments or Substitutes? Evidence from 1947

Here's another gem from the lab of Norman Mackworth (which in my head is looking increasingly like the Dharma Initiative): "High Incentives Versus Hot and Humid Atmospheres in a Physical Effort Task" N. H. Mackworth (British Journal of Psychology, 1947).  The setup is very similar to my last post, except this time the workers are doing arm curls until complete exhaustion:


But Mackworth varied whether the worker was encouraged to push themselves to do more (verbally and visually).  In all cases, the workers with encouragement did more arm curls.  But at high temperatures, this margin dropped substantially (see fig). In this case, it seems like moderate temperatures and incentives are compliments.  This sounds like unfortunate news for hot developing countries...

[For a review of what's happened since 1947 in this field of ergonomics, see the book chapter here.]

5.13.2011

Which health supplements actually work?


Since we're pretty big on data visualization here on Fight Entropy I thought I'd point out that the guys over at Information is Beautiful have updated their great Snake Oil infographic on nutritional supplements. It does an excellent job of summarizing the current state of research on a fairly sprawling and contentious topic. Go check it out.

Now if they'd only do one on climate phenomena...

5.12.2011

Are Temperature and Human Capital Compliments or Substitutes? Evidence from 1946

My own work has focused on whether economic productivity can be influence by temperature through its impact on worker productivity. I recently dug up "Effects of Heat on Wireless Telegraphy Operators Hearing and Recording Morse Messages" by N. H. Mackworth (British Journal of Industrial Medicine, 1946) and have decided its one of my favorite papers. The British military asked Norman Mackworth to put Morse code operators in rooms of varying temperature and humidity and recorded the number of errors they made. These guys were put to work in 3 hour stretches, decoding random sequences of letters and numbers for 5-7 weeks (see fig).  

The main result is stark.  The operators who were considered "exceptionally skilled" (based on their error rates at low temperatures) were hardly affected by the heat. But the less skilled operators had error rates that went through the roof when temperatures rose (see below). Apparently, moderate temperatures and human capital are substitutes (at least in this situation). This is good news for many of the hot, developing countries around the world...

5.10.2011

How important is brain temperature? Ask a large predator fish

This is the kind of thing I can't believe they didn't teach me in elementary school.  I knew the platypus was exceptional among mammals for its beak and eggs, but I never knew that some cold-blooded animals (ectotherms) were actually partially warm-blooded (regional endothermy is the technical name). 

I was doing a literature review of the effects of temperature on brain function and cognition, when I ran across this amazing literature. In a famous 1982 Science article, Francis Carey of WHOI demonstrated that swordfish had evolved a specialized organ that simply sat next to their brain and kept it warm by burning calories quickly.  This was important, he argued, because these fish rapidly dove to depths where the water temperature was 20 degrees (C) colder than their normal environment. Because brain function is important to these hunters, it seemed reasonable that it was worth it for them to evolve specialized organs to keep their brains warm.


Sound too fantastic? Since then, cranial endothermy has also been documented in some varieties of sharks and tuna.  Because these species are so far from one another (in an evolutionary sense) and many of their more closely related relatives didn't have brain heaters, its thought that these different groups evolved similar organs independently from one another. This would suggest that maintaining a relatively more stable brain temperature might have large benefits.  Now, does this apply to humans?...