Archive for the ‘Uncategorized’ Category

Google, Search Ranking, and the Fight Against Piracy

Monday, October 20th, 2014

Last month, Rahul Telang and I blogged about research we conducted with Liron Sivan where we used a field experiment to analyze how the position of pirate links in search results impact consumer behavior. Given this research, we were very interested in Google’s announcement last Friday that they were changing their ranking algorithm to make pirate links harder to find in search results.

According to the announcement, Google changed their ranking algorithm to more aggressively demote links from sites that receive a large number of valid DMCA notices, and to make legal links more prominent in search results. The hope is that these changes will move links from many “notorious” pirate sites off the first page of Google’s search results and will make legal content easier to find.

One might ask whether these changes — moving pirate results from the first to the second page of search results and promoting legal results — could have any effect on user behavior. According to our experimental results, the answer seems to be “yes, they can.”

Specifically, in our experiment we gave users the task of finding a movie of their choosing online. We then randomly assigned users to a control group and to two treatment groups: one where pirate links were removed from the first page of search results and where legal links were highlighted (legal treatment), and one where legal links were removed from the first page of search results (piracy treatment).

Our results show that users are much more likely to purchase legally in the legal treatment condition than in the control. We also found that these results hold even among users who initially search using terms related to piracy (e.g., by including the terms “torrent” or “free” in their search, or by including the name of well-known pirate sites), suggesting that even users with a predisposition to pirate can be persuaded to purchase legally through small changes in search results.

Given our findings, reducing the prominence of pirated links and highlighting legal links seems like a very promising and productive decision by Google. While it remains to be seen just how dramatically Google’s new search algorithm will reduce the prominence of pirate links, we are hopeful that Google’s efforts to fight piracy will usher in a new era of cooperation with the creative industries to improve how consumers discover movies and other copyrighted content, and to encourage users to consume this content through legal channels instead of through theft. If implemented well, both Google and studios stand to benefit significantly from such a partnership.

Does Paying Olympians for Winning Medals Make Them More Likely to Win?

Wednesday, August 15th, 2012

Missy Franklin, America’s newest star swimmer and most winning Olympian this summer, took home $110,000 in addition to her four gold and one bronze medals. That’s because the United States Olympic Committee pays athletes $25,000 for each gold, $15,000 for each silver, and $10,000 for each bronze medal they win. The United States isn’t alone in rewarding winning athletes. At least 42 other countries also pay winners, with payouts for gold ranging from about $11,000 in Kenya to $1.2 million in Georgia.

(click the picture to enlarge it)

Incentives might mean more than money. In 2008, medalists from Belarus received not just money, but also free meat for life.[1] At least one country includes a stick in addition to its incentive carrot. North Korea, which is apparently the basis for The Hunger Games, reportedly rewards its gold medal winners “with handsome prize money, an apartment, a car, and additional perks like refrigerators and television sets,” while “poor performances” could yield time in a labor camp.[2]

Why do countries pay winners? The most obvious answer is that they want to create an additional incentive to win. But does it? We set out to answer this question.

We put together data on each country’s medal count and medal payout scheme for the 2012 Olympics in order to test for a correlation.[3] We also control for country size and income, since those are surely the biggest predictor of how many medals a country will win: more populous countries are more likely to have that rare human who is physically built and mentally able to become an Olympic athlete, while richer countries are more likely to be able to invest in training those people.

Thus, we estimate the following regression:

Medalc = f(populationc, per capita incomec, medal payoutc), where c indicates the country. The table below shows the results. As expected, bigger and richer countries win more medals, especially gold medals. Curiously, however, medal payouts are negatively correlated with winning medals, and this correlation is statistically significant for bronze and silver medal payouts.

Table 1: Relationship Between the Number of Gold, Silver, and Bronze Medals and Country Characteristics

(including only countries for which we could find information)

What could explain this counterintuitive result?

One possibility is that it is simply wrong. Data on medal payouts do not exist in one place, so we had to search for information on each country. As a result, just because we could not find data on a country’s payouts does not mean it doesn’t have any. In the analysis above I excluded countries for which we had no information on medals. Most of the countries omitted probably did not offer rewards, but we cannot say this with certainty.

We can partially address this question by assuming—and I emphasize that this may be an inappropriate assumption—that countries for which we found no data have no payouts and re-estimating the regression. The table below shows these results. Under this assumption, the results change slightly. Gold and silver payouts become positively correlated with number of medals won, but are far from statistically significant. In other words, this analysis simply suggests that there is little, if any, correlation between awards and medals. Payouts for bronze medals, however, become positive and statistically significant.

Table 2: Relationship Between the Number of Gold, Silver, and Bronze Medals and Country Characteristics

(including all countries and assuming no information on rewards means country does not offer rewards)

Another complication is that this analysis does not take into account non-monetary payouts, such as meat-for-life, or punishments like banishment to labor camps, but we do not have a way at the moment to incorporate that information empirically.

Finding no correlation between monetary payments and medals is not surprising in some countries. In the United States, for example, $25,000—while perhaps today a sizable per-medal sum for high school student Missy Franklin—is dwarfed by the millions of dollars she can earn in endorsements now that she has won her medals.

Such valuable endorsement opportunities, however, are probably less common in other countries, while the relative value of the rewards might be much higher. So, for example, $11,000 in Kenya may provide a much stronger incentive than $25,000 in the United States. We test this hypothesis by running the original regression and excluding richer countries. I exclude the tables here, but the results do not change: even including only poorer countries, where the rewards are more likely to make a material difference in someone’s life, rewards are not significantly correlated with winning more medals, even controlling for population and income.

Another explanation for these results is that elite athletes likely compete for a host of reasons unrelated to money: because they love their sport, because they want to be the best, or for other personal reasons that give them satisfaction.

But why would payouts be negatively correlated with winning medals? My guess is that in reality they aren’t. Instead, the payouts proxy for something else. Perhaps countries that give larger monetary payouts perform worse than one would expect given their size and wealth, and hope that the payouts incent better performance by their athletes. In this case, payouts would be negatively correlated with a country’s performance, all else equal, not because they are not incentives, but because they are there because the country should be doing better.

Still, overall the evidence suggests that these payments don’t increase the medal count. And because they benefit such a small number of athletes it’s hard to argue that they are important for making it possible to make a living as an Olympic-level athlete.

Overall, if the desire is to create additional incentives to win, countries might want to re-think their reward system.

Note: I thank Corwin Rhyan and Anjney Midha for for their excellent research assistance and indulging me by hunting laboriously for data on the olympics even though we work at a think tank devoted to technology issues.



[3] We tried to find information for 2008, but could confirm information for only 10 countries.

Where do vendors to cable think the industry is heading? Evidence from trade show data, 2012

Tuesday, May 29th, 2012

For the past three years I have been collecting data about exhibitors at the NCTA trade show from the show’s website. With this year’s show having just ended, it’s time to take a look.

Exhibitor attendance

This year, the website listed 259 exhibitors, down from 271 in 2011 and 345 in 2010. These statistics somewhat exaggerate the number of companies that participate since each company at each booth counts as a separate exhibitor. So, for example, Zodiac Interactive was represented at booth ES-59 and CableNET’s booth, so is included twice.

Hot or Not?

The show website shows the categories of products, services, or technologies each exhibitor selects to describe itself. An exhibitor can select several categories. To evaluate the prevalence of each category I total the number of times each category is selected, and then divide that by the number of exhibitors to make it comparable across years.

The figure below shows the top 20 categories for 2010, 2011, and 2012. The top three categories remain constant and are not surprising, given that this is the cable show: cable programming, video on demand, and IPTV.

Top 20 Product Categories, 2010-2012


The biggest winners were cloud services, mobile apps, and “multiscreen content” (although it is possible this last category was called something else in past years), which were not (officially) represented at all in previous years but were now in the top 20. Other new categories this year included social TV, broadband services, home networking, and content navigation.

Major New Product Categories 2012

“Broadband services” is rather vague and probably does not indicate any particular new product or service. The others, however, appear to represent new developments in cable. “Home networking” is related to cable companies’ interest in home monitoring services, and “content navigation” indicates interest in user interfaces that do more than change channels.

The following table shows the biggest gainers, in percentage points, for products and services that had also been exhibited in 2010 or 2011. WiFi products and services saw the biggest increase, followed by data analysis, home information services, and business services.

Biggest Gainers 2011-1012


The following table shows the category losers. The biggest losers appear to be categories most associated with traditional cable television: pay programming, pay-per-view, program guides, and video on demand. Personal video recorders showed a sharp dropoff, perhaps corresponding to the increase in cloud services, meaning that the industry sees consumers less likely to be recording content at home as opposed to downloading or streaming it from the cloud. Educational programming decreased significantly, although “children’s programming” increased a bit (see above).

Biggest Losers 2011-2012

What does this mean?

The data themselves have certain problems that make drawing strong conclusions difficult. For example, they don’t control for the size of the exhibitors’ booths. NBCUniversal’s exhibit space (449), for example, is hardly comparable to Cycle30’s booth (2242). This problem is partly mitigated by larger booths holding multiple exhibitors and more categories. Additionally, the categories are self-reported by the exhibitors and do not appear to have strict definitions. Exhibitors have no incentive to select grossly inaccurate categories, since that would attract people unlikely to purchase their products, but exhibitors probably tend towards being overly-inclusive so as not to miss potential clients. This tendency might bias towards especially popular technologies. For example, perhaps exhibitors take liberties in claiming they offer “social TV” or “cloud services” because those contain popular buzzwords rather than because their products truly offer much in the way of those services.

2012 Cable Show Floor Plan

Despite these shortcomings in the data, they provide one source of information on where economic actors with money at stake think the industry is headed over the next year. And, according to them, the industry is moving away from its traditional role as linear video distributor to storing content in the cloud, trying to capitalize on trends in social everything, and providing other services like home monitoring.

FCC Reform Bills

Friday, November 4th, 2011

Politico’s Morning Tech reported Thursday that the release of the text of the already-approved USF order would be delayed probably until next week.  The delay of yet another adopted FCC order in being released to the public makes legislation recently introduced all the more appropriate. 

Wednesday, Rep. Walden and Sen. Heller released legislation aimed at improving agency transparency and process at the FCC.  Although  some interest groups have voiced concern that the proposed reforms on transaction reviews would benefit telecom companies, or overall would curtail the agency’s ability to protect the public interest, the proposals concerning  a cost benefit analysis of regulations are sensible – and desperately needed. 

The reforms, as described in Sen. Heller’s press release, would:

Require the Commission to survey the state of the marketplace through a Notice of Inquiry before initiating new rulemakings to ensure the Commission has an up-to-date understanding of the rapidly evolving and job-creating telecommunications marketplace.

Require the Commission to identify a market failure, consumer harm, or regulatory barrier to investment before adopting economically significant rules. After identifying such an issue, the Commission must demonstrate that the benefits of regulation outweigh the costs while taking into account the need for regulation to impose the least burden on society.

Require the Commission to establish performance measures for all program activities so that when the Commission spends hundreds of millions of federal or consumer dollars, Congress and the public have a straightforward means of seeing what bang we’re getting for our buck.

Apply to the Commission, an independent agency, the regulatory reform principles that President Obama endorsed in his January 2011 Executive Order.

Prevent regulatory overreach by requiring any conditions imposed on transactions to be within the Commission’s existing authority and be tailored to transaction-specific harms.

Identifying an actual market failure a regulation is attempting to address should be a given for policymakers but, unfortunately, the FCC rarely takes that approach. Even if attempts at pre-emptive regulation are well-intended, it is virtually impossible to analyze the effects of a regulation without some measurable outcome.   TPI President Tom Lenard echoed both the need for an identified market problem and a cost-benefit analysis before enacting regulation in comments to the FCC in response to the Open Internet Order NPRM and in comments to the FTC regarding their proposed privacy framework, illustrating that such principles can, and should, apply across regulatory agencies. Recently, Scott Wallsten showed how the FCC could incorporate cost-effectiveness analysis into its decision-making process in the context of universal service reforms.

I’m crossing my fingers that some iteration of Rep. Walden and Sen. Heller’s legislation actually passes.  It’s a great start at sensible, meaningful reform to the agency.

Health Information Technology, High-Skilled Immigration, and Tax Administration: Radio Interview

Friday, October 14th, 2011

I was a guest on Progressive Radio Network’s “Of Consuming Interest” on September 9th, where I spoke about my work at TPI on health information technology, high-skilled immigration, and tax administration.

In my conversation with radio host Jim Turner, I discussed links between health policy and technology. I outlined the effects innovation can have on costs—to raise or reduce them—and the importance of looking at evidence to make sure policies are on the right track. I also talked about how technology affects privacy, both broadly and more specifically with regard to electronic health records. Privacy is important for consumers but privacy is not free—there are tradeoffs that require striking a balance. For example, stringent privacy rules have slowed hospitals’ adoption of electronic records, resulting in higher infant mortality.

Jim Turner and I also talked about issues involving federal subsidies to health information technology. While such technologies have the potential to spur innovation, reduce costs, and improve patient care, the roughly $30 billion provided to health care providers to speed the adoption of electronic health records in the 2009 economic stimulus could result in substantial waste and unintended consequences, even slowing the adoption of electronic records. As I argued in published comments to proposed program rules, these subsidies may end up funding activities already underway rather than inducing new investment and innovation. They can also backfire with results opposite to their intent if complex rules and uncertainties about qualifying for payment increase investment risk.

Health information technologies were the subject of the Aspen Forum workshop session I organized on the Internet, social media, and drug advertising. Consumers need information because they are playing an increasingly active role in their health care, and they are increasingly turning to the Internet and social media. Advertising goes hand in hand with public information and studies show that the benefits of prescription drug advertising outweigh the costs. Indeed, restricting information about approved products results in the dissemination of inaccurate information and counterfeit products. In a recent opinion, the Supreme Court reaffirmed that drug advertising is protected speech under the constitution.

Turning to immigration and innovation, I said that although immigration is always controversial, especially when unemployment is high, most analysts agree that lifting our stringent caps on immigration by scientists and engineers would boost innovation, productivity, and economic growth. What is less well understood is that high-skilled immigrants pay substantially more in taxes than they receive in federal benefits and are a plus for the federal budget, as my study showed. In response to Jim’s question about immigrants potentially displacing American workers, I pointed out that immigrants with advanced degrees tend to be complementary with domestic workers rather than substituting for them, resulting in higher earnings and more investment. But high-skilled immigration policy has been held hostage to comprehensive immigration reform, which is highly controversial as it involves border control issues and the problem of undocumented aliens.

Innovation in computer technology has led many people to assume that having the government prepare individual tax returns would reduce tax compliance costs. But, a study I co-wrote with Prof. Joseph Cordes of George Washington University examined the evidence and concluded that implementing such a program is not advisable. Filers may not realize significant cost savings because checking a return for completeness and accuracy requires much of the same work as preparing a return. Advances in tax preparation software and other assistance have sharply reduced the cost of tax preparation, reducing the potential savings from return-free filing. Further, additional costs to employers and other payers of income would be large and would disproportionally burden small businesses—employers’ data reporting deadlines would have to be advanced to allow tax refunds to be timely, which people count on. A return-free system would also introduce problems regarding privacy, security, and taxpayers retaining liability for errors in government-prepared returns, which could pose a particular issue for low-income filers.

Please go to the Of Consuming Interest Website to hear the full interview.

Spectrum Allocation in Japan

Tuesday, July 5th, 2011

I’m working on a case study of broadband in Japan. In the process I’ve translated the spectrum map for 335MHz-2.2GHz into English. Because I have not seen this in English I’m posting it here for anyone who might be interested. The translations are based on Google Translate — free to send me any corrections.

Research Roundup: Cyber Security, Network Neutrality and More

Monday, June 27th, 2011

This edition of Research Roundup highlights a paper by Amalia R. Miller and Catherine Tucker on the risks of publicized data breaches in the health sector. Miller and Tucker perform one of the first empirical analyses of the medical sector by looking at how hospitals have adopted encryption software over time. They find that “the use of encryption software does not reduce overall instances of publicized data loss. Instead, its installation is associated with an increase in the likelihood of publicized data loss due to fraud or loss of computer equipment.” (p 3) The authors speculate that focusing on encryption software may be to the detriment of implementing effective internal access controls and lead to employee carelessness. In other words, without human-based company processes that complement encryption’s effectiveness, the risks for data losses could increase with the software’s implementation.

(Click through to the full post to see the abstract and link to this paper and 11 others on topics from privacy to copyright policy)


Where is the USF Really Going?

Friday, March 18th, 2011

Our own Scott Wallsten participated in a Heartland InfoTech and Telecom News podcast to discuss his recent paper, “The Universal Service Fund: What Do High-Cost Subsidies Subsidize?“”  Just how much of of the funds are going to expenses not directly related to providing telecommunications service?  According to Scott’s research, 59 cents of every dollar is used for administrative and overhead.

The podcast covers a brief description of the policy goals of the Universal Service Fund, issues with the way the program is funded and distributed, and the incentives resulting from the subsidies for firms to increase costs.  In addition to discussing reforms underway to shift the program to subsidize broadband services, Scott also proposed specific reforms, including focusing on low-income assistance and distributing funds directly to consumers.

The podcast, hosted by Bruce Edward Walker, managing editor of Infotech & Telecom News, can be found on the Heartland Institute website.

We’re Number 13!

Thursday, February 17th, 2011

The Global Think Tanks Index, compiled by the Think Tanks and Civil Societies Program at the University of Pennsylvania, has ranked TPI as one of the top science and technology think tank in the world.  Of the top 25 (table 18), we are very pleased to be number 13!

The rankings were determined by a large group of experts and peer institutions, including journalists, donors, intergovernmental organizations, academic institutions, and think tank leaders.  The full report in available at  

And, congrats to ITIF for making the list, too!

Research Opportunity – Program on Digital Communications

Sunday, January 23rd, 2011

For the second year, Time Warner Cable is sponsoring a research program on digital communications.  Scott Wallsten was asked to write an essay for the 2010 program, which was published by both TWC and in the Federal Communications Law Journal.  Other authors from last year’s collection include John Palfrey, Dale Hatfield, Nicol Turner-Lee, and Christopher Yoo.

The details:

Time Warner Cable has announced the second year of its Research Program on Digital Communications, which awards stipends designed to foster research dedicated to increasing understanding of the benefits and challenges facing the future of digital technologies in the home, office, classroom and community. The 2011 Research Announcement sets forth the program’s guidelines and the list of research questions. Researchers affiliated with universities and not-for-profits are eligible to apply for the stipends.  Applicants are asked to write a three page summary outlining their approach to one of the topics and to submit a brief resume for each author. Multidisciplinary teams are encouraged, to provide the broadest possible insights. More information can be found at the research program website or by following The deadlines for submission of applications are April 1, 2011 and November 1, 2011.