Showing posts from January 17, 2011

Risks of automated stock prediction engines

A celebrety tweeted about a stock tip to his 3 million followers. By the end of the day the stock price jumped over 290%. "You can double your money right now. Just get what you can afford," Jackson tweeted about H&H; Imports, a money-losing venture out of Clearwater, Fla., that owns TV Goods, a marketing firm recently founded by Kevin Harrington. While all the online reports I read assume that his followers fell for it, I am not sold on that. I would like to know if anyone ruled out the root cause as automated systems using twitter data for stock price change prediction. Automated systems using twitter data often use follower count to compute probability of some information being true. One of my news crawlers ( ) actually uses the same twitter feed to rate technical posts on scalability. Knowing how widespread the use of twitter data is in different kind of automations, and because of how some of the way twitter data could behave is unpredictable, I would

How facebook ships code

Stumbled on a fascinating post about how facebook ships code . This level of detail is rare from an organization as big as this.  This is a very long piece... but here are a few lines from it to entice you to click on it. From framethink as of June 2010, the company has nearly 2000 employees, up from roughly 1100 employees 10 months ago.  Nearly doubling staff in under a year! the two largest teams are Engineering and Ops, with roughly 400-500 team members each.  Between the two they make up about 50% of the company. product manager to engineer ratio is roughly 1-to-7 or 1-to-10 all engineers go through 4 to 6 week “Boot Camp” training where they learn the Facebook system by fixing bugs and listening to lectures given by more senior/tenured engineers.  estimate 10% of each boot camp’s trainee class don’t make it and are counseled out of the organization. after boot camp, all engineers get access to live DB (comes with standard lecture about “with great power com

Its Logical - IAAS users will move to PAAS

Sysadmins love infrastructure control, and I have to say that there was a time when root access gave me a high. It wasn’t  until I moved to web operations team (and gave up my root access) that I realized that I was  more productive when I wasn’t dealing with day to day hardware and OS issues. After managing my own EC2/Rackspace instance for my blog for a few years , I came to another realization today that IAAS (infrastructure as a service) might be one of these fads which will give way to PAAS (Platform as a service). WordPress is an excellent blogging platform, and I manage  multiple instances of it  for my blogs (and one for my   wife’s blog ). I chose to run my own wordpress instance because I loved the same control which I used to have when I was a sysadmin. I not only wanted to run my own plugins, configured my own features, play with different kinds of caching features, I also wanted to choose my own linux distribution (Ubuntu ofcourse) and make it work the way I always w