WolframAlpha Struggles in Traffic Tests
May 15th, 2009 By: Rich Miller
Remember how the new “knowledge engine” WolframAlpha said it was ready for 175 million queries a day at launch? It turns out the service and its supercomputer-backed infrastructure hasn’t performed well in traffic load tests, and this evening’s scheduled soft launch (the official launch is Monday) could be delayed, according to the LA Times. UPDATE: The WolframAlpha team went ahead with a live “launch” broadcast, but was about three hours late with its scheduled kickoff as the WA team battled a logging database and latency between two colo sites. By 11 pm Eastern time the WolframAlpha site was live and responding to queries.
Here’s an excerpt of comments to the LAT from Stephen Wolfram, the creator of WolframAlpha: “We have several supercomputer-class compute clusters,” Wolfram said. “One of our tests was to use one cluster to simulate traffic and run it against the other cluster. And when we did that last night, we found that the through-put we got degraded horribly when we increased the amount of traffic that we were pushing from one cluster to the other. So we don’t quite understand that, and that would very much degrade the through-put that we could get.”
The Wolfram team later updated its blog, announcing its intent to launch as planned but acknowledging the scalability challenges:
“One of the biggest challenges we’re navigating today is effectively linking our supercomputers together,” the WA team wrote. “We’ve been switching on more and more compute capacity, with the expectation of having full capacity available on Monday. Tonight, we’re looking to begin to test the system on a larger scale, get a sense of how it will behave, and continue performance tuning.”
WolframAlpha will run on infrastructure spread across five data centers, and be able to handle 175 million queries a day at launch, the company said in a blog post this week. Wolfram’s computing horsepower includes “two supercomputers, just about 10,000 processor cores, hundreds of terabytes of disks, a heck of a lot of bandwidth, and what seems like enough air conditioning for the Sahara to host a ski resort,” the company said.
Infrastructure is definitely a disadvantage of search startups when comparing to Google, Microsoft or Yahoo. Nothing beat real life stress test and they’re doing it a bit too late. I guess this is just another Cuil. The real competitors of Google are Yahoo and Microsoft. I’m using Yahoo as the default search engine and have been able to find everything. I did not miss Google one bit.
[...] il suo nuovo strumento di ricerca. Le prime impressioni d’uso di ReadWriteWeb, CNET News, Data Center Knowledge, Lifehacker, Gizmodo , TechCrunch , L.A. Times Tech Blog, Mashable , Search Engine [...]
TomPosted May 16th, 2009
This is *worse* than Cuil.
Cuil is at least slightly useful, this doesn’t return results for 90% of the stuff I type in.
They should change the name to “Worthless”
WolframPosted May 16th, 2009
Wolfram is not a search engine lol. Its a computational Engine and it is quite useful.. maybe its not useful to you but to me, it is extremely useful and has great features which I have been using.
Steve Wolfram is my new friend =P
[...] por trás do Wolfram informou que o mesmo possui uma superestrutura para lidar com o tráfego, mas parece que nas fases de testes os servidores não aguentaram a carga. Fazer esses tipos de testes é um procedimento raro em algumas empresas (principalmente algumas [...]