Let’s have a look at the most important deployment scenarios that we have for software today, there’s
- the web platform (client-side),
- the cloud and server-side,
- phones, wearables and entertainment devices,
- game consoles, and
I realized that many folks in the web sphere weren’t even aware of the existence of the Speedometer benchmark. We should change that. Speedometer is definitely not the ideal benchmark either, but we learned in 2016, that’s it’s a lot closer to real world web application patterns than anything we had before. There is an on-going effort to modernize Speedometer to also cover recent technologies ES2015, TypeScript and Webpack.
I’d like to respond to some criticism that I got for pointing to Speedometer just because V8 cannot win the official Google benchmark any more: Despite what folks might believe I truly believe in benchmarks as ways to improve the web platform! Competition is key here. But competition has to reflect real improvements, so it’s important to pick the benchmark based on real world applicability, which is honestly very hard to judge. And let’s be completely open and honest here: Apple is clearly setting the bar high for everyone wrt. real world web performance! This is and will be a major challenge for us, but I’m excited to pick up that challenge!
We have been adding ways to Chrome infrastructure to measure performance from inside the browser, which gave a lot of important insight, but is not portable across browsers. From these investigations I am concluding that Speedometer might be the best proxy for real world performance that is currently available. We will follow up with a detailed blog post about the real world performance effort soon.
I’m heavily focusing on client-side uses of V8 in the blog post. But that doesn’t mean that we don’t care about Node.js. In fact we do care a lot about Node.js applications nowadays and we are highly interested in ways to measure performance. Currently we are looking into ways how to use real world Node.js applications like yarn to drive and track performance improvements, but we are only at the beginning. We are also obviously looking at the AcmeAir benchmark. We have built a good relationship with the Node.js community this year, and we’re already seeing a lot of benefits there.