Twitter buys analytics company

Twitter, which recently announced its Promoted Tweets advertising program, has acquired the maker of a cloud-hosted Web analytics application, Twitter said Thursday.Smallthought Systems’ Trendly lets Web site owners dig deeper into the usage and traffic data that Google Analytics collects about their sites.

The Smallthought staff has become part of Twitter’s analytics team, where they will integrate Trendly features and technology into Twitter’s existing systems, as well as help develop new products.

In April, Twitter launched with a limited number of partners like Starbucks and Best Buy the Promoted Tweets program, which is designed to let companies market their products and services on the popular microblogging and social-networking site.

As with all advertising services, a key to the success of Promoted Tweets will be Twitter’s capacity to analyze the popularity and effectiveness of these ads so that campaigns can be evaluated and optimized.

The analytics for Promoted Tweets may be more challenging than for other online advertising programs for a few reasons, including the fact that the ad format for Promoted Tweets will be the same as the format for regular “tweets” and that Twitter’s usage is going through the roof, with 2 billion “tweets” posted in May, according to Web monitoring company Pingdom.

“Every day millions of people use Twitter to create, share and discover information, and as we grow, analytics becomes an increasingly crucial part of improving our service,” reads Twitter’s announcement of its Smallthought acquisition.

Credit & Resource: http://www.networkworld.com/news/2010/061010-twitter-buys-analytics.html

=-=-

How Trendly helps your web marketing

Google Analytics does a great job of collecting your data, but it does a bad job of helping you understand it. For example, at Dabble DB, we are very interested in how many people come to us after searching for online database. Here’s what that keyword’s traffic looks like for the first few months of 2009:

Google Analytics keyword traffic example

It’s definitely going up and down a lot, but we don’t really care about daily fluctuation, we care about the trend. On average, how many people should we expect each day? And is that changing?

Trendly uses a statistical model to answer that question for us. It assumes that our traffic is going to stay the same for days, weeks, or even months at a time, but every once in a while something is going to change — like our ranking for “online database” improving, sending more people our way. The red line shows how Trendly sees this keyword over the same time period:

Trendly interpretation of keyword traffic

According to Trendly, our daily visitors from “online database” went up from 24 to 40 in early January, and then again up to 50 in early February. It reports these changes as items in a news feed:

Items in a news feed

By boiling several months of data down to a couple of items in a news feed, Trendly helps us keep on top of many different things at once. For example, this same feed actually tracks all of our search keywords:

Tracking all search keywords

You can see that our traffic from searches for co-founder Avi Bryant had a bump at the end of January (around the time he gave a talk at CUSEC), but went back down again. The sparklines beside each news item show those patterns concisely.

The news feed is continuous, and shows up to three years of history. If we want to see the earlier change to “online database”, we just scroll down a few weeks:

Scroll to see changes

The news feed does a great job of showing what’s changed, but it’s nice to put those individual keywords into a wider context. A chart running down the left provides the big picture:

A big chart for the big picture

The chart is locked to the same timescale as the news feed — and so, unlike most charts, time runs vertically. Each colored layer in the chart represents a single keyword. For example, the big green layer represents visits from “online database”. If I click on either the chart or the news item, the layer will pop out:

Pop-out layers

You can see how the green layer gets wider at the same time as the news item appears. The wider the layer, the more visits we get each day. The wider the chart as a whole — the sum of all the layers — the more visits we get in total from search. You can also see that Trendly tries to make things more meaningful by clustering similar keyword phrases together: The popup for “online database” shows that, while most (86%) of the searches in this cluster are for exactly “online database”, there are less frequent similar phrases that are also being included here, like “make an online database”.

Trendly isn’t just for tracking keywords. It has feeds for many of the reports you’re used to from Google Analytics: referrals, content, ad campaigns, and more. If you use goal tracking or ecommerce, Trendly also helps you track those:

  • Share/Bookmark

Comments off

What Web2.0 means to Cloud?

I discussed the subject with one of colleagues who is a Cloud Computing architect. I’m logging what my comment here

=-=-

To continue our previous talk is a huge discussion. I’d recommend you could start to get involved in http://twitter.com and follow

http://twitter.com/mashable
http://twitter.com/j3ffyang -> me
http://twitter.com/OpenIBM -> I own this too as of being admin for IBM Open Source Global community

When you hit any of above, you can see the bytes come from http://aws.amazon.com actually, which is an IaaS with no doubt. Twitter is a kind of social collaboration network -> an application running over Amazon Web Services (AWS). Twitter doesn’t own any hardware resources. Whenever Twitter needs computing capability, it goes to AWS and AWS fulfills its request… on demand. Even though Twitter sometimes out of service due to its overload.

@ IaaS, AWS not only gives power of hardware (CPU, memory, disk and network…), but also provides plugin / API to connect Twitter with Hadoop… and Simple Queue Service (SQS), and Simple Database (SDB).

You shouldn’t be surprised @ Twitter’s power to gather thousand of thousand developers around it, if keeping our eyes open. (Some reasons of the motivation of social collaboration in term of Web2.0). See these:

http://tweetwheel.com
http://ftags.com
http://tweetvalue.com/
http://www.tweetizen.com/
http://twittersnooze.com/
http://mrtweet.net/home/j3ffyang
http://tweettrail.com/search/hadoop

This list is almost endless. They’re all independent of twitter.com. The above are all SaaS, plugable into Twitter.com where provides API -> http://apiwiki.twitter.com/ and http://twitter.com/downloads – @ PaaS

This is an ecosystem.

  • Share/Bookmark

Comments off

Innovative ways to use social software in combination

Collaboration cross firewall: I started to get involved in a Cloud project and had to travel to Shanghai every week in past one month. While out of my office during trip, or boarding @ airport, or sitting in cab, I’m out of the company firewall! That means I can’t access BlogCentral. My brain must “stop” in front of firewall. If I want to keep it thinking, I’d switch to public Web2.0 places.
Ease of combination: Have you used Ping.fm ? Or you may ask what Ping.fm is? In short, it’s a hub of collaboration and a practice of innovation. Let’s see a scenario: In a cab, I see a scene. I capture a photo by using my Nokia E71 smartphone (iPhone works too). After shooting, a small icon of mail prompts. Click mail icon, I’m in mail mode with the capture picture as an attachment. I pick an email address from contact list. Such email address is like vfr45t@ping.fm that was randomly assigned by Ping.fm . Whatever message sent to such account will automatically be updated into my accounts @ Twitter, Facebook, del.icio.us, LinkedIn, MySpace, Blogger, Identi.ca, WordPress, Flickr, FriendFeed, Mashable, etc, you name it… All these could be finished within one minute. (Security is another topic though. I’d very carefully post the data in this very web2.0 way.)
Performance: WordPress is good. Working on company’s BlogCentral is a challenge. I lean to write @ twitter.com as I’m lazy and don’t have to write much :-P

  • Share/Bookmark

Comments off

Nokia E71 Smartphone doesn’t need a cable

I’m using Linux as my primary desktop. And in the contrast, currently Nokia doesn’t supply application(s) to support Linux. I have to find a way to get rid of USB cable…

The first application I need is SIC!FTP. With this application, all files (in batch) could be transferred between my phone and Linux machine(s) through wifi, even without SIM card.

Let’s see what else are installed in which you might get interested too. I walk you through one by one

screenshot0001

LotusTraveler: Light Lotus Notes client on Symbian platform. Needs a gateway to get authenticated to office Notes mail server.

ProblemReport: with LotusTraveler. Have never used that once. Hopefully will not.

MobClient: Lotus Mobility Client. A VPN client on symbian

Putty: This is great tool that gives a native SHELL to access and control any Unix/ Linux machine.

GoogleMap: v3.0 with Latitude = maps + location of your friend

SpotOn: keeps backlid and/ or camera light on.

Mobbler: This is a great Web2.0 online music radio that allows you tag your loved tracks (banable too) and bridges you into community with Common Interest.

fring: You know this one

5ud0ku: Sudoku. There are a lot of similar. This is the best. Try it while waiting @ airport.

Sametime: Lotus messenger

Gmail: Application on Symbiam, which contains mail thread function.

screenshot0002

Opera Mini: the most popular browser on mobile. Looking forward to Firefox Fennec

WorldMate: free from Nokia to assist you during travel in diff timezone, weather and currency exchange. Heard it eat traffic a lot.

SIC!FTP: If you’re a Linux guru, you’d love this to turn your phone to a real computer.

Gizmo5 & Skype (beta) as they are.

Screenshot: is a tool that I used to capture screens.

  • Share/Bookmark

Comments off

Is Eucalyptus ready to be your private cloud?

Source: http://highscalability.com/eucalyptus-ready-be-your-private-cloud

Rich Wolski, professor of Computer Science at the University of California, Santa Barbara, gave a spirited talk on Eucalyptus to a large group of very interested cloudsters at the Eucalyptus Cloud Meetup. If Rich could teach computer science at every school the state of the computer science industry would be stratospheric. Rich is dynamic, smart, passionate, and visionary. It’s that vision that prompted him to create Eucalyptus in the first place. Rich and his group are experts in grid and distributed computing, having a long and glorious history in that space. When he saw cloud computing on the rise he decided the best way to explore it was to implement what everyone accepted as a real cloud, Amazon’s API. In a remarkably short time they implement Eucalyptus and have been improving it and tracking Amazon’s changes ever since.

The question I had going into the meetup was: should Eucalyptus be used to make an organization’s private cloud? The short answer is no.

The project is of high quality, the people are of the highest quality, but in the end Eucalyptus is a research project from a university. As an academic project Eucalyptus is subject to changes in funding and the research interests of the team. When funding sources dry up so does the project. If the team finds another research area more interesting, or if they get tired of chasing a continuous stream of new Amazon features, or no new grad students sign on, which will happen in a few years, then the project goes dark.

Fears over continuity have at least two solutions: community support and commercial support. Eucalyptus could become community supported open source project. This is unlikely to happen though as it conflicts with the research intent of Eucalyptus. The Eucalyptus team plans to control the core for research purposes and encourage external development of add-on service like SQS. Eucalyptus won’t go commercial as University projects must stay clear from commercial pretensions. Amazon is “no comment” on Eucalyptus so it’s not clear what they would think of commercial development should it occur.

Taken together these concerns imply Eucalyptus is not a good base for an enterprise quality private cloud. Which they readily admit. It’s not enterprise ready Rich repeats. It’s not that the quality isn’t there. It is and will be. And some will certainly base their private cloud on Eucalyptus, but when making a decision of this type you have to be sure your cloud infrastructure will be around for the long haul. With Eucalyptus that is not necessarily the case. Eucalyptus is still a good choice for it’s original research purpose, or as cheap staging platform for Amazon, or as base for temporary clouds, but as your rock solid private cloud infrastructure of the future Eucalyptus isn’t the answer.

The long answer is a little more nuanced and interesting.

The primary purpose for Eucalyptus is research. It was never meant to be our little untethered private Amazon cloud. But if it works, why not?

Eucalyptus is Not a Full Implementation of the Amazon Stack

Eucalyptus implements most of EC2 and a little of S3. They hope to get community support for the rest. That of course makes Eucalyptus far less interesting as a development platform. But if your use for Eucalyptus is as an instant provisioning framework you are still in the game. Their emulation of EC2 is so good RightScale was able to operate on top of Eucalyptus. Impressive.

But even in the EC2 arena I have to wonder for how long they’ll track Amazon development. If you are a researcher implementing every new Amazon feature is going to get mighty old after a while. It will be time to move on and if you are dependent on Eucalyptus you are in trouble. Sure, you can move to Amazon but what about that $1 million data center buildout?

Developing software not tied to the Amazon service stack then Eucalyptus would work great.

As an Amazon developer I would want my code to work without too much trouble in both environments. Certainly you can mock the different services for testing or create a service layer to hide different implementations, but that’s not ideal and makes Eucalyptus as an Amazon proxy less attractive.

One of the uses for Eucalyptus is to make Amazon cheaper and easier by testing code locally without out having to deploy into Amazon all the time. Given the size of images the bandwidth and storage costs add up after a while, so this could make Eucalyptus a valuable part of the development process.

Eucalyptus is Not as Scalable as Amazon

No kidding. Amazon has an army of sysadmins, network engineers, and programmers to make their system work at such ginormous scales. Eucalyptus was built on smarts, grit and pizza. It will never scale as well as Amazon, but Eucalyptus is scalable to 256 nodes right now. Which is not bad.

Rich thinks with some work they already know about it could scale to 5000 nodes. Not exactly Amazon scale, but good enough for many data center dreams.

One big limit Eucalyptus has is the self-imposed requirement to work well in any environment. It’s just a tarball you can install on top of any network. They rightly felt this was necessary for adoption. Saying to potential customers that you need to setup a special network before you can test this software tends to slow down adoption. By making Eucalyptus work as an overlay they soothed a lot of early adopter pain.

But by giving up control of the machines, the OS, the disk, and the network they limited how scalable they can be. There’s more to scalability than just software. Amazon has total control and that gives them power. Eucalyptus plans to make more invasive and more scalable options available in the future.

Lacks Some Private Cloud Features

Organizations interested in a private cloud are often interested in:

  • Control
  • Privacy and Security
  • Utility Chargeback System
  • Instant Provisioning Framework
  • Multi-tenancy
  • Temporary Infrastructure for Proof of Concept for “Real” Provisioning
  • Cloud Management InfrastructureEucalyptus satisfies many of these needs, but a couple are left wanting:
  • The Utility Chargeback System allows companies to bill back departments for the resources they use and is a great way get around a rigid provisioning process and still provide accountability back to the budgeting process. Eucalyptus won’t do this for you.
  • A first class Cloud Management Infrastructure is not part of Eucalyptus because it’s not part of Amazon’s API. Amazon doesn’t expose their internal management process. Eucalyptus is adding some higher level management tools, but they’ll be pretty basic.These features may or may not be important to you.

    Clouds vs Grids

    Endless pixels have been killed defining clouds, grids, and how they are different enough that there’s really a whole new market to sell into. Rich actually makes a convincing argument that grids and clouds are different and do require a completely different infrastructure. The differences:

    Cloud

  • Full private cluster is provisioned
  • Individual user can only get a tiny fraction of the total resource pool
  • No support for cloud federation except through the client interface
  • Opaque with respect to resources

    Grid

  • Built so that individual users can get most, if not all of the resources in a single request
  • Middleware approach takes federation as a first principle
  • Resources are exposed, often as bare metal

    Related Articles

  • Get Off of My Cloud by M. Jagger and K. Richards.
  • Rich Wolski’s Home Page
  • Enomaly
  • Nimbus
    • Share/Bookmark

    Comments off

    j3ffyang @ twitter

    • Share/Bookmark

    Comments off

    j3ffyang @ twitter

    • Share/Bookmark

    Comments off

    « Previous entries Next Page » Next Page »